This Friday, we'll discuss "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks" and related papers:
"The Lottery Ticket Hypothesis: A randomly-initialized, dense neural network contains a subnetwork that is initialised such that — when trained in isolation — it can match the test accuracy of the original network after training for at most the same number of iterations."