
This Friday, we'll discuss "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks" and related papers: "The Lottery Ticket Hypothesis: A randomly-initialized, dense neural network contains a subnetwork that is initialised such that — when trained in isolation — it can match the test accuracy of the original network after training for at most the same number of iterations." Paper: https://openreview.net/forum?id=rJl-b3RcF7 Literature survey: https://towardsdatascience.com/the-lottery-ticket-hypothesis-a-survey-d1f0f6... Additional LTH-related papers found in this post and comment: https://www.alignmentforum.org/posts/dpzLqQQSs7XRacEfK/understanding-the-lot... We'll meet Friday at 1. https://oregonstate.zoom.us/j/2739792686?pwd=VkRUeHJkYnhvTzlvZzR6YnZWNERKQT0...