10/21/22: More on "Transformers From Scratch"

 

 

 Agenda & Minutes

• Welcome to the 35th meeting, Oct. 21, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to "On the positive side" and can start there next time and probably finish the document.

The meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (indeed jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.