10/28/22: Finish up the article Transformers From Scratch

 Agenda & Minutes

• Welcome to the 36th meeting, Oct. 28, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We finished it! Then surfed a bit. Next time we will view https://www.youtube.com/watch?v=TQQlZhbC5ps, then start on the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. 

Meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

10/21/22: More on "Transformers From Scratch"

 

 

 Agenda & Minutes

• Welcome to the 35th meeting, Oct. 21, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to "On the positive side" and can start there next time and probably finish the document.

The meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (indeed jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

10/14/22: VW proposal defense

Agenda & Minutes

• Welcome to the 34th meeting, Oct. 14, 2022.
• Using another video link, we'll attend VW's proposal defense today

10/7/22: Continue reading Transformers From Scratch

 

 Agenda & Minutes

• Welcome to the 33rd meeting, Oct. 7, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Next week VW will do his proposal presentation (on a different video link which will be sent out).
  
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the section "Decoder Stack" and can start there next time.
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.