9/9/22: Continue with "Transformers From Scratch"

Agenda & Minutes

• Welcome to the 29th meeting, Sept. 9, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members needed.
• SSCET conference next Friday in EIT: 
• https://cpb-us-e1.wpmucdn.com/wordpressua.uark.edu/dist/2/760/files/2022/09/2022-Arkansas-Engineering-Forum-SSCET-Event-Schedule.pdf
  
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The [n x d_model] sequence of embedded words serves as the basis for everything that follows." We can start there next time.
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.