Friday, September 16, 2022

9/16/22: Continue with "Transformers From Scratch"

 Agenda & Minutes

  • Welcome to the 30th meeting, Sept. 16, 2022.
  • Updates/news/inputs/comments?
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The Mask block enforces the constraint that," and can start there next time we study this document (which is planned to be in two weeks since next week is AM's defense).
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

No comments:

Post a Comment