Wednesday, September 21, 2022

9/23/22: AM defense

Meeting #31

Agenda:

Today is devoted to the defense.

See calendar entry for the correct videoconference link; it is supplied by AM and is not the usual link.

Minutes:

Congratulations to AM for passing her defense!


Friday, September 16, 2022

9/16/22: Continue with "Transformers From Scratch"

 Agenda & Minutes

  • Welcome to the 30th meeting, Sept. 16, 2022.
  • Updates/news/inputs/comments?
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The Mask block enforces the constraint that," and can start there next time we study this document (which is planned to be in two weeks since next week is AM's defense).
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

Friday, September 9, 2022

9/9/22: Continue with "Transformers From Scratch"

Agenda & Minutes

  • Welcome to the 29th meeting, Sept. 9, 2022.
  • Updates/news/inputs/comments?
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The [n x d_model] sequence of embedded words serves as the basis for everything that follows." We can start there next time.
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

Friday, September 2, 2022

9/2/22: More reading of "Transformers From Scratch"

 Agenda & Minutes

  • Welcome to the 28th meeting, Sept. 2, 2022.
  • Updates/news/inputs/comments?
    • Let's start as soon as the seminar is over and people have logged in.
    • New members needed.
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the section "Softmax" and can start there next time.
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

5/17/24: Discussion and Reading

  Machine Learning Study Grou p Welcome ! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any ...