Friday, September 23, 2022

Wednesday, September 21, 2022

9/23/22: AM defense

Meeting #31

Agenda:

Today is devoted to the defense.

See calendar entry for the correct videoconference link; it is supplied by AM and is not the usual link.

Minutes:

Congratulations to AM for passing her defense!


Friday, September 16, 2022

9/16/22: Continue with "Transformers From Scratch"

 Agenda & Minutes

  • Welcome to the 30th meeting, Sept. 16, 2022.
  • Updates/news/inputs/comments?
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The Mask block enforces the constraint that," and can start there next time we study this document (which is planned to be in two weeks since next week is AM's defense).
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

Friday, September 9, 2022

9/9/22: Continue with "Transformers From Scratch"

Agenda & Minutes

  • Welcome to the 29th meeting, Sept. 9, 2022.
  • Updates/news/inputs/comments?
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The [n x d_model] sequence of embedded words serves as the basis for everything that follows." We can start there next time.
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

Friday, September 2, 2022

9/2/22: More reading of "Transformers From Scratch"

 Agenda & Minutes

  • Welcome to the 28th meeting, Sept. 2, 2022.
  • Updates/news/inputs/comments?
    • Let's start as soon as the seminar is over and people have logged in.
    • New members needed.
  • Readings, viewings, etc. 
    • More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the section "Softmax" and can start there next time.
    • At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  • Readings/videos we have finished. 
    • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
    • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
    • We finished other things from before this list of finished sources was created.

 

Friday, August 26, 2022

8/26/22: Welcome back to Fall 2022!

 

 Agenda & Minutes

  • Welcome to the 27th meeting, Aug. 26, 2022.
  • Updates/news/inputs/comments?
    • Update on start time: let's plan to start as soon as the seminar is over and people have logged in.
    • New members needed.
    • This website is reorganized. See the bulleted links to pages on this website in the right column.
  • Readings, viewings, etc. 
    • Today's material: we viewed and discussed https://www.youtube.com/watch?v=F1X4fHzF4mQ.
    • Next time we may continue with: more of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to "It will probably not surprise you to learn that projecting words" a previous time and can continue on from there.
    • At some point we can discuss and vote on other sources. See the list on the page of sources.
    • Readings/videos we have finished. 
      • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
      • https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
      • We finished other things from before this list of finished sources was created.

 

Friday, August 19, 2022

8/19/22: Welcome back to Fall, 2022

 

 Agenda & Minutes

  • Welcome to the 26th meeting, Aug. 19, 2022.
  • Updates/news/inputs/comments?
    • Update on start time: let's plan to start as soon as the seminar is over and people have logged in.
    • New members needed. DB will see about putting out the word a bit.
    • This website is reorganized. See the bulleted links to pages on this website in the right column.
  • Readings, viewings, etc. 
    • Today's reading: more of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to "It will probably not surprise you to learn that projecting words" and will continue on from there next time.
    • At some point we can discuss and vote on other sources. See the list on the page of sources.
    • Readings/videos we have finished. 
      • The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
      • We finished other things from before this list of finished sources was created.