11/18/22: Continuing with the Turing award lecture paper

Agenda & Minutes

• Welcome to the 39th meeting, Nov. 18, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• We got up to "Breakthroughs in speech and object
  recognition" on p. 60 of the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We will start there next time.
  

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

11/11/22: Start reading the 2021 Turing Award lecture paper

Agenda & Minutes

• Welcome to the 38th meeting, Nov. 11, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome. We're starting a new reading.
  
• Readings, viewings, etc. 
• We started on the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250 and got through p. 59. So we can start with p. 60 next time.

 The meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

11/4/22: Video on transformers

 

 Agenda & Minutes

• Welcome to the 37th meeting, Nov. 4, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome, and we're starting a new video and new reading.
  
• Readings, viewings, etc. 
• We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
  
• next time we will start on the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

10/28/22: Finish up the article Transformers From Scratch

 Agenda & Minutes

• Welcome to the 36th meeting, Oct. 28, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We finished it! Then surfed a bit. Next time we will view https://www.youtube.com/watch?v=TQQlZhbC5ps, then start on the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. 

Meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

10/21/22: More on "Transformers From Scratch"

 

 

 Agenda & Minutes

• Welcome to the 35th meeting, Oct. 21, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to "On the positive side" and can start there next time and probably finish the document.

The meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (indeed jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

10/14/22: VW proposal defense

Agenda & Minutes

• Welcome to the 34th meeting, Oct. 14, 2022.
• Using another video link, we'll attend VW's proposal defense today

10/7/22: Continue reading Transformers From Scratch

 

 Agenda & Minutes

• Welcome to the 33rd meeting, Oct. 7, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Next week VW will do his proposal presentation (on a different video link which will be sent out).
  
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the section "Decoder Stack" and can start there next time.
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.