11/25/22: Continue on p. 60 of 2021 Turing Award lecture paper

 

Agenda & Minutes

• Welcome to the 40th meeting, Nov. 25, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• We started at "Breakthroughs in speech and object
  recognition" on p. 60 of the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. Next time we will start with section heading "Recent Advances" on p. 61.

The meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

11/18/22: Continuing with the Turing award lecture paper

Agenda & Minutes

• Welcome to the 39th meeting, Nov. 18, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• We got up to "Breakthroughs in speech and object
  recognition" on p. 60 of the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We will start there next time.
  

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

11/11/22: Start reading the 2021 Turing Award lecture paper

Agenda & Minutes

• Welcome to the 38th meeting, Nov. 11, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome. We're starting a new reading.
  
• Readings, viewings, etc. 
• We started on the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250 and got through p. 59. So we can start with p. 60 next time.

 The meeting ended here.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

11/4/22: Video on transformers

 

 Agenda & Minutes

• Welcome to the 37th meeting, Nov. 4, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome, and we're starting a new video and new reading.
  
• Readings, viewings, etc. 
• We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
  
• next time we will start on the 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.