10/14/22: VW proposal defense

Agenda & Minutes

• Welcome to the 34th meeting, Oct. 14, 2022.
• Using another video link, we'll attend VW's proposal defense today

10/7/22: Continue reading Transformers From Scratch

 

 Agenda & Minutes

• Welcome to the 33rd meeting, Oct. 7, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members welcome.
• Next week VW will do his proposal presentation (on a different video link which will be sent out).
  
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the section "Decoder Stack" and can start there next time.
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

9/30/2022: Explainable AI

Meeting #32

Agenda: IS presented on explainable AI.

9/23/22: AM defense

Meeting #31

Agenda:

Today is devoted to the defense.

See calendar entry for the correct videoconference link; it is supplied by AM and is not the usual link.

Minutes:

Congratulations to AM for passing her defense!

9/16/22: Continue with "Transformers From Scratch"

 Agenda & Minutes

• Welcome to the 30th meeting, Sept. 16, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members needed.
• SSCET conference is today in EIT: 
• https://cpb-us-e1.wpmucdn.com/wordpressua.uark.edu/dist/2/760/files/2022/09/2022-Arkansas-Engineering-Forum-SSCET-Event-Schedule.pdf
  
• Next week's meeting is AM's defense. Next week go to a different videoconference location: meet.google.com/pca-vuqi-dkw. The defense will be there.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The Mask block enforces the constraint that," and can start there next time we study this document (which is planned to be in two weeks since next week is AM's defense).
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

9/9/22: Continue with "Transformers From Scratch"

Agenda & Minutes

• Welcome to the 29th meeting, Sept. 9, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members needed.
• SSCET conference next Friday in EIT: 
• https://cpb-us-e1.wpmucdn.com/wordpressua.uark.edu/dist/2/760/files/2022/09/2022-Arkansas-Engineering-Forum-SSCET-Event-Schedule.pdf
  
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the passage "The [n x d_model] sequence of embedded words serves as the basis for everything that follows." We can start there next time.
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.

 

9/2/22: More reading of "Transformers From Scratch"

 Agenda & Minutes

• Welcome to the 28th meeting, Sept. 2, 2022.
• Updates/news/inputs/comments?
• Let's start as soon as the seminar is over and people have logged in.
  
• New members needed.
• Readings, viewings, etc. 
• More of "Transformers From Scratch," https://e2eml.school/transformers.html. We got up to the section "Softmax" and can start there next time.
  
• At some point we can discuss and vote on other sources. See the list on the page of sources. Also youtube is full of (jammed, perhaps even clogged with) videos about neural nets, transformers, etc., etc.
  
• Readings/videos we have finished. 
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We finished other things from before this list of finished sources was created.