3/29/24: Video! (On the "Sparks of AGI" paper)

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many.

 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

---

Agenda & Minutes

107th meeting, Mar. 29, 2024

• Updates, announcements, questions, etc.?
• We may get some masters student presenting their work or defending. They are certainly welcome and invited!
• Anything else?
  
• Readings: We are reading
• As decided last time, today we viewed this Youtube video about the article: https://www.youtube.com/watch?v=qbIk7-JPB2c (found by IE)
• We got up to minute 28 in the video and will start there the next time we view this video.
  
• Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712).
• We are up to "Next, we explore how GPT-4 can generate" and will start with that next time we read from the article.
• Want to read another article or view another video? Let me know and I'll put it on the list and/or we can time share across more than one article per meeting!
  

• We have read chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 up to "Note that the first attention layer in a decoder block pays attention to" and we can start from there at some point.