2/16/24: Reading of "Sparks of Artificial General Intelligence ..."

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. CT. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many.

 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

---

Agenda & Minutes

101st meeting, Feb. 16, 2024

 

• Updates, announcements, questions, etc.?
• Readings: We are reading
  
• Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712).
• We continued where it says "However, impressive outputs are not enough to convince us that". Next time start with "Throughout the paper we emphasize limitations"
• Here is a Youtube video about the article: https://www.youtube.com/watch?v=qbIk7-JPB2c (found by IE)
  
• We have read chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 up to "Note that the first attention layer in a decoder block pays attention to" and we can start from there.
• Suggested viewings/readings on LAMs (Large Action Models) we could evaluate:
  
• https://www.youtube.com/watch?v=22wlLy7hKP4&t=91s&ab_channel=rabbit
• https://www.youtube.com/watch?v=UOZqFMxRpWE&ab_channel=ExitsMedia
• https://www.youtube.com/watch?v=Rqh6fhcAqpw&ab_channel=ColdFusion
• https://www.youtube.com/watch?v=uJnhh7YSr5Q&ab_channel=TheAIGRID
• https://medium.com/version-1/the-rise-of-large-action-models-lams-how-ai-can-understand-and-execute-hum

• Nvidia training materials
• We could go through some of these. MM has a license for free course/resource access. See https://www.nvidia.com/en-us/training/online/.