2/23/24: Continue reading "Sparks of Artificial General Intelligence ..."

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. CT. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many.

 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

---

Agenda & Minutes

102nd meeting, Feb. 23, 2024

• Updates, announcements, questions, etc.?
• Readings: 
• We viewed and discussed a video about Geoff Hinton: https://www.youtube.com/watch?v=qrvK_KuIeJk
• Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712).
• We are up to "Throughout the paper we emphasize limitations"
• Here is a Youtube video about the article: https://www.youtube.com/watch?v=qbIk7-JPB2c (found by IE)
• We have read chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 up to "Note that the first attention layer in a decoder block pays attention to" and we can start from there.
• Suggested viewings/readings on LAMs (Large Action Models) we could evaluate:
  
• https://www.youtube.com/watch?v=22wlLy7hKP4&t=91s&ab_channel=rabbit
• https://www.youtube.com/watch?v=UOZqFMxRpWE&ab_channel=ExitsMedia
• https://www.youtube.com/watch?v=Rqh6fhcAqpw&ab_channel=ColdFusion
• https://www.youtube.com/watch?v=uJnhh7YSr5Q&ab_channel=TheAIGRID
• https://medium.com/version-1/the-rise-of-large-action-models-lams-how-ai-can-understand-and-execute-hum

• Nvidia training materials
• We could go through some of these. MM has a license for free course/resource access. See https://www.nvidia.com/en-us/training/online/.