3/31/23: GPT-4

 Machine Learning Study Group

Welcome! We start at 4:00 (or as soon as the weekly seminar is over and people have logged in). Zoom automatically ends the meeting after 40 minutes. New members are always welcome and anyone can join. You may attend any or all sessions. Also feel free to ask to be removed from the invite list at any time, as we have no wish to send unneeded emails which we all certainly get too many of.

 

Agenda & Minutes

• Welcome to the 58th meeting, March 31, 2023.
• Status updates/news/inputs/comments
• Student status updates?
  
• Any other updates/news/inputs or comments?
  

• We read from https://openai.com/research/gpt-4 about GPT-4 and ended at "We preview GPT-4’s performance by evaluating it on a narrow suite of standard academic vision benchmarks." where we can start again next time we do this article.
• At a future meeting VK will continue stepping us through the article, "ChatGPT Strategy" by C. Goodall. We will start with the section "10 WAYS TEACHERS CAN USE CHAT GPT TO REDUCE WORKLOAD."
• MC suggested: Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712). We could check the abstract and decide what else if anything in it to read.
  
• Here are some other things we could choose to read from in the future from as time allows.
  
• ChatGPT related readings, video viewings, etc.
  

• ChatGPT: What Is It & How Can You Use It? (searchenginejournal.com). We already read and discussed up to "The moderators at the coding Q&A website Stack Overflow ..." on 1/6/23.
• ChatGPT Is a Game-Changer. Here’s How to Use it in Your Writing. We already discussed more or less up to "2. Headline generation" on 12/30/22.
  
• ChatGPT Caused 'Code Red' at Google, Report Says - CNET. We already discussed up to "ChatGPT is an AI chatbot" on 12/30/22. 
• 20 Entertaining Uses of ChatGPT You Never Knew Were Possible | by Mark Schaefer | Dec, 2022 | Medium  
• Large Language Models: A New Moore's Law? (huggingface.co)
• The Brilliance and Weirdness of ChatGPT - The New York Times
• AI experts are increasingly afraid of what they’re creating
• Short video: ChatGPT in medicine

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos/demos we have finished. 
• 2/17/23; "Deep Learning for AI" by Bengio, LeCun and Hinton, the Turing Award Lecture paper for 2018, published in CACM, 2021, https://dl.acm.org/doi/pdf/10.1145/3448250.
  
• ChatGPT Is a Tipping Point for AI (Harvard Business Review). Finished 1/27/23.
• 12/16/22: We demoed ChatGPT.
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.