Friday 12/30/22: ChatGPT Discussion - Everyone Welcome

Machine Learning Study Group

Agenda & Minutes

• Welcome to the 45th meeting, Dec. 30, 2022.
• Updates/news/inputs/comments
• We start at 4:00 (or as soon as the weekly seminar is over and people have logged in). Zoom automatically ends the meetings after 40 minutes.
  
• New members welcome. Anyone can join.
  
• We have some guests today. You are welcome to request weekly calendar invites, or just participate today.
  
• Readings, viewings, etc. 
• Today (and maybe next time, etc., as desired): We will discuss ChatGPT by reading and talking about one or more of the following:

• ChatGPT Caused 'Code Red' at Google, Report Says - CNET. We discussed up to "ChatGPT is an AI chatbot"
• ChatGPT: What Is It & How Can You Use It? (searchenginejournal.com)
• ChatGPT Is a Tipping Point for AI (Harvard Business Review)
• The Brilliance and Weirdness of ChatGPT - The New York Times
• ChatGPT Explains Why AIs like ChatGPT Should Be Regulated - Scientific American
• ChatGPT Is a Game-Changer. Here’s How to Use it in Your Writing. We discussed more or less up to "2. Headline generation"
• 7 Interesting Experiments with ChatGPT
• AI experts are increasingly afraid of what they’re creating
• NYT article 
• Short video: ChatGPT in medicine

We plan to end the meeting here.

• We have been reading the Turing Award lecture paper https://dl.acm.org/doi/pdf/10.1145/3448250. We got up to "Variational auto-encoders" on p. 63 and will start from there at a future meeting.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos/demos we have finished. 
• 12/16/22: We demoed ChatGPT.
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

12/23/22: Continued reading

 

 Agenda & Minutes

• Welcome to the 44th meeting, Dec. 23, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• We are reading Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We got up to "Variational auto-encoders." on p. 63 and will start from there next time.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos/demos we have finished. 
• 12/16/22: We demoed ChatGPT.
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

12/16/22: ChatGPT

 Agenda & Minutes

• Welcome to the 43rd meeting, Dec. 16, 2022.
• Updates/news/inputs/comments?
• We start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• Today we focused on running and discussing ChatGPT.

 The meeting ended here.

• We are reading Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We got up to "In supervised learning, a label" on p. 62, and will start there next time.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

12/9/22: Continue the reading.

 Agenda & Minutes

• Welcome to the 42nd meeting, Dec. 9, 2022.
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• We are reading Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We got up to "In supervised learning, a label" on p. 62, and will start there next time.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.

 

12/2/22: Reading and discussion

 Agenda & Minutes

• Welcome to the 41st meeting, Nov. 25, 2022.
•  Congratulations to VK for passing his final defense! A few updates to the document are needed.
  
• Updates/news/inputs/comments?
• Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
  
• New members welcome.
• Readings, viewings, etc. 
• We are reading Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We will start next time with section heading "Soft attention and the transformer architecture" on p. 61.

• At some point we can discuss and vote on other sources. See the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
  

• Readings/videos we have finished. 
• 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
• Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
• The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
• https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
  
• We also finished other things from before this list of finished sources was created to keep a record of them.