Machine Learning Study Group
- Welcome to the 77th meeting, Aug. 25, 2023.
- We are finishing up, from last time, "week" 1 of the 3-week quasi-cycle (which consists of reading in week 1, and HuggingFace labs in weeks 2 and 3, interspersed with weeks with other activities).
- Status updates/news/inputs/comments
- Student and project updates?
- Schedule of activities:
- Today: read & evaluate various possibilities for the next reading
- Any other updates/news/inputs or comments?
- Status of the threads of activity:
- Here is where we are with the Huggingface lab exercises:
- To continue with the Huggingface lab program, last time we worked on chapter 1, part 3, https://huggingface.co/learn/nlp-course/chapter1/3?fw=tf. After the first paragraph we went to the collab link where we worked on that, starting to experiment with the code window
from transformers import pipeline
generator = pipeline("text-generation", model="distilgpt2")
generator(
"In this course, we will teach you how to",
max_length=30,
num_return_sequences=2,
)
Next time we can experiment a bit more and then go on from there.
- Readings: let us discuss and evaluate the abstracts of the potential readings in the page of reading possibilities.
- We have evaluated items 1-11 and will finish the list next week (instead of going on to week 2 of the 3-week quasi-cycle).
- Readings/videos/demos we have finished.
- 6/30/23: We finished https://openai.com/research/gpt-4 about GPT-4!
- 2/17/23; "Deep Learning for AI" by Bengio, LeCun and Hinton, the Turing Award Lecture paper for 2018, published in CACM, 2021, https://dl.acm.org/doi/pdf/10.1145/3448250.
- ChatGPT Is a Tipping Point for AI (Harvard Business Review). Finished 1/27/23.
- 12/16/22: We demoed ChatGPT.
- 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
- Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
- The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
- https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
- We also finished other things from before this list of finished sources was created to keep a record of them.