Machine Learning Study Group
- Welcome to the 61st meeting, April 21, 2023.
- Status updates/news/inputs/comments
- Student and project updates
- PT
is working on different window sizes for the LSTM algorithm. Will give us an update on preliminary results next time.
- K is working on installing Rapids.AI.
- Superimposed text project (VK). Paper submitted to FTC 2023 on VQA on images with superimposed text.
- DD has an algorithm that detects ambiguity in words. Would a NN work better? Plan: finish the tutorial on fine tuning a large language model. Might be able to tell us about the key points in it next week.
- Any other updates/news/inputs or comments?
- https://huggingface.co/learn/nlp-course/chapter7/3?fw=tf. Evaluation was 4.0 to read more of this article.
- Next time we can evaluate https://huggingface.co/learn/nlp-course/chapter0/1?fw=tf.
- In the article "ChatGPT Strategy"
by C. Goodall, we got through item 2 in the section "10 WAYS TEACHERS
CAN USE CHAT GPT TO REDUCE WORKLOAD." We can start from there. Evaluation was 3.0 to keep reading it.
- We read https://openai.com/research/gpt-4 about GPT-4 up to the section "Steerability" but got cut off before we could evaluate it. So we will evaluate it next time.
- MC suggested: Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712). We read the abstract to decide whether to read the article. The group's evaluation was 3 6/7 out of 5 to read it.
- Here are some other things we could choose to read from in the future from as time allows.
- ChatGPT related readings, video viewings, etc.
- ChatGPT: What Is It & How Can You Use It? (searchenginejournal.com). We already read and discussed up to "The moderators at the coding Q&A website Stack Overflow ..." on 1/6/23.
- ChatGPT Is a Game-Changer. Here’s How to Use it in Your Writing. We already discussed more or less up to "2. Headline generation" on 12/30/22.
- ChatGPT Caused 'Code Red' at Google, Report Says - CNET. We already discussed up to "ChatGPT is an AI chatbot" on 12/30/22.
- 20 Entertaining Uses of ChatGPT You Never Knew Were Possible | by Mark Schaefer | Dec, 2022 | Medium
- Large Language Models: A New Moore's Law? (huggingface.co)
- The Brilliance and Weirdness of ChatGPT - The New York Times
- AI experts are increasingly afraid of what they’re creating
- Short video: ChatGPT in medicine
- At some point we can discuss and vote on other sources. See
the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
- Readings/videos/demos we have finished.
- 2/17/23; "Deep Learning for AI" by Bengio, LeCun and Hinton, the Turing
Award Lecture paper for 2018, published in CACM, 2021, https://dl.acm.org/doi/pdf/10.1145/3448250.
- ChatGPT Is a Tipping Point for AI (Harvard Business Review). Finished 1/27/23.
- 12/16/22: We demoed ChatGPT.
- 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
- Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
- The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
- https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
- We also finished other things from before this list of finished sources was created to keep a record of them.