Machine Learning Study Group
 |
Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. |  |
Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
113th meeting, May 17, 2024
- Schedule:
- Continue reading "Sparks of Artificial General Intelligence: Early experiments ..."
- Future week: Discussion about chatbot feasibility for an industrial application with guest speaker (and UALR PhD graduate) KO.
- Updates, announcements, questions, etc.?
- Anything else?
- Readings: We are reading
- Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712).
- We got up to "2.3 Music" and can start there next time.
- Want to read another article or view another video? Let me know and I'll put it on the list below and/or we can time share across more than one article per meeting!
- VW suggests: discuss OMIM in AI.
- BL suggests: https://www.youtube.com/watch?v=dDUC-LqVrPU.
- "Excessive
use of words like ‘commendable’ and ‘meticulous’ suggests ChatGPT has
been used in thousands of scientific studies" - https://english.elpais.com/
science-tech/2024-04-25/ excessive-use-of-words-like- commendable-and-meticulous- suggest-chatgpt-has-been-used- in-thousands-of-scientific- studies.html - NIST-associated materials such as on measuring AI, including as jumping off points:
- https://ai-challenges.nist.gov/genai
- https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv
- https://www.nist.gov/news-events/events/2021/06/ai-measurement-and-evaluation-workshop
- https://www.nist.gov/programs-projects/ai-measurement-and-evaluation/ai-metrology-colloquia-series
- LLMs and the singularity:
- https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf
- Summary of it: https://poe.com/s/WuYyhuciNwlFuSR0SVEt
- But what is a GPT? Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M
- We have read chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 up to "Note that the first attention layer in a decoder block pays attention to" and we can start from there at some point.
