Friday, June 28, 2024

6/28/24: Presentation (JK)

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
118th meeting, June 28, 2024
 

  • Schedule:
    • Updates, news, or comments?
    • Today: Presentation by JK.
    • Current activity: Here are some potential readings and viewings, ranked with the highest evaluated ones first. We will read/view from the first one or two soon.
      1. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M.We viewed the first two segments. 6/7/24, vote was 4 6.75/8.
      2. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract.
      3. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish it was 3 5.234/6.
      4. https://ai-challenges.nist.gov/genai. 6/7/24 vote was 3 2/7. We ended at "fake or misleading information."
      5. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      6. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv. We read up to "NIST aims to expand these efforts, driving AI research and enabling progress by:". 6/7/24 vote was 3 1.75/8.
      7. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4. We read up to "Transformers are language models" and evaluated on 6/14/24 at: 3 1.75/9.
      8. https://arxiv.org/abs/2404.04125. We read up to "This trend persists even when controlling for sample-level similarity between pretraining and downstream datasets, and testing on purely synthetic data distributions." in the abstract. Evaluation on 6/14/24 was: 2 8.5/9.
      9. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film). We read up to "The film was originally marketed" on 6/14/24. Vote to read more was: 1.4.
  • Updates, announcements, questions, etc.?
    • Anything else?



at No comments:

Monday, June 10, 2024

6/14/2024: Finish evaluating new readings

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
117th meeting, June 14, 2024

  • Schedule:
    • Next week (6/21/24): No meeting.
    • Following week (6/28/24): Presentation by JK.
    • Updates, news, or comments?
    • We evaluated some other readings/viewings for more in-depth examination later. Here they are with the highest evaluated ones in order first.
      1. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M.We viewed the first two segments. 6/7/24, vote was 4 6.75/8.
      2. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract.
      3. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish it was 3 5.234/6.
      4. https://ai-challenges.nist.gov/genai. 6/7/24 vote was 3 2/7. We ended at "fake or misleading information."
      5. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      6. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv. We read up to "NIST aims to expand these efforts, driving AI research and enabling progress by:". 6/7/24 vote was 3 1.75/8.
      7. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4. We read up to "Transformers are language models" and evaluated on 6/14/24 at: 3 1.75/9.
      8. https://arxiv.org/abs/2404.04125. We read up to "This trend persists even when controlling for sample-level similarity between pretraining and downstream datasets, and testing on purely synthetic data distributions." in the abstract. Evaluation on 6/14/24 was: 2 8.5/9.
      9. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film). We read up to "The film was originally marketed" on 6/14/24. Vote to read more was: 1.4.
  • Updates, announcements, questions, etc.?
    • Anything else?


at No comments:

Friday, June 7, 2024

6/7/24: Evaluate more potential readings

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
116th meeting, June 7, 2024

  • Schedule:
    • Updates, news, or comments?
    • Current activity: Evaluate some other readings/viewings for more in-depth examination later.
      1. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 starting from "Note that the first attention layer in a decoder block pays attention to" 
      2. https://arxiv.org/abs/2404.04125
      3. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film)
      4. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M.We viewed the first two segments. 6/7/24, vote was 4 6.75/8.
      5. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract.
      6. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish it was 3 5.234/6. 
      7. https://ai-challenges.nist.gov/genai. 6/7/24 vote was 3 2/7. We ended at "fake or misleading information."
      8. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      9. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv. We read up to "NIST aims to expand these efforts, driving AI research and enabling progress by:". 6/7/24 vote was 3 1.75/8.
  • Updates, announcements, questions, etc.?
    • Anything else?
  • Reading
    • Want to read another article or view another video? Let me know and I'll put it on the list below and/or we can time share across more than one article per meeting!




at No comments:
Subscribe to: Posts (Atom)