Friday, June 28, 2024

6/28/24: Presentation (JK)

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
118th meeting, June 28, 2024
 

  • Schedule:
    • Updates, news, or comments?
    • Today: Presentation by JK.
    • Current activity: Here are some potential readings and viewings, ranked with the highest evaluated ones first. We will read/view from the first one or two soon.
      1. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M.We viewed the first two segments. 6/7/24, vote was 4 6.75/8.
      2. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract.
      3. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish it was 3 5.234/6.
      4. https://ai-challenges.nist.gov/genai. 6/7/24 vote was 3 2/7. We ended at "fake or misleading information."
      5. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      6. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv. We read up to "NIST aims to expand these efforts, driving AI research and enabling progress by:". 6/7/24 vote was 3 1.75/8.
      7. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4. We read up to "Transformers are language models" and evaluated on 6/14/24 at: 3 1.75/9.
      8. https://arxiv.org/abs/2404.04125. We read up to "This trend persists even when controlling for sample-level similarity between pretraining and downstream datasets, and testing on purely synthetic data distributions." in the abstract. Evaluation on 6/14/24 was: 2 8.5/9.
      9. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film). We read up to "The film was originally marketed" on 6/14/24. Vote to read more was: 1.4.
  • Updates, announcements, questions, etc.?
    • Anything else?



at No comments:

Monday, June 10, 2024

6/14/2024: Finish evaluating new readings

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
117th meeting, June 14, 2024

  • Schedule:
    • Next week (6/21/24): No meeting.
    • Following week (6/28/24): Presentation by JK.
    • Updates, news, or comments?
    • We evaluated some other readings/viewings for more in-depth examination later. Here they are with the highest evaluated ones in order first.
      1. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M.We viewed the first two segments. 6/7/24, vote was 4 6.75/8.
      2. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract.
      3. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish it was 3 5.234/6.
      4. https://ai-challenges.nist.gov/genai. 6/7/24 vote was 3 2/7. We ended at "fake or misleading information."
      5. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      6. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv. We read up to "NIST aims to expand these efforts, driving AI research and enabling progress by:". 6/7/24 vote was 3 1.75/8.
      7. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4. We read up to "Transformers are language models" and evaluated on 6/14/24 at: 3 1.75/9.
      8. https://arxiv.org/abs/2404.04125. We read up to "This trend persists even when controlling for sample-level similarity between pretraining and downstream datasets, and testing on purely synthetic data distributions." in the abstract. Evaluation on 6/14/24 was: 2 8.5/9.
      9. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film). We read up to "The film was originally marketed" on 6/14/24. Vote to read more was: 1.4.
  • Updates, announcements, questions, etc.?
    • Anything else?


at No comments:

Friday, June 7, 2024

6/7/24: Evaluate more potential readings

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
116th meeting, June 7, 2024

  • Schedule:
    • Updates, news, or comments?
    • Current activity: Evaluate some other readings/viewings for more in-depth examination later.
      1. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 starting from "Note that the first attention layer in a decoder block pays attention to" 
      2. https://arxiv.org/abs/2404.04125
      3. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film)
      4. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M.We viewed the first two segments. 6/7/24, vote was 4 6.75/8.
      5. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract.
      6. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish it was 3 5.234/6. 
      7. https://ai-challenges.nist.gov/genai. 6/7/24 vote was 3 2/7. We ended at "fake or misleading information."
      8. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      9. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv. We read up to "NIST aims to expand these efforts, driving AI research and enabling progress by:". 6/7/24 vote was 3 1.75/8.
  • Updates, announcements, questions, etc.?
    • Anything else?
  • Reading
    • Want to read another article or view another video? Let me know and I'll put it on the list below and/or we can time share across more than one article per meeting!




at No comments:

Friday, May 24, 2024

5/31/24: VW presentation on OMIM and LLMs

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
115th meeting, May 31, 2024

  • Schedule:
    • VW presentation on OMIM and LLMs.
(The meeting ended here)
 
    • Updates or comments?
    • Future week: Discussion about chatbot feasibility for an industrial application with guest speaker (and UALR PhD graduate) KO.
    • Current activity: Evaluate some other readings/viewings for more in-depth examination later.
      1. We've been reading "Sparks of Artificial General Intelligence: Early Experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." 5/24/24 vote to read more of the paper was 3 1/5.
      2. Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. 5/24/24 vote to finish was 3  5.234/6.
      3. LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt)
      4. Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M
      5. https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv
      6. https://ai-challenges.nist.gov/genai
      7. Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 starting from "Note that the first attention layer in a decoder block pays attention to" 
      8. https://arxiv.org/abs/2404.04125
      9. https://www.youtube.com/watch?v=wjZofJX0v4M
      10. https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film)
  • Updates, announcements, questions, etc.?
    • Anything else?
  • Reading
    • Want to read another article or view another video? Let me know and I'll put it on the list below and/or we can time share across more than one article per meeting!



at No comments:

5/24/24: Evaluate some information sources

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
114th meeting, May 24, 2024

  • Schedule:
    • Updates or comments?
    • Future week: Discussion about chatbot feasibility for an industrial application with guest speaker (and UALR PhD graduate) KO.
    • Next week: VW presentation on OMIM and LLMs. Thanks!
    • This week: Evaluate our current reading and some other readings/viewings for more in-depth examination later.
      • Our current reading (which may be getting dated) is "Sparks of Artificial General Intelligence: Early experiments ..." starting at "2.3 Music" (https://arxiv.org/abs/2303.12712). We got up to "We then asked the model to describe the tune in musical terms." Vote to read more of the paper was 3.2.
      • Some new things to read/view:
        • Https://www.youtube.com/watch?v=dDUC-LqVrPU (suggested by BL). We got up to time 4:25. Vote to finish was 3 5.234/6.
The meeting ended here.

        • LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt)
        • Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M
        • https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv
        • https://ai-challenges.nist.gov/genai
        • Chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 starting from "Note that the first attention layer in a decoder block pays attention to" 
        • https://arxiv.org/abs/2404.04125
        • https://www.youtube.com/watch?v=wjZofJX0v4M
        • https://en.wikipedia.org/wiki/The_Lawnmower_Man_(film)
  • Updates, announcements, questions, etc.?
    • Anything else?
  • Reading
    • Want to read another article or view another video? Let me know and I'll put it on the list below and/or we can time share across more than one article per meeting!


at No comments:

Friday, May 17, 2024

5/17/24: Discussion and Reading

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
113th meeting, May 17, 2024

  • Schedule:
    • Continue reading "Sparks of Artificial General Intelligence: Early experiments ..."
    • Future week: Discussion about chatbot feasibility for an industrial application with guest speaker (and UALR PhD graduate) KO.
  • Updates, announcements, questions, etc.?
    • Anything else?
  • Readings: We are reading
    • Sparks of Artificial General Intelligence: Early experiments with GPT-4 (https://arxiv.org/abs/2303.12712).
      • We got up to "2.3 Music" and can start there next time.
    • Want to read another article or view another video? Let me know and I'll put it on the list below and/or we can time share across more than one article per meeting! 
      • VW suggests: discuss OMIM in AI.
      •  BL suggests: https://www.youtube.com/watch?v=dDUC-LqVrPU.
      • "Excessive use of words like ‘commendable’ and ‘meticulous’ suggests ChatGPT has been used in thousands of scientific studies" - https://english.elpais.com/science-tech/2024-04-25/excessive-use-of-words-like-commendable-and-meticulous-suggest-chatgpt-has-been-used-in-thousands-of-scientific-studies.html
      • NIST-associated materials such as on measuring AI, including as jumping off points:
        • https://ai-challenges.nist.gov/genai
        • https://www.nist.gov/ai-test-evaluation-validation-and-verification-tevv
        • https://www.nist.gov/news-events/events/2021/06/ai-measurement-and-evaluation-workshop
        • https://www.nist.gov/programs-projects/ai-measurement-and-evaluation/ai-metrology-colloquia-series
      • LLMs and the singularity:
        • https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf
        • Summary of it: https://poe.com/s/WuYyhuciNwlFuSR0SVEt
      • But what is a GPT? Visual intro to transformers | Chapter 5, Deep Learning, https://www.youtube.com/watch?v=wjZofJX0v4M

  • We have read chapter 1 part 4: https://huggingface.co/learn/nlp-course/chapter1/4 up to "Note that the first attention layer in a decoder block pays attention to" and we can start from there at some point.


at No comments:

Wednesday, May 1, 2024

5/10/24: Masters defense (PA)

 

Machine Learning Study Group

Welcome! We meet from 4:00-4:40 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu
Agenda & Minutes
112th meeting, May 10, 2024

  • Schedule:
    • This week: PA's masters defense: TRADITIONAL MACHINE LEARNING AND DEEP LEARNING NLP TECHNIQUES FOR BUILDING A MULTI CLASS MENTAL HEALTH CLASSIFIER
 
at No comments:
Subscribe to: Posts (Atom)