2/25/22: Started on our first videos

 Agenda & minutes:

• Welcome to the 7th meeting.
• (No report on AI study group at Arkansas State U. this week)
• Any other updates/news/inputs/comments?
• Organizational reminders
• This agenda and minutes is on a blog, https://AIntwhatitusedtobe.blogspot.com. 
• This meeting will be automatically ended by Zoom after 40 min.
• Demo: The blog has been reconfigured to permit anonymous and semi-anonymous comments. Now you can discuss things after the meetings even more freely!
• Future meetings:
• Next meeting: Any suggestions or requests? 
• Readings, viewings, etc.: 
• "Attention is all you need," https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf. Attention is all you need, A Vaswani, N Shazeer, N Parmar… - Advances in neural …, 2017 - proceedings.neurips.cc … Cited by 35,980 
• We finished through 2 paragraphs of section 2, so next time we read some we can start with section 2.
• Let's read a paragraph or two to keep up the momentum.
• Featured resource: Short and long videos - 
• Summary & testing of a longer video, by VW (5 min.): https://www.youtube.com/watch?v=oiDH9DZWi5Y. We watched it.
• The longer video (44 min. but can skip last 10 minutes about negative result): https://www.youtube.com/watch?v=HfnjQIhQzME&authuser=1. We watched up to time 7:44 but did not yet discuss the slide that finished being presented at that point.
• Future reading possibilities:
• MM would like to step us through some of the resources available from NVIDIA.
• MM suggests explainable AI as a reading/discussion topic.
• MM suggests https://www.youtube.com/watch?v=4Bdc55j80l8&ab_channel=TheA.I.Hacker-MichaelPhi as a transformer video.
• 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250
• Anticipative Video Transformer, https://facebookresearch.github.io/AVT/?fbclid=IwAR1RurSM33v8baN10H9JCX_dvVNtscydsLupaB8NMgKOmNIPjIwD3XO2vOA.
• "Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact," https://peerj.com/articles/cs-773.
• We read the abstract. It is not clear whether we should continue reading material from it. Any opinions/thoughts/comments?
• Some quantum computing references we could read as needed (from VW):
• - Quantum crossing threshold (free): https://www.nature.com/articles/s41586-021-04273-w
• - Crossing threshold in silicon: https://www.nature.com/articles/s41586-021-04182-y
• - Three-qubit donor processor in Si: https://www.nature.com/articles/s41586-021-04292-7

2/18/22: Read "Attention ..." paper

Agenda & minutes:

• Welcome to the 6th meeting.
• Report on AI study group at Arkansas State U.
• MM: list of benefits for members of UA Little Rock AI and ML group -

• 1) Free membership to International Association of Pattern Recognition, https://iapr.org/
• The benefits are
• 1.1 Conference and Workshop FEEs Discount for all events organized by IAPR, https://iapr.org/conferences/
• 1.2 Free IAPR Newsletter
• 1.3 Free membership for https://iapr.org/committees/pattern-recognition-in-human-machine-interaction and https://neuro.informatik.uni-ulm.de/TC9/
• 1.4 Fees discount for all events organized by IAPR TC-(summer scoops, access to datasets)
• 2) We offer FREE NVIDIA Online classes and also Free NVIDIA workshops MM and AM are NVIDIA Certified Instructors and Ambassadors: https://www.nvidia.com/en-us/training/
• ... happy to explain to you and we need to discuss how to promote all FREE activities
• Any other updates/news/inputs/comments?
• Organizational reminders
• This agenda and minutes is on a blog, https://AIntwhatitusedtobe.blogspot.com. You can add comments if you like, just like for many other blogs.
• This meeting will be automatically ended by Zoom after 40 min.
• Future meetings:
• Feb. 25 meeting: Any ideas/requests? 
• MM may have some video material that shows animation of the transformer algorithm. Alternatively we could continue with the paper that we started reading today.
• Reading: 
• "Attention is all you need," https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf. Attention is all you need, A Vaswani, N Shazeer, N Parmar… - Advances in neural …, 2017 - proceedings.neurips.cc … Cited by 35,980 
• We finished through section 1.
• Future reading possibilities:
• MM suggests explainable AI as a reading/discussion topic.
• Anticipative Video Transformer, https://facebookresearch.github.io/AVT/?fbclid=IwAR1RurSM33v8baN10H9JCX_dvVNtscydsLupaB8NMgKOmNIPjIwD3XO2vOA.
• "Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact," https://peerj.com/articles/cs-773.
• We read the abstract. It is not clear whether we should continue reading material from it. Any opinions/thoughts/comments?
• Some quantum computing references we could read as needed (from VW):
• - Quantum crossing threshold (free): https://www.nature.com/articles/s41586-021-04273-w
• - Crossing threshold in silicon: https://www.nature.com/articles/s41586-021-04182-y
• - Three-qubit donor processor in Si: https://www.nature.com/articles/s41586-021-04292-7

2/11/22: VW videos and discussion

   Agenda & minutes:

• Welcome to the 5th meeting! 
• Any updates/news/inputs/comments?
• VW getting ready for candidacy exam.
• Organizational issues
• This agenda and minutes is on a blog, https://AIntwhatitusedtobe.blogspot.com. You can add comments if you like, just like for many other blogs.
• This meeting will be automatically ended by Zoom after 40 min. 
• Future meetings: 
• Feb. 18 meeting: We will focus on "Attention is All You Need" and read and discuss it together.
• Feb. 25 meeting: Any ideas/requests?
• VW presented his 1-minute videos and accompanying discussion: 
• https://www.youtube.com/watch?v=6Mu9sv9B4W0&ab_channel=ChrisFix;  and 
• https://www.youtube.com/watch?v=JWPzdtwO2HI
• Readings and etc. that have been suggested:
• "Attention is all you need," https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
• We read the first sentence of the abstract and discussed it quite a bit. This is a classic and important paper. We will devote a future meeting to reading through more of it, bit by bit. 

•  Attention is all you need, A Vaswani, N Shazeer, N Parmar… - Advances in neural …, 2017 - proceedings.neurips.cc … attention-weighted positions, an effect we counteract with Multi-Head Attention as described in section 3.2. Self-attention, sometimes called intra-attention is an attention … In Table 3 rows (A), we vary the number of attention heads and the attention key and value dimensions,… Cited by 35980 Related articles All 35 versions

• MM suggests explainable AI as a reading/discussion topic.
• Anticipative Video Transformer, https://facebookresearch.github.io/AVT/?fbclid=IwAR1RurSM33v8baN10H9JCX_dvVNtscydsLupaB8NMgKOmNIPjIwD3XO2vOA.
• "Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact," https://peerj.com/articles/cs-773. 
• We read the abstract last time and scanned more this time. It is not clear whether we should continue reading material from it. Any opinions/thoughts/comments?
• Some quantum computing references we could read as needed (from VW):
• - Quantum crossing threshold (free): https://www.nature.com/articles/s41586-021-04273-w
  - Crossing threshold in silicon: https://www.nature.com/articles/s41586-021-04182-y
  - Three-qubit donor processor in Si: https://www.nature.com/articles/s41586-021-04292-7

2/4/22: Presentation by AM

   Agenda & minutes:

• Welcome to the 4th meeting! 
• Any updates/news/inputs/comments?
• MM would like to offer some opportunities to our group as these opportunities arise. Thanks!
• Presentation by AM on her research work. There is no video recording but the chat window transcript is available.
• Organizational issues
• This agenda and minutes is on a blog, https://AIntwhatitusedtobe.blogspot.com. You can add comments if you like, just like for many other blogs.
• This meeting will be automatically ended by Zoom after 40 min. 
• Future meetings: 
• Feb. 11 meeting: We will focus on "Attention is All You Need" and read and discuss it together.
• Feb. 18 meeting: Any ideas/requests? 
• MM suggests explainable AI as a topic.
• VW videos can be part of the meeting.
• Readings and etc. that have been suggested:
• VW videos: https://www.youtube.com/watch?v=6Mu9sv9B4W0&ab_channel=ChrisFix; https://www.youtube.com/watch?v=JWPzdtwO2HI
• "Attention is all you need," https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
• We read the first sentence of the abstract and discussed it quite a bit. This is a classic and important paper. We will devote a future meeting to reading through more of it, bit by bit. 
• Anticipative Video Transformer, https://facebookresearch.github.io/AVT/?fbclid=IwAR1RurSM33v8baN10H9JCX_dvVNtscydsLupaB8NMgKOmNIPjIwD3XO2vOA.
• "Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact," https://peerj.com/articles/cs-773. 
• We read the abstract last time and scanned more this time. It is not clear whether we should continue reading material from it. Any opinions/thoughts/comments?
• Some quantum computing references we could read as needed (from VW):
• - Quantum crossing threshold (free): https://www.nature.com/articles/s41586-021-04273-w
  - Crossing threshold in silicon: https://www.nature.com/articles/s41586-021-04182-y
  - Three-qubit donor processor in Si: https://www.nature.com/articles/s41586-021-04292-7