AIn't What It Used to Be: 3/4/22: Getting bogged down...

Agenda & minutes:

Any report on AI study group at Arkansas State U. this week? No
List of many, many conferences: http://conferences.visionbib.com/Iris-Conferences.html.

"Attention is all you need," https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf. Attention is all you need, A Vaswani, N Shazeer, N Parmar… - Advances in neural …, 2017 - proceedings.neurips.cc … Cited by 35,980

We finished through section 3 so we can start with 3.1 next time.
This paper seems dense for our current state of understanding, so we'll put it on hold.

A longer video (44 min. but can skip last 10 minutes about negative result): https://www.youtube.com/watch?v=HfnjQIhQzME&authuser=1. We watched up to time 16:00. However this is a bit ahead of what we want so we'll put it on hold.

https://www.youtube.com/watch?v=4Bdc55j80l8
MM would like to step us through some of the resources available from NVIDIA.
MM suggests explainable AI as a reading/discussion topic.
MM suggests https://www.youtube.com/watch?v=4Bdc55j80l8&ab_channel=TheA.I.Hacker-MichaelPhi as a transformer video.
2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250
Anticipative Video Transformer, https://facebookresearch.github.io/AVT/?fbclid=IwAR1RurSM33v8baN10H9JCX_dvVNtscydsLupaB8NMgKOmNIPjIwD3XO2vOA.
"Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact," https://peerj.com/articles/cs-773.
We read the abstract. It is not clear whether we should continue reading material from it. Any opinions/thoughts/comments?
Some quantum computing references we could read as needed (from VW):

- Quantum crossing threshold (free): https://www.nature.com/articles/s41586-021-04273-w
- Crossing threshold in silicon: https://www.nature.com/articles/s41586-021-04182-y
- Three-qubit donor processor in Si: https://www.nature.com/articles/s41586-021-04292-7

AIn't What It Used to Be