Agenda & minutes:
- Welcome to the 9th meeting.
- Any other updates/news/inputs/comments?
- Should we try assigning a reading one week, and then discussing it the next week, or stay with the current format where we read together and discuss, a little bit at a time?
- Future meetings:
- Next meeting(s): Any suggestions or requests?
- Readings, viewings, etc.:
- We read the first three paragraphs of https://www.marktechpost.com/2022/03/07/an-introduction-to-saliency-maps-in-deep-learning/ last and could potentially continue with it next time.
- Should we try reading the first paragraph or so of several sources, and then pick one to do in more depth? Or go with picking something and trying to get through it? We could vote on this.
- Future reading possibilities:
- CNN basics: https://towardsdatascience.com/the-most-intuitive-and-easiest-guide-for-convolutional-neural-network-3607be47480
- https://e2eml.school/transformers.html: "Transformers From Scratch"
- https://www.youtube.com/watch?v=BolevVGJk18
- Jonschkowski, Brock, Learning State Representations with Robotic Priors, on disk
- Ni et al., Learning Good State and Action Representations via Tensor Decomposition, on disk
- MM would like to step us through some of the resources available from NVIDIA.
- MM suggests explainable AI as a reading/discussion topic.
- MM suggests https://www.youtube.com/watch?v=4Bdc55j80l8&ab_channel=The A.I.Hacker-MichaelPhi as a transformer video.
- 2021 Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250
- Anticipative Video Transformer, https://facebookresearch.github.io/AVT/?fbclid=IwAR1RurSM33v8baN10H9JCX_dvVNtscydsLupaB8NMgKOmNIPjIwD3XO2vOA.
- "Deep learning—a first meta-survey of selected reviews across scientific disciplines, their commonalities, challenges and research impact," https://peerj.com/articles/cs-773.
- We read the abstract. It is not clear whether we should continue reading material from it. Any opinions/thoughts/comments?
- "Attention is all you need," https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf. Attention is all you need, A Vaswani, N Shazeer, N Parmar… - Advances in neural …, 2017 - proceedings.neurips.cc … Cited by 35,980
- We have read through section 3 so we could start with 3.1 next time we look at it. However this paper seems dense for our current state of understanding, so we'll put it on hold.
- Featured resource: Short and long videos -
- A longer video (44 min. but can skip last 10 minutes about negative result): https://www.youtube.com/watch?v=HfnjQIhQzME&authuser=1. We watched up to time 16:00. However this is a bit ahead of what we want so we'll put it on hold.
- Some quantum computing references we could read as needed (from VW):
- - Quantum crossing threshold (free): https://www.nature.com/articles/s41586-021-04273-w
- - Crossing threshold in silicon: https://www.nature.com/articles/s41586-021-04182-y
- - Three-qubit donor processor in Si: https://www.nature.com/articles/s41586-021-04292-7
