Agenda & Minutes
- Welcome to the 41st meeting, Nov. 25, 2022.
- Congratulations to VK for passing his final defense! A few updates to the document are needed.
- Updates/news/inputs/comments?
- Let's start at 4:00 (or as soon as the seminar is over and people have logged in, if that is a little after 4:00).
- New members welcome.
- Readings, viewings, etc.
- We are reading Turing Award lecture paper: https://dl.acm.org/doi/pdf/10.1145/3448250. We will start next time with section heading "Soft attention and the transformer architecture" on p. 61.
- At some point we can discuss and vote on other sources. See
the list on the page of sources. Also Youtube is full of videos about neural nets, transformers, etc.
- Readings/videos we have finished.
- 11/4/22: We viewed and discussed a transformers video: https://www.youtube.com/watch?v=TQQlZhbC5ps first. This seemed to be one of the better videos of the many out there.
- Transformers From Scratch," https://e2eml.school/transformers.html. Finished on 10/28/22.
- The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
- https://www.youtube.com/watch?v=F1X4fHzF4mQ. Finished 8/26/22.
- We also finished other things from before this list of finished sources was created to keep a record of them.
No comments:
Post a Comment