Agenda & Minutes
- Welcome to the 25th meeting, July 29, 2022.
- Schedule note. We will skip the next two weeks, and the next meeting will be August 19.
- Updates/news/inputs/comments?
- This website is reorganized. See the bulleted links to pages on this website in the right column.
- Readings, viewings, etc.
- Thanks to VK for suggesting some videos to vote on.
- Sources to scan today.
- We considered the article associated with last week's video at https://jalammar.github.io/illustrated-transformer this time. We read the first section called "A Higher Level Look." Should we read it in more depth? 5=strongly agree, 4=agree, 3=neutral, 2=disagree, 1=strongly disagree. Vote to read more was: 4.
- Then we watched to 4:40 of another video,
https://www.youtube.com/watch?v=TQQlZhbC5ps. Vote to finish was 4.
- We ended here but next time could consider additional sources:
- Read another bit of "Transformers From Scratch," https://e2eml.school/transformers.html, and decide if we want to circle back and finish it. We have read up to the subsection "Sequence Completion" earlier and can read on from there if we wish.
- We can discuss and vote on other sources, as time allows. See the list on the page of sources.
- Readings/videos we have finished.
- The Narrated Transformer Language Model, Jay Alammar, https://www.youtube.com/watch?v=-QH8fRhqFHM, finished 7/22/22.
- Other things from before this list of finished sources was created.
No comments:
Post a Comment