The Data Science Institute hosted an optional workshop for our AI Summer participants in which we discussed the algorithms and architectures that make transformer models possible. is now open to everyone on our YouTube page.
During the workshop, the Data Science Team discusses the influential paper “Formal Algorithms for Transformers” by Mary Phuong and Marcus Hutter. You can access the paper . We recommend reading through the paper, paying particular attention to the introductory sections. Some notation may be unfamiliar, but you can leverage the power of ChatGPT, GPT4, BingChat, Claude, or Bard to help explain any complex concepts that may arise.
You can watch the workshop . And don’t forget to watch the rest of our AI Summer workshops on our .