How I animate 3Blue1Brown | A Manim demo with Ben Sparks

From 3Blue1Brown. A behind-the-scenes look at how I animate videos. Code for all the videos: https://github.com/3b1b/videos Manim: https://github.com/3b1b/manim Community edition: https://github.com/ManimCommunity/manim/ I added some more details about the workflow shown in this video to the readme of the videos repo: https://github.com/3b1b/videos?tab=readme-ov-file#workflow These lessons are funded directly by viewers: https://3b1b.co/support Timestamp: 0:00 – Intro 2:39 –…

How might LLMs store facts | Chapter 7, Deep Learning

From 3Blue1Brown. Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video’s start: https://www.alignmentforum.org/posts/iGuwZTHWb6DFY3sKB/fact-finding-attempting-to-reverse-engineer-factual-recall Anthropic posts…

Attention in transformers, visually explained | Chapter 6, Deep Learning

From 3Blue1Brown. Demystifying attention, the key mechanism inside transformers and LLMs. Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks An equally valuable form of support is to simply share the videos. Demystifying self-attention, multiple heads, and cross-attention. Instead of sponsored ad reads, these lessons…