My name is Mithuna Yoganathan and I did my PhD in theoretical physics at the University of Cambridge. My channel is about the strange world of mathematics and science.
From Looking Glass Universe. The difference between this video and the last GPT I made is that that one was a toy model. It was trained on a very small set of data (the works of Shakespeare) and it doesn’t get very good. This one is much bigger, and reaches the level of GPT-2. It…
From Looking Glass Universe. Here’s the blogpost announcement- it’s pretty light on details, so I’m very sorry if I misunderstood some of it. https://deepmind.google/discover/blog/ai-solves-imo-problems-at-silver-medal-level/ The problems this year: https://www.imo-official.org/year_info.aspx?year=2024 Here’s a video solution for question 6: https://www.youtube.com/watch?v=7h3gJfWnDoc
From Looking Glass Universe. This video is a long and detailed description of AlphaFold 3. I’ve been spending a lot of time understanding the algorithm and this video is the result of that. But if you just want to get the gist of the algorithm then I’d recommend these much shorter videos I’ve made: AlphaFold…
From Looking Glass Universe. Go to https://ground.news/universe to stay fully informed. Subscribe through my link to get 40% off unlimited access this month only. Resources: fast.ai course on diffusion: https://course.fast.ai/Lessons/part2.html Algorithmic Simplicity’s video on diffusion: https://www.youtube.com/watch?v=zc5NTeJbk-k Computerphile video on diffusion: https://www.youtube.com/watch?v=1CIpzeNxIhU Super helpful video on diffusion transformers: https://www.youtube.com/watch?v=fWUwDEi1qlA
From Looking Glass Universe. Kapathy’s tutorial: https://www.youtube.com/watch?v=kCc8FmEb1nY Link to the Colab (make a copy of it to fill it in): https://colab.research.google.com/drive/10TjJAOO-oCGIWEScYF7HTbGInVqJm3yN?usp=sharing GPT theory videos: 3blue1brown’s super helpful videos on this: https://youtu.be/eMlx5fFNoYc?si=_7XgY5nOpVaRdThU and https://youtu.be/wjZofJX0v4M?si=Cc4QkmzN6rsJZuOc Algorithmic Simplicity’s video give great intuition: https://youtu.be/kWLed8o5M2Y?si=2WqR04FblltNxbF- PyTorch nn.Module tutorial: https://pytorch.org/tutorials/beginner/basics/buildmodel_tutorial.html When I didn’t understand things, I mostly just asked ChatGPT to…
From Looking Glass Universe. The new AlphaFold paper is here: https://www.nature.com/articles/s41586-024-07487-w Previous AlphaFold video: https://youtu.be/3gSy_yN9YBo The research I referenced that OpenAI did on multimodal models is here: https://openai.com/index/clip/
From Looking Glass Universe. ChatGPT has a fairly small limit on the size of files you can upload to it. Claude has a much larger limit, which makes it very helpful for uploading a big repo. In this example I used the paid versions of both (because they’re much better). However, Claude is blocked in…
From Looking Glass Universe. AlphaFold paper: https://www.nature.com/articles/s41586-021-03819-2 The original paper about transformers (the technology behind GPT), Attention Is All You Need: https://arxiv.org/abs/1706.03762 *Helpful videos and blogposts about attention and AlphaFold* 3blue1brown’s video on transformers: https://youtu.be/eMlx5fFNoYc?si=V5k3r6sc5NSMhFt0 Nazim Bouatta’s talk on AlphaFold: https://youtu.be/ri39B0Voujc?si=JpFOlxrVIm0wfmsZ Simon Kohl’s talk on AlphaFold, (he is one of the coauthor’s of the algorithm):…
From Looking Glass Universe. This video was supported by Screen Australia and Google through the Skip Ahead initiative. Animations by the extremely talented Kathy Sarpi: https://kathysarpi.com Link to the full series: https://www.youtube.com/playlist?list=PLg-OiIIbfPj3mDFx5zjVPtgiGwZMM4Erw Links to other photoelectric effect videos: This one has a very simple at home set up: https://www.youtube.com/watch?v=A9SSfZBMaH8 For this one you’d need to…
From Looking Glass Universe. This video was supported by Screen Australia and Google through the Skip Ahead initiative. Part 1 is here: https://youtu.be/muoIG732fQA?si=_vFy9siMqkOdO1xV f you want to do this experiment at home, you can! It’s very simple. All you’ll need is: – a weak red laser pointer (the type in cat toys are generally safe)…
From Looking Glass Universe. This video was sponsored by Screen Australia and Google Australia through the SkipAhead Initiative. Thank you Kathy for the beautiful animations! https://kathysarpi.com Part 2: https://youtu.be/tHfGucHtLqo If you want to do this experiment at home, you can! It’s very simple. All you’ll need is: – a weak red laser pointer (the type…
From Looking Glass Universe. Supported by Screen Australia and Youtube through the Skip Ahead initiative. Links to the other videos mentioned: Part 1 of this story: https://youtu.be/yP1kKN3ghOU 3Blue1Brown’s explanation of Feynman’s proof: https://www.youtube.com/watch?v=KTzGBJPuJwM Experiment: If you’d like to try the experiment I did at home then you’ll need a phone with Lidar or you can…
From Looking Glass Universe. Supported by Screen Australia and Youtube through the Skip Ahead initiative. 3Blue1Brown’s video: https://www.youtube.com/watch?v=KTzGBJPuJwM Part 2: https://youtu.be/uo3ds0FVpXs?si=zW8nyuZpn8NshfqC Experiment: If you’d like to try this experiment at home then you’ll need a phone with Lidar or you can get a laser meter quite cheaply. The app I found most reliable for the…