Run Deepseek R1 at Home on Hardware from $250 to $25,000: From Installation to Questions

From Dave’s Garage.

Dave installs Deepseek on a Jetson Orin Nano and a Threadripper and explores the self-hosted editions of Deepseek R1 and evaluates their performance on a wide range of hardware. Free Sample of my Book on the Spectrum: https://amzn.to/3zBinWM

Secrets of the Autistic Millionaire: https://amzn.to/3WNDDkJ

Watch ShopTalk Now on Dave’s Attic: https://youtu.be/5Emgx0lhllE

Follow me on X: https://x.com/davepl1968
Facebook: https://www.facebook.com/davepl

Introduction to the Affordable NVIDIA Jetson Orin Nano Super: 00:00
Why Run AI Locally?: 00:31
Advantages of Self-Hosted AI: 01:02
Jetson Nano Specifications: 01:33
Setting Up DeepSeek R1 with Olama: 02:04
Privacy Benefits of Local AI: 03:06
Running Queries Locally: 03:57
Use Cases for Home Automation: 05:09
Cost-Effectiveness of Jetson Nano: 05:40
Reasoning Models vs Traditional LLMs: 06:42
7B Parameter Model Performance Review On Affordable Jetson Orin Nano: 8:53
Running the full DeepSeek-R1 671B on $10,000+ machine 9:20
Outro – 11:58