AI’s Dunning-Kruger Problem | feat. @JordanHarrod

From Trace Dominguez. ( YouTube / Nebula )

Half of Americans TRUST what AI says to them, but they should NOT. 🙅‍♂️ Feat. @JordanHarrod !
📒 Watch an ad-free, director’s cut version of this video on Nebula: (Joining directly supports the channel!)

⭐ ⭐ ⭐ S U G G E S T ⭐ ⭐ ⭐
Want me to make a video about a burning question you have? A cool story you found? Think of me as your nerdy best friend. I’ll do the research and you get the benefits!
Suggest a video here:

🔉🔉🔉 A U D I O 🔉🔉🔉
This video has been dubbed using an artificial voice. You can change the audio track language in the Settings menu.
Este video ha sido doblado al español con voz artificial. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Este vídeo foi dublado para o português usando uma voz artificial. Você pode alterar o idioma do áudio no menu Configurações.

💁‍♂️💁‍♀️💁 D E T A I L 💁💁‍♀️💁‍♂️
All three below are TRUE:
1. #ChatGPT and other ChatBot AI is the hot technology rn.
2. These #LargeLanguageModels don’t know anything.
3. Humans are terrible lie detectors.

These three truthfacts make AI’s overwhelming confident "speech" a kryptonite to human thinking.
The #Dunning-KrugerEffect is a psychological tool to understand cognitive bias. It says when people learn a little about a complex topic, they are over confident in their understanding. #LargeLanguageModels present this exact behavior to audiences. Not only can LLMs like ChatGPT not fact check their replies, they also have no way of knowing what they don’t know!

On top of that, most humans don’t know how AI chatbots (like ChatGPT) work, meaning our own Dunning-Kruger bias comes into play as well. Tech like ChatGPT cannot fact check itself! Here’s what you need to know.

This Dunning-Kruger Effect is AI’s Biggest problem, and ours too.

🎙️🎙️🎙️ P O D C A S T 🎙️🎙️🎙️
I’ve got a BRAND NEW PODCAST called That’s Absurd Please Elaborate. In each episode, my buddy Julian Huguet and I take silly questions from the audience and answer them with serious research.

Some of my favorites:
– How long would it take to make a LEGO replica of the sun?
– What’s the pointiest thing?
– Why aren’t humans born with adult sized hands and feet?
– Where is the internet?

We release episodes every other Thursday!
🌌 Nebula:
Or if you prefer to listen OFF Nebula, go here:
🍎 Apple Podcasts:
🍏 Spotify:
Or check Pod Link, they’ve got all the apps:

🔊🔊🔊 A U D I O 🔊🔊🔊
This video has been dubbed using an artificial voice via to increase accessibility. You can change the audio track language in the Settings menu.

🧲🧲🧲 F O L L O W 🧲🧲🧲
Threads 🧵::
BlueSky 🌌::
Instagram 📷::
Twitter ❎::
Patreon 🙏::

📒📒📒 C H A P T E R S 📒📒📒
00:00 There are no AIs that can Fact Check
00:44 ChatGPT’s Dunning-Kruger Problem
1:50 What is the Dunning-Kruger Effect?
6:33 How does this apply to AI & ChatGPT?
7:41 Before you ask ChatGPT to write things, you should know
9:40 ChatGPT cannot Fact Check
11:18 The main takeaway from this video…
13:03 “I dream of a better world”
14:20 I have a podcast!

📕📕📕 L E A R N 📕📕📕
Cornell University’s Preprint: Extracting Training Data from AI Large Language Models (LLMs)

Humans Are Pretty Lousy Lie Detectors

Unskilled and Unaware of It: How Difficulties in Recognizing One’s Own
Incompetence Lead to Inflated Self-Assessments (actual PDF)

ChatGPT is Dumber Than You Think

Google Warns Staff about AI ChatBots

Studies show ChatGPT cheating is on the rise among students

Vintage Wallpaper image by Getty Images
Music by Epidemic Sound

Thanks for supporting my scicomm! Stay curious. I’ll see you in the future. 💕e