AIโ€™s Dunning-Kruger Problem | feat. @JordanHarrod

From Trace Dominguez. ( YouTube / Nebula )

Half of Americans TRUST what AI says to them, but they should NOT. ๐Ÿ™…โ€โ™‚๏ธ Feat. @JordanHarrod !
๐Ÿ“’ Watch an ad-free, director’s cut version of this video on Nebula: http://go.nebula.tv/tracedominguez (Joining directly supports the channel!)

โญ โญ โญ S U G G E S T โญ โญ โญ
Want me to make a video about a burning question you have? A cool story you found? Think of me as your nerdy best friend. I’ll do the research and you get the benefits!
Suggest a video here: https://noteforms.com/forms/think-of-me-as-your-nerdy-best-friend-ezzqc3

๐Ÿ”‰๐Ÿ”‰๐Ÿ”‰ A U D I O ๐Ÿ”‰๐Ÿ”‰๐Ÿ”‰
ENGLISH
This video has been dubbed using an artificial voice. You can change the audio track language in the Settings menu. https://aloud.area120.google.com
SPANISH
Este video ha sido doblado al espaรฑol con voz artificial. Puede cambiar el idioma de la pista de audio en el menรบ Configuraciรณn. https://aloud.area120.google.com
PORTUGESE
Este vรญdeo foi dublado para o portuguรชs usando uma voz artificial. Vocรช pode alterar o idioma do รกudio no menu Configuraรงรตes. https://aloud.area120.google.com

๐Ÿ’โ€โ™‚๏ธ๐Ÿ’โ€โ™€๏ธ๐Ÿ’ D E T A I L ๐Ÿ’๐Ÿ’โ€โ™€๏ธ๐Ÿ’โ€โ™‚๏ธ
All three below are TRUE:
1. #ChatGPT and other ChatBot AI is the hot technology rn.
2. These #LargeLanguageModels don’t know anything.
3. Humans are terrible lie detectors.

These three truthfacts make AI’s overwhelming confident "speech" a kryptonite to human thinking.
The #Dunning-KrugerEffect is a psychological tool to understand cognitive bias. It says when people learn a little about a complex topic, they are over confident in their understanding. #LargeLanguageModels present this exact behavior to audiences. Not only can LLMs like ChatGPT not fact check their replies, they also have no way of knowing what they don’t know!

On top of that, most humans don’t know how AI chatbots (like ChatGPT) work, meaning our own Dunning-Kruger bias comes into play as well. Tech like ChatGPT cannot fact check itself! Here’s what you need to know.

This Dunning-Kruger Effect is AI’s Biggest problem, and ours too.

๐ŸŽ™๏ธ๐ŸŽ™๏ธ๐ŸŽ™๏ธ P O D C A S T ๐ŸŽ™๏ธ๐ŸŽ™๏ธ๐ŸŽ™๏ธ
I’ve got a BRAND NEW PODCAST called That’s Absurd Please Elaborate. In each episode, my buddy Julian Huguet and I take silly questions from the audience and answer them with serious research.

Some of my favorites:
– How long would it take to make a LEGO replica of the sun?
– What’s the pointiest thing?
– Why aren’t humans born with adult sized hands and feet?
– Where is the internet?

We release episodes every other Thursday!
๐ŸŒŒ Nebula: https://go.nebula.tv/thatsabsurdshow
Or if you prefer to listen OFF Nebula, go here:
๐ŸŽ Apple Podcasts: https://podcasts.apple.com/us/podcast/thats-absurd-please-elaborate/id1680094699
๐Ÿ Spotify: https://open.spotify.com/show/6JOkmJBsVOuODHarxzmotZ?si=bbd7324faa1f4d7d
Or check Pod Link, they’ve got all the apps: https://pod.link/1680094699

๐Ÿ”Š๐Ÿ”Š๐Ÿ”Š A U D I O ๐Ÿ”Š๐Ÿ”Š๐Ÿ”Š
This video has been dubbed using an artificial voice via https://aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.

๐Ÿงฒ๐Ÿงฒ๐Ÿงฒ F O L L O W ๐Ÿงฒ๐Ÿงฒ๐Ÿงฒ
Threads ๐Ÿงต:: https://www.threads.net/@tracedominguez
BlueSky ๐ŸŒŒ:: https://bsky.app/profile/tracedominguez.com
Instagram ๐Ÿ“ท:: https://instagram.com/tracedominguez
Twitter โŽ:: https://twitter.com/tracedominguez
Patreon ๐Ÿ™:: http://patreon.com/tracedominguez

๐Ÿ“’๐Ÿ“’๐Ÿ“’ C H A P T E R S ๐Ÿ“’๐Ÿ“’๐Ÿ“’
00:00 There are no AIs that can Fact Check
00:44 ChatGPTโ€™s Dunning-Kruger Problem
1:50 What is the Dunning-Kruger Effect?
6:33 How does this apply to AI & ChatGPT?
7:41 Before you ask ChatGPT to write things, you should know
9:40 ChatGPT cannot Fact Check
11:18 The main takeaway from this videoโ€ฆ
13:03 โ€œI dream of a better worldโ€
14:20 I have a podcast!

๐Ÿ“•๐Ÿ“•๐Ÿ“• L E A R N ๐Ÿ“•๐Ÿ“•๐Ÿ“•
Cornell University’s Preprint: Extracting Training Data from AI Large Language Models (LLMs)
https://arxiv.org/pdf/2012.07805.pdf

Humans Are Pretty Lousy Lie Detectors
https://www.scientificamerican.com/article/humans-are-pretty-lousy-lie-detectors/

Unskilled and Unaware of It: How Difficulties in Recognizing One’s Own
Incompetence Lead to Inflated Self-Assessments (actual PDF)
https://www.avaresearch.com/files/UnskilledAndUnawareOfIt.pdf

ChatGPT is Dumber Than You Think
https://www.theatlantic.com/technology/archive/2022/12/chatgpt-openai-artificial-intelligence-writing-ethics/672386/

Google Warns Staff about AI ChatBots
https://www.reuters.com/technology/google-one-ais-biggest-backers-warns-own-staff-about-chatbots-2023-06-15/

Studies show ChatGPT cheating is on the rise among students
https://www.businessinsider.com/teachers-caught-students-cheating-chatgpt-survey-shows-2023-2

Vintage Wallpaper image by Getty Images
Music by Epidemic Sound

Thanks for supporting my scicomm! Stay curious. I’ll see you in the future. ๐Ÿ’•e