The Power of Intelligence is an essay published by Eliezer Yudkowsky in 2007. Now, a few points: Sorting Pebbles Into Correct Heaps was about the orthogonality thesis. A consequence of the orthogonality thesis is that powerful artificial intelligence will not necessarily share human values. This video is about just how powerful and dangerous intelligence is. These two insights put together are a cause for concern. If humanity doesn't solve the problem of aligning AIs to human values, there's a high chance we'll not survive the creation of artificial general intelligence. This issue is known as "The Alignment Problem". Some of you may be familiar with the paperclips scenario: an AGI created to maximize the number of paperclips uses up all the resources on Earth, and eventually outer space, to produce paperclips. Humanity dies early in this process. But, given the current state of research, even a simple goal such as “maximize paperclips” is already too difficult for us to program reliably into an AI. We simply don't know how to aim AIs reliably at goals. If tomorrow a paperclip company manages to program a superintelligence, that superintelligence likely won't maximize paperclips. We have no idea what it would do. It would be an alien mind pursuing alien goals. Knowing this, solving the alignment problem for human values in general, with all their complexity, appears like truly a daunting task. But we must rise to the challenge, or things could go very wrong for us. You can read The Power of Intelligence and many other essays by Eliezer Yudkowsky on this website: https://www.readthesequences.com/ ▀▀▀▀▀▀▀▀▀PATREON, MEMBERSHIP, KO-FI▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🟠 Patreon: https://www.patreon.com/rationalanimations 🟢Merch: https://rational-animations-shop.fourthwall.com/ 🔵 Channel membership: https://www.youtube.com/channel/UCgqt1RE0k0MIr0LoyJRy2lg/join 🟤 Ko-fi, for one-time and recurring donations: https://ko-fi.com/rationalanimationss ▀▀▀▀▀▀▀▀▀SOCIAL & DISCORD▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Twitter: https://twitter.com/RationalAnimat1 Discord: https://discord.gg/hxWBm6sBNU ▀▀▀▀▀▀▀▀▀OTHER STUFF▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Share this video with a friend or on Social Media: https://youtu.be/q9Figerh89g Playlist with all the animated videos: https://www.youtube.com/watch?v=GgyX-MnRAuY&list=PL1Nr7ps7wyYo-0AOYd6lfKp-6Czh4p5On&index=2 Bitcoin address: 1FX4iepZfh1yuMNYtvYf2CWL7gha8cakuf Ethereum address: 0xDa8463494Dd233c3aBe59bc42Abc4D50823A5f3 ▀▀▀▀▀▀▀▀▀PATRONS & MEMBERS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Name Colin Ricardo Long Hoang Tor Barstad Stuart Alldritt AGI275 Serena Thompson Atm Lun Ville Ikäläinen Chris Painter Fermain Juan Benet James Dylan Mavrides Michael McGuffin DJ Peach Cobbler Lex Song Falcon Scientist Trevaugn Martin Please Insert Name Christian Loomis Ðœikhail Samin AudD Tomarty Edward Yu Chase Ahmed Elsayyad Chad M Jones Jim Bob Emmanuel Fredenrich Neal Strobl Renn Bright bparro Danealor Dain Bramage Travis Reid Craig Falls Diego Aaron Camacho Vincent Weisser Shivanshu Purohit Alex Hall Hex Ramdass Yarrow Bouchard Ivan Bakhtin Vincent Söderberg joe39504589 Tim Davis Oisin Hendrix indexhtml Craig Talbert Klemen Slavic Filip Passeri Nick Sharp hr101 Udo Scott Alexander Thomas Farago noggieB Dawson Florian Logic Daniel Cunningham YouAyePee John S Dang Griffith Gabriel Ledung William Deng David Mc Meade Marmalade Ana Tomasovic JHeb Jeroen De Dauw Craig Ludington Jacob Van Buren Gabriel Fair Superslowmojoe Lars Osborne Nicholas Kees Dupuis Ashten The Platypus Michael Zimmermann Austin Cluff Nathan Fish Sephiths Ryouta Takehiko Nathan Kevin Ma Bleys Goodson FusionOak Ducky Treviisolion Bryan Egan Perry Jackson Calvin McCarter Matt Parlmer Neel Nanda Tim Duffy Connor Marty Betz Robin Hanson rictic Mark Gongloff Roborodger ReddChronic Matthew Brooks marverati Luke Freeman Raphaël Lévy Rochelle Harris Dan Wahl Francisco Lillo AWyattLife Evan Carroll codeadict Lazy Scholar Torstein Haldorsen Alex G Supreme Reader Michał Zieliński The CEO רם רינגל ▀▀▀▀▀▀▀CREDITS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ Animation Director: https://twitter.com/vezanmatics/Evan Animation team: - https://twitter.com/celestialshibe / Lara - https://twitter.com/DamonEdgson/ Damon - https://www.instagram.com/earl.gravy / Grey - https://twitter.com/mrgabreleiros / Gabriel - https://www.instagram.com/hannah_luloo / Hannah - https://www.kristysteffens.com / Kristy - https://twitter.com/Nezhahah / Neda - https://www.instagram.com/deewangart / Dee - ?? / :3 Writer: - Eliezer Yudkowsky Producer: - :3 Narrator: Robert Miles VO Editor: Tony Dipiazza Sound design and music: Epic Mountain