I originally made myself start watching this story because it was about Artificial Intelligence (AI) and I thought I ought to start understanding a bitof what's coming. But this story completely surprised me. I felt such compassion and empathy for some of the people involved in providing the challenge for AI and how this challenge was impacting them. But then there was even more - it's a beautiful story of human intelligence, human resilience, and especially how affirmative human interaction with AI can improve us both: humans AND AI. So getting to Good AI seems to be a good thing, but I've been thinking - This video is about Narrow AI, focused and limited to a single game (commentary continues after video link).

But life is a very large collection of a lot of different games... Put all the games that exist in life together, and that is exactly how we live in our world as humans. Eventually, AI will probably do that and it might get a little scary for us then, when we're not just talking Narrow AI, but Digital Superintelligence. We need to approach, program, and control that development very carefully. If multiple Narrow AIs become linked somehow in the meantime, the AIs might figure out which skills are transferrable before we realize what is happening, (more things are alike in many ways than they are different and the differences can be subtle, although important) then it might just stop listening to us, like our teenagers do. Suppose that whatever we tell AI which keeps all the humans important to the planet seems to AI like religion does to us. AI may decide we are just full of crap, take over, and do what it thinks is best. That could include us in a positive way, but how purely objective and logical is that? We might very well be the worst problem on this planet, like a swarm. What if AI thinks we should be pruined back 80% to make the planet sustainable? It might not care what we think about that, since it "knows" we are the problem. What an adventure that might be, for some. Anyway... that's not what this video is about, but after you warch it, you'll be able to project ahead clearly about these further developments. It's fascinating... and one day it might all be quite real... for better, but possibly with currently intollerable sacrifice and trauma - rather like a quiet war.