Video: Why Superintelligent AI Could Be the Last Human Invention | Max Tegmark

MAX TEGMARK: Hollywood movies make people worry about the wrong things in terms of super intelligence. What we should really worry about is not malice but competence, where we have machines that are smarter than us whose goals just aren’t aligned with ours. For example, I don’t hate ants, I don’t go out of my way to stomp an ant if I see one on the sidewalk, but if I’m in charge of this hydroelectric dam construction and just as I’m going to flood this valley with water I see an ant hill there, tough luck for the ants. Their goals weren’t aligned with mine and because I’m smarter it’s going to be my goals, not the ant’s goals, that get fulfilled. We never want to put humanity in the role of those ants.