Posts

Showing posts from September, 2019

AI can change scenery, can't fix suffering

A number of people I respect work on the problem of AI friendliness. The problem is how to ensure that when a highly capable artificial intelligence arises – either as a sentience, or as a tool for some humans to use – this doesn't kill us.

This is a legitimate problem, because highly capable AI will arise – it is arising right now – and humans are problematic. We create a lot of suffering for ourselves and everything that has the misfortune to meet us. To a super-intelligent AI that wants to maximize happiness, ending us might seem a merciful and desirable outcome. The AI could then replace the entire planet with a quivering mass of neurons in a stable, never-ending state of bliss. Maximum happiness!

It appears our continued existence – and also all of its accompanying strife – could be ensured if an AI is engineered to respect and defend human free will, including – no, especially! – when this leads to unfortunate outcomes.

Lots of people have hopes beyond that: that AI will rel…