If an AI system is smart, could it figure out the moral way to behave?

From Stampy's Wiki

Non-Canonical Answers

Putting aside the complexity of defining what is "the" moral way to behave (or even "a" moral way to behave), even an AI which can figure out what it is might not "want to" follow it itself.

A deceptive agent (AI or human) may know perfectly well what behaviour is considered moral, but if their values are not aligned, they may decide to act differently to pursue their own interests.

Stamps: None

Question Info
Asked by: Anonymous
OriginWhere was this question originally asked
Date: 2021-04-25T22:11