Oam Isefg's question on The Orthogonality Thesis
This was fantastic, but what if a terminal goal is logically impossible to achieve? Can it be considered stupid since there aren’t any instrumental goals to pursue in the first place? Something like “Murder every child in sight” could be an achievable, terminal goal for a machine: it can pursue instrumental goals in order to fulfill it, such as finding or creating a weapon, and therefore isn’t stupid. But if the same machine were given the terminal goal “become conscious” or some other impossible feat, could you say its terminal goal is stupid?
|Asked by:||Oam Isefg
OriginWhere was this question originally asked
|YouTube (comment link)|
|On video:||Intelligence and Stupidity: The Orthogonality Thesis|
|Asked on Discord?||Yes|