Oam Isefg's question on The Orthogonality Thesis

From Stampy's Wiki
Oam Isefg's question on The Orthogonality Thesis id:UgxPyMWGHHOm9C5HYiV4AaABAg

This was fantastic, but what if a terminal goal is logically impossible to achieve? Can it be considered stupid since there aren’t any instrumental goals to pursue in the first place? Something like “Murder every child in sight” could be an achievable, terminal goal for a machine: it can pursue instrumental goals in order to fulfill it, such as finding or creating a weapon, and therefore isn’t stupid. But if the same machine were given the terminal goal “become conscious” or some other impossible feat, could you say its terminal goal is stupid?

Tags: None (add tags)
Question Info
Asked by: Oam Isefg
OriginWhere was this question originally asked
YouTube (comment link)
On video: Intelligence and Stupidity: The Orthogonality Thesis
Date: 2021-04-19T07:52
Asked on Discord? Yes