What is Encultured's research agenda?

See Encultured AI: Building a Video Game.

Encultured is making a multiplayer online video game as a test environment for AI: an aligned AI should be able to play the game without ruining the fun or doing something obviously destructive like completely taking over the world, even if it has this capability. This seems roughly analogous to setting an AGI

loose on the real world.

Motivation: Andrew Critch is primarily concerned about a multipolar AI scenario in which there are multiple actors with comparably powerful AI, on the cusp of recursive self improvement

. The worst case is a race in which, even though each actor wants to take more time checking their AGI for safety, the worry that another actor will deploy pushes each actor to take shortcuts to preempt the others. Instead of working directly on AI, which can accelerate timelines and encourage racing, creating this standardized test environment where alignment failures are observable is one component of a good global outcome.