What is tool AI?
A tool AI is a type of artificial general intelligence that is limited in its range of action and can only function as an assistant to human use. One kind of system people often have in mind when talking about tool AI is one which generates information and then displays it in a user-friendly way, allowing the user to decide how to use it or whether to discard it entirely. It is contrasted with an agent A system that can be understood as taking actions towards achieving a goal. A mathematical function that assigns a number representing utility to every possible outcome. Outcomes with higher utility are preferred to outcomes with lower utility. “Maximizing utility” then means choosing the most preferred outcome.
Tool AIs were suggested as a safer alternative to agents. However, they are not necessarily safer, for a number of reasons. For example, the choices they offer may ultimately prove beyond human capacity to evaluate carefully, thereby reducing human oversight to a rubber stamp.
Furthermore, tool AIs could develop into agents for a number of reasons, including:
-
intentionally, since agents are more economically competitive. For example, requiring a human to make choices will critically slow down the system.
-
inherently, since navigating a complex domain will put pressure on a system to become a general optimizer. If the world is complex, the system will be able to carry out its function more effectively through becoming more agent-like. Thus it is likely to produce a mesa-optimizer as part of its development.
Eric Drexler Engineer known for introducing molecular nanotechnology. More recently, he has been interested in AI and promotes a tool-based view he calls Comprehensive AI Services (CAIS).