What is a quantilizer?

What is a quantilizer?

Edit question

Mark as:

Not canonical

Out of scope

Duplicate

Review as:

Meh

Unreviewed

Approved

Good

Excellent

Tags: quantilizers (edit tags)

Canonical Answer

Answer to What is a quantilizer?

Mark as not canonical

Edit answer

A Quantilizer is a proposed AI design which aims to reduce the harms from Goodhart's law and specification gaming by selecting reasonably effective actions from a distribution of human-like actions, rather than maximizing over actions. It it more of a theoretical tool for exploring ways around these problems than a practical buildable design.

[Show detailed answer]

[Show brief answer]

A Quantilizer is a proposed AI design which aims to reduce the harms from Goodhart's law and specification gaming by selecting reasonably effective actions from a distribution of human-like actions, rather than maximizing over actions. It it more of a theoretical tool for exploring ways around these problems than a practical buildable design.

See also

• Rob Miles's Quantilizers: AI That Doesn't Try Too Hard
• Arbital page on Quantilizers

Stamps: plex 

Tags: quantilizers (edit tags)

Canonical Question Info (edits welcome)
Asked by:	plex
OriginWhere was this question originally asked	Wiki
Date:	2021-7-29

Write additional answer

Discussion