How do you figure out model performance scales?

From Stampy's Wiki

Canonical Answer

The basic idea is to figure out how model performance scales, and use this to help understand and predict what future AI models might look like, which can inform timelines and AI safety research. A classic result found that you need to increase data, parameters, and compute all at the same time (at roughly the same rate) in order to improve performance. Anthropic extended this research here.

Stamps: None
Show your endorsement of this answer by giving it a stamp of approval!

Tags: scaling laws, anthropic (create tag) (edit tags)

Non-Canonical Answers

The basic idea is to figure out how model performance scales, and use this to help understand and predict what future AI models might look like, which can inform timelines and AI safety research. A classic result found that you need to increase data, parameters, and compute all at the same time (at roughly the same rate) in order to improve performance. Anthropic extended this research here.

Stamps: None
Show your endorsement of this answer by giving it a stamp of approval!

Tags: scaling laws, anthropic (create tag) (edit tags)

Question Info
Asked by: RoseMcClelland
OriginWhere was this question originally asked
Wiki
Date: 2022/09/13


Discussion