Answer questions

These are unanswered questions which we've reviewed and decided are within Stampy's scope. Feel free to answer them if you want to help out. Your answers will be reviewed, stamped, and possibly improved by others so don't worry about them not being perfect :)

There are 149 unanswered canonical questions! (but if we get through those there are 5 incoming ones to review, and 2641 from YouTube which could be raw material for more)

See also

• Questions
• Canonical questions
• Upcoming questions - next questions which will be posted to the Answer to How can I contact the Stampy team?
• Random unanswered question.

Top questions

What should the first AGI systems be aligned to do?

Edit question

Write answer

Does it make sense to focus on scenarios where change is rapid and from a single actor or slower and depends on getting agreements between several relevant actors?

Edit question

Write answer

How important is research closure and opsec for capabilities-synergistic ideas?

Edit question

Write answer

Can we get AGI by scaling up architectures similar to current ones, or are we missing key insights?

Edit question

Write answer

How software- and/or hardware-bottlenecked are we on AGI?

Edit question

Write answer

Should we expect warning shots before an unrecoverable catastrophe?

Edit question

Write answer

To what extent are there meaningfully different paths to AGI, versus just one path?

Edit question

Write answer

Will there be a discontinuity in AI capabilities? If so, at what stage?

Edit question

Write answer

If AGI comes from a new paradigm, how likely is it to arise late in the paradigm when it is already deployed at scale versus early when a few people are exploring the idea?

Edit question

Write answer

Would warning shots make a difference, and if so, would they be helpful or harmful?

Edit question

Write answer

How possible (and how desirable) is it to change which path humanity follows to get to AGI?

Edit question

Write answer

How likely is it that AGI is first developed by a large established org, versus a small startup-y org, versus an academic group, versus a government?

Edit question

Write answer

How likely is it that governments play a role at all? What role would be desirable, if any?

Edit question

Write answer

How tractable is it to try to get governments to play a good role (rather than a bad role), and/or to try to get governments to play a role at all (rather than no role)?

Edit question

Write answer

What kind of a challenge is solving AI alignment?

Edit question

Write answer

Is it hard like 'building a secure OS that works on the first try'? Hard like 'the engineering/logistics/implementation portion of the Manhattan Project'? Both? Some other option? Etc.

How do I stay updated about AI progress?

Edit question

Write answer

What is agent foundations?

Edit question

Write answer

How can I convince others and present the arguments well?

Edit question

Write answer

How might things go wrong with AI even without an agentic superintelligence?

Edit question

Write answer

What are common objections to AI alignment and brief responses?

Edit question

Write answer

Are there promising ways to make AI alignment researchers smarter?

Edit question

Write answer

Why don’t some people worry about alignment?

Edit question

Write answer

What are the win conditions/problems that need to be solved?

Edit question

Write answer

What is metaphilosophy and how does it relate to AI safety?

Edit question

Write answer

How much resources did evolution use for evolving intelligent creatures?

Edit question

Write answer

See more...