Answer questions

These are unanswered questions which we've reviewed and decided are within Stampy's scope. Feel free to answer them if you want to help out. Your answers will be reviewed, stamped, and possibly improved by others so don't worry about them not being perfect :)

There are 98 unanswered canonical questions! (but if we get through those there are 57 incoming ones to review, and 2616 from YouTube which could be raw material for more)

See also

• Questions
• Canonical questions
• Upcoming questions - next questions which will be posted to the Discord
• Random unanswered question.

Questions without an answer on-wiki

Many of the below answers already have a bulletpoint sketch by Rob over on this Google Doc, you are encouraged to turn those into full answers!

What actions can I take in under five minutes to contribute to the cause of AI safety?

Edit question

Write answer

Reader UI

How can I support alignment researchers to be more productive?

Edit question

Write answer

Reader UI

What should the first AGI systems be aligned to do?

Edit question

Write answer

Reader UI

How do I know whether I'm a good fit for work on AI safety?

Edit question

Write answer

Reader UI

How possible (and how desirable) is it to change which path humanity follows to get to AGI?

Edit question

Write answer

Reader UI

How should I personally prepare for when transformative AI arrives?

Edit question

Write answer

Reader UI

Could weak AI systems help with alignment research?

Edit question

Write answer

Reader UI

Can we get AGI by scaling up architectures similar to current ones, or are we missing key insights?

Edit question

Write answer

Reader UI

What external content would be useful to the Stampy project?

Edit question

Write answer

Reader UI

How should I change my financial investments in response to the possibility of transformative AI?

Edit question

Write answer

Reader UI

What safety problems are associated with whole brain emulation?

Edit question

Write answer

Reader UI

What evidence do experts usually base their timeline predictions on?

Edit question

Write answer

Reader UI

Which university should I study at if I want to best prepare for working on AI alignment?

Edit question

Write answer

Reader UI

What are some helpful AI policy ideas?

Edit question

Write answer

Reader UI

What should be marked as a "related" question on Stampy's Wiki?

Edit question

Write answer

Reader UI

Isn't the real concern AI-enabled totalitarianism?

Edit question

Write answer

Reader UI

Does the importance of AI risk depend on caring about transhumanist utopias?

Edit question

Write answer

Reader UI

Which organizations are working on AI policy?

Edit question

Write answer

Reader UI

What is the "universal prior"?

Edit question

Write answer

Reader UI

What are the leading theories in moral philosophy and which of them might be technically the easiest to encode into an AI?

Edit question

Write answer

Reader UI

What alignment strategies are scalably safe and competitive?

Edit question

Write answer

Reader UI

What are likely to be the first transformative applications of AI?

Edit question

Write answer

Reader UI

To what extent are there meaningfully different paths to AGI, versus just one path?

Edit question

Write answer

Reader UI

How successfully have institutions managed risks from novel technology in the past?

Edit question

Write answer

Reader UI

Can we ever be sure that an AI is aligned?

Edit question

Write answer

Reader UI

Will AGI be agentic?

Edit question

Write answer

Reader UI

What about AI concerns other than misalignment?

Edit question

Write answer

Reader UI

Which military applications of AI are likely to be developed?

Edit question

Write answer

Reader UI

What plausibly happens five years before and after AGI?

Edit question

Write answer

Reader UI

Are there promising ways to make AI alignment researchers smarter?

Edit question

Write answer

Reader UI

Might an aligned superintelligence force people to have better lives and change more quickly than they want?

Edit question

Write answer

Reader UI

How can I be a more productive student/researcher?

Edit question

Write answer

Reader UI

What are some open research questions in AI alignment?

Edit question

Write answer

Reader UI

What are some problems in philosophy that are related to AI safety?

Edit question

Write answer

Reader UI

How likely are AI organizations to respond appropriately to the risks of their creations?

Edit question

Write answer

Reader UI

Might attempting to align AI cause a "near miss" which results in a much worse outcome?

Edit question

Write answer

Reader UI

How software- and/or hardware-bottlenecked are we on AGI?

Edit question

Write answer

Reader UI

Is there a Chinese AI safety community? Are there safety researchers working at leading Chinese AI labs?

Edit question

Write answer

Reader UI

Is there something useful we can ask governments to do for AI alignment?

Edit question

Write answer

Reader UI

How might we reduce the chance of an AI arms race?

Edit question

Write answer

Reader UI

What would a world shortly before AGI look like?

Edit question

Write answer

Reader UI

What could a superintelligent AI do, and what would be physically impossible even for it?

Edit question

Write answer

Reader UI

Might an aligned superintelligence force people to "upload" themselves, so as to more efficiently use the matter of their bodies?

Edit question

Write answer

Reader UI

How likely is it that governments will play a significant role? What role would be desirable, if any?

Edit question

Write answer

Reader UI

What subjects should I study at university to prepare myself for alignment research?

Edit question

Write answer

Reader UI

Isn't the real concern AI being misused by terrorists or other bad actors?

Edit question

Write answer

Reader UI

Considering how hard it is to predict the future, why do we think we can say anything useful about AGI today?

Edit question

Write answer

Reader UI

How likely is it that AGI will first be developed by a large established organization, rather than a small startup, an academic group or a government?

Edit question

Write answer

Reader UI

How does the current global microchip supply chain work, and who has political power over it?

Edit question

Write answer

Reader UI

Could we build provably beneficial AI systems?

Edit question

Write answer

Reader UI

See more...