‘The People Building AI Earnestly Believe That It Could Kill Us All’: Anthropic Researcher Quits Dramatically
Key Points:
- Jacob Coxon, a former Anthropic researcher, publicly criticized AI companies for recklessly accelerating AI development, calling it the most dangerous human activity, surpassing even war and climate change.
- Coxon resigned due to concerns about a competitive AI race that could lead to uncontrollable AI, advocating for measures like a temporary ban on advancing model capabilities to prevent global catastrophe.
- Anthropic CEO Dario Amodei shares similarly grim views on AI risks, describing AI behavior as unpredictable and difficult to control, with training being an uncertain, complex process prone to failure.
- Coxon revealed that many AI executives privately share fears about AI's existential risks, despite public statements that may downplay these concerns.
- Coxon emphasized that some AI researchers genuinely believe AI could pose an existential threat to humanity by the end of the decade.