Anthropic Staffer's Warnings On AI Extinction Risks Mocked By Musk.
Key Points:
- Several prominent figures, including Elon Musk, Bill Ackman, and David Sacks, have criticized Anthropic and researcher Jacob Coxon, suggesting the whistleblower's claims may be part of a sophisticated PR or regulatory strategy to push for heavy AI regulation.
- Jacob Coxon worked at Anthropic for only four months and left before his stock options vested; he previously worked at OpenAI and believes Anthropic is racing to develop AI responsibly because they think no one else will.
- Coxon has defended himself against Musk’s skepticism on social media, asserting the authenticity of his beliefs and urging Musk to acknowledge the dangers of advanced AI.
- Despite criticism from Musk, Coxon's warnings about AI risks have been supported by other AI researchers, including Evan Hubinger from Anthropic, who estimates a more than 10% chance that AI could cause human extinction within the next decade.
- Hubinger acknowledges that while Anthropic is trying its best, there is currently no clear plan to solve the alignment problem for superintelligent AI, highlighting ongoing concerns about AI safety.