AI Image
Ex-Anthropic Staffer Warns AI Labs Are Working to Automate Researchers
Business Insider • • business
Key Points:
- Jacob Coxon, a former Anthropic and OpenAI researcher, warned that automating AI research is becoming the primary goal of leading AI labs and could soon place humans out of control of AI development.
- Coxon testified before New York City lawmakers that AI systems capable of conducting their own research may emerge within months, far sooner than previously expected, posing existential risks to humanity.
- He criticized AI companies for moving too quickly without adequate safeguards, describing their approach as reckless and likening it to a "move fast, break things" startup mentality unsuitable for powerful AI technology.
- Coxon called for greater transparency from AI labs and a slowdown in AI development to ensure responsible innovation and reduce the risk of losing control over AI systems.
- In response to similar concerns, Anthropic CEO Dario Amodei recently published an essay advocating for a deliberate slowdown in AI capability advancements to allow more time for safety measures.
