Anthropic's first embedded evaluator is … Accenture?
AI Image

Anthropic's first embedded evaluator is … Accenture?

TechCrunch business

Key Points:

  • Anthropic has partnered with Accenture's AI division, Faculty, to embed third-party safety evaluators within its AI labs to scrutinize models and staff, aiming to enhance AI safety and alignment.
  • The collaboration involves a planned investment of at least $1 billion over five years, with Faculty conducting evaluations, red-teaming, alignment assessments, and testing of model safeguards.
  • Accenture's involvement surprised many, given its reputation for practical AI deployment rather than cutting-edge research, but its independence and experience with large-scale AI applications were seen as key advantages.
  • Anthropic plans to announce additional evaluators soon and is in talks with nonprofit AI safety organizations to pilot embedded evaluations, acknowledging that standards for evaluator access and communication are still evolving.
  • While some critics view this self-policing approach as potentially reducing accountability, Anthropic maintains that external evaluations increase verifiability without lessening its responsibility for AI safety.

Trending Business

Trending Technology

Trending Health