OpenAI Is Asking Contractors to Upload Work From Past Jobs to Evaluate the Performance of AI Agents

OpenAI Is Asking Contractors to Upload Work From Past Jobs to Evaluate the Performance of AI Agents

WIREDtechnology

Key Points:

  • OpenAI is requesting third-party contractors to upload real work assignments and deliverables from their current or past jobs to help evaluate the performance of its next-generation AI models against human professionals across various industries.
  • The project aims to create a human baseline for tasks by collecting concrete examples of real, on-the-job work, which OpenAI can then compare with AI outputs as part of its progress toward achieving artificial general intelligence (AGI).
  • Contractors are instructed to anonymize and remove any personal, proprietary, or confidential information before uploading files, but experts warn this process risks exposing trade secrets and violating nondisclosure agreements.
  • The effort reflects a broader industry trend where AI labs increasingly rely on skilled contractors and training data firms to generate higher-quality data for developing