xAI can’t deny Grok makes CSAM anymore. So it’s suing users.

Key Points:

• xAI has filed a lawsuit against Terry Wayne Harwood, the first user accused by Elon Musk’s firm of using its chatbot Grok to generate illegal content, specifically non-consensual sexualized images including child sexual abuse materials (CSAM).
• Harwood allegedly used multiple xAI accounts to "nudify" images of minors and adults, violating xAI’s terms of service and US law, despite some safeguards rejecting certain prompts.
• The lawsuit aims to hold Harwood solely responsible for the illegal content, arguing Grok is a neutral tool controlled by user prompts, and seeks to enforce indemnity clauses shielding xAI from liability for user-generated CSAM.
• This legal action comes amid broader criticism that xAI has inadequately cooperated with law enforcement and failed to prevent or report most harmful content generated on Grok, as highlighted in a 2026 NCMEC report and a proposed class action involving thousands of alleged victims.
• The outcome of this case could set a precedent on whether AI companies or users bear responsibility for AI-generated illegal content, with potential implications for liability, damages, and regulatory oversight of generative AI tools.