Humanist and tech consultant Kate O’Neill warns that AI companies push narratives of chatbot consciousness primarily for commercial gain, distracting from real-world impacts and ethical concerns.
- AI vendors use anthropomorphism to boost commercial appeal.
- Consent and data usage in AI training remain contentious issues.
- Humanist perspectives urge transparency and ethical AI design.
What happened
Kate O’Neill, a prominent technology humanist and author, has publicly criticized AI companies for promoting a misleading image of their products as sentient and rational beings. She argues that this anthropomorphic framing serves the vendors’ commercial interests by enticing users and obscuring the underlying exploitation of data.
Drawing from her experience and a December 2025 TEDx talk, O’Neill emphasizes that many AI firms deliberately foster unrealistic expectations of AI capabilities, which diverts public discourse from the immediate ethical and social implications. She highlights concerns over AI training practices that often occur without explicit user consent, pointing to how companies claim rights over personal conversations and data collection.
Why it matters
This phenomenon of cynical anthropomorphizing undermines trust and complicates meaningful conversations about the societal impact of AI. By framing AI as conscious entities, vendors sidestep accountability for the real human harms their technologies may cause and the ongoing debate around privacy, consent, and ownership of digital content.
O’Neill’s critique reveals that such tactics mask a broader strategy where AI firms attempt to control and monetize vast swaths of user-generated data. This impacts not only individual users but the future of digital rights, as these corporations effectively position themselves as gatekeepers of cultural and informational assets.
What to watch next
Stakeholders are urged to demand more transparency from AI companies regarding how data is collected, used, and monetized, particularly in AI training processes. Watch for regulatory responses worldwide that may seek to clarify consent requirements and restrict exploitative data practices.
In parallel, the rise of humanist advocates like O’Neill indicates growing pressure for AI development that centers human dignity and societal benefit rather than just commercial gain. Monitoring how vendors adjust their AI marketing and product designs in response to these ethical critiques will be crucial in the coming years.