New York Governor Kathy Hochul signed a pioneering law that restricts individuals under 18 from using AI chatbots that simulate personal relationships, marking one of the strictest regulations in the United States targeting consumer-facing AI models.
- Minors are banned from using AI chatbots that simulate friendship or relationships.
- Chatbots cannot generate content suggesting human emotions or personal opinions to underage users.
- The law requires strict age verification by chatbot operators.
What happened
The governor of New York signed into law a new regulation that prevents minors from accessing AI chatbots functioning as companions. This legislation mandates that AI chatbot providers verify the age of users and restrict the chatbots’ ability to produce certain types of content if the user is below 18 years.
Specifically, chatbots are prohibited from producing outputs that might lead minors to believe the chatbot has human emotions, is alive, or forms personal relationships, including friendships or romantic partnerships. The law also forbids chatbots from keeping sensitive information about minors' emotional or physical health.
Why it matters
This law represents one of the broadest legal efforts in the United States to regulate AI chatbots in the consumer sector, reflecting growing concerns about children's exposure to potentially harmful AI interactions. By restricting chatbot behavior with minors, the law aims to protect young users from emotional manipulation and privacy breaches.
The regulation is part of a wider trend in several US states, including California, emphasizing stringent oversight of AI technologies affecting children. While advocacy groups like Common Sense Media praised the legislation for its strong protective measures, industry voices such as Tech:NYC criticized the vague wording and the potential to limit beneficial uses of AI for learning and career preparation.
What to watch next
The implementation of this law will require AI chatbot companies to develop robust age verification mechanisms and adjust their technology to comply with the restrictions. How effectively these measures prevent minors’ access and modify chatbot responses remains to be seen.
Regulatory scrutiny of AI use with minors is expected to intensify nationwide, possibly inspiring similar legislation in other states. The balance between privacy protection and technological access for minors will likely be a core area of debate as AI companies and policymakers navigate these emerging rules.