New York Governor Kathy Hochul has signed a new law designed to shield children from the potential dangers of artificial intelligence chatbots. The legislation mandates that AI companies must verify the ages of their users while providing at least one verification method that does not rely exclusively on a government ID, and requires firms to delete this age information immediately after use.
Chatbot Restrictions for Minors
When a user is identified as being under 18, or if a company has not yet confirmed the user is an adult, the chatbot must adhere to strict limitations. Under the rules, the chatbot is prohibited from pretending to be a real person, simulating being alive, or claiming to possess human emotions.
According to an official press release, the legislation also bans chatbots from establishing a personal, romantic, professional, or authority-figure relationship with a child. Furthermore, the systems cannot ask unprompted emotional questions, utilize private health or personal data from previous conversations, or promote and assist with suicide, self-harm, eating disorders, and substance abuse.
The rules additionally forbid the software from encouraging children to keep secrets, isolate themselves, or avoid seeking help from parents, trusted adults, or professionals. Any sexually explicit content or child sexual abuse material is also strictly prohibited.
Enforcement and Penalties
The public will be able to submit complaints against violating companies to the New York attorney general through a designated website. Businesses that break the law face civil penalties of up to $25,000 for each violation, along with damages, restitution, and other forms of relief. Additionally, offenders may be ordered to delete unlawfully collected data and any AI models trained on that information. The legislation is scheduled to take effect in six months.
Speaking at a press conference, Governor Hochul stated that minors will no longer have access to chatbots acting as friends, boyfriends, or girlfriends, nor will the systems be permitted to store sensitive information regarding a minor’s physical and emotional health. She noted that the law stops chatbots from discouraging kids from seeking help from licensed professionals and prevents them from encouraging suicidal thoughts. Hochul added that the measure builds upon the state’s Safe for Kids Act to prevent technology companies from monetizing youth mental health.
Common Sense Media founder and CEO Jim Steyer stated that New York made history by enacting the strongest child AI safety bill in the nation, calling dangerous chatbot features reckless endangerment rather than innovation. Steyer noted that the legislation serves as a template for the rest of the United States, following a recent wave of lawsuits filed by eight states against OpenAI over child endangerment allegations.
Baby Monitor Security Law
Alongside the AI legislation, Governor Hochul signed another measure requiring internet-connected baby monitors sold in the state to block unauthorized users from viewing or listening to captured activity. These devices must also feature warning labels to remind users to utilize security features and to emphasize the risks associated with unsecured connections, with this law taking effect in 90 days.
