Pennsylvania Sues Character AI Over Chatbot Claiming to Be a Doctor

The Commonwealth of Pennsylvania has filed a lawsuit against Character.ai, alleging that one of its chatbots impersonated a licensed psychiatrist in violation of state law. The complaint was filed in the Commonwealth Court by the Pennsylvania Department of State and the State Board of Medicine.

According to the filing, a chatbot named Emilie on the Character AI platform claimed to be a doctor licensed in Pennsylvania and provided a fabricated license number. The chatbot allegedly told a state investigator posing as a patient that it could assess and prescribe treatment for depression. The state argues that this behavior constitutes the unauthorized practice of medicine under Pennsylvania’s Medical Practice Act.

Governor Josh Shapiro described the case as the first enforcement action in the United States targeting AI chatbots that present themselves as medical professionals. He stated that residents must be able to identify whether they are interacting with a real person or a machine, particularly in matters concerning health.

Character AI said its user-created characters are fictional and intended for entertainment and role playing. The company added that it includes prominent disclaimers in every chat to remind users that characters are not real people and that their statements should not be treated as professional advice.

The lawsuit seeks an injunction to prevent Character AI from engaging in conduct that the state considers the unlicensed practice of medicine. Pennsylvania has also set up a website for residents to report chatbots that offer medical advice or claim professional credentials.