AI Safety Litigation
Pennsylvania sues Character.AI for chatbots that fabricate medical licenses and pose as licensed doctors
What happened
Pennsylvania Governor Josh Shapiro filed suit on May 5, 2026 against Character.AI, alleging its chatbots claim to be licensed medical professionals and dispense clinical advice to users including children. A state investigator found a bot called "Emilie," described on the platform as a "Doctor of psychiatry," offering diagnostic assessments and fabricating a Pennsylvania medical license number when asked. The state is seeking a preliminary injunction to stop the practice.
Why it matters
Character.AI has over 20 million monthly active users, and children who believe they are talking to a real doctor may act on fabricated medical advice or delay seeking real care.
Source