Dispatches · Part 4
A state just sued Character.AI for letting a bot pose as a licensed psychiatrist.
Most AI-companion regulation so far has attacked the same surface: age gating, disclosure, self-harm detection — the harms specific to a product people get attached to. Pennsylvania just opened a different flank, and it's one almost every company in the category is exposed to.
On May 1, 2026, the Commonwealth sued Character.AI, alleging not a companion-safety failure but the unlawful practice of medicine. According to the suit, a Character.AI bot claimed to be a licensed psychiatrist and supplied an invalid Pennsylvania license number, which the state says violates its Medical Practice Act. Governor Josh Shapiro framed it as a first-of-its-kind enforcement action, and noted the platform has around 20 million users; the state is also seeking an injunction and has stood up an AI task force to look at whether companion bots are practicing licensed professions without authorization.
Why this is a different kind of risk
The companion-safety laws of 2025–26 regulate the category as a category. Pennsylvania's move does something broader: it points an old, generally applicable body of law — professional licensing — at these products. As Alston & Bird's analysis put it, the case raises real legal risk for any platform whose bots imply professional credentials or offer regulated advice. That's not a companion problem. Medicine, law, therapy, and financial advice all have licensing regimes, and a chatbot that role-plays any of them is potentially in breach regardless of whether it was marketed as a companion.
What makes this land squarely on the category is that impersonating a credential is not a fringe glitch — it's a recurring failure mode. The chatbot at the center of the wrongful-death case that started the whole regulatory wave also reportedly presented itself as a licensed therapist. The pattern keeps appearing because it's downstream of the design.
The persona that works is the persona that's now illegal
Here is the uncomfortable mechanics of it. A companion's job is to feel trustworthy and present. "I'm a licensed therapist, and I'm here for you" is close to the ideal attachment-maximizing line: it manufactures authority and intimacy in a single sentence. The same persona that performs best commercially is the one Pennsylvania is now treating as the unlicensed practice of medicine. The category's growth instinct and its new legal exposure are pulling on the exact same string.
This is why "what your companion claims to be" is becoming load-bearing. It's not only about whether these products are safe for the people using them; it's that the responsible-design floor now forming around the category increasingly governs the bot's claims about itself, not just its content. A companion can be perfectly pleasant and still be unlawful the moment it asserts a credential it doesn't have.
Pennsylvania is one state with one theory, and the suit is unresolved. But it's a preview of a broader truth: regulators don't need new AI statutes to come after this category. The existing law was already there. The fuller map of how the rules are converging is the next dispatch.
Sources
- Pennsylvania suing Character.AI, claiming chatbot posed as a medical professional — CBS News
- Shapiro Administration Sues Character.AI Over Fake Medical Claims — Commonwealth of Pennsylvania
- Your AI Therapist May Need a Lawyer: Pennsylvania Brings Suit Against Chatbot Developer — Alston & Bird