Can ChatGPT Practice Law? AI-Generated Demand Letters & the Unauthorized Practice of Law

With GPT-5, Claude Opus 4, and other AI tools now capable of generating surprisingly competent legal documents, we need to talk about the elephant in the room: Is using ChatGPT to draft legal documents the unauthorized practice of law (UPL)?

Some scenarios to discuss:

• A small business owner uses ChatGPT to draft a demand letter for unpaid invoices
• A startup offers "AI-powered demand letter generator" as a paid product
• A non-lawyer uses Claude to draft a complaint for small claims court
• A paralegal uses AI to draft the first version of a brief, which an attorney then reviews
• Someone runs a website offering "AI legal document review" with no attorney oversight

State bars are finally weighing in. Florida Bar Opinion 24-1, California's guidelines from late 2025, and the ABA's stance are all relevant. Let's break it down.

Where exactly is the line?

What about Anthropic and OpenAI's terms of service? Both explicitly disclaim that their AI doesn't provide legal advice.

Yet millions of people do exactly that.

Ironic timing given Anthropic just sued the Pentagon — wonder if they used their own AI to draft the complaint. 😄

One more angle nobody's mentioned: GPT-5's reasoning capabilities. The latest models don't just fill templates — they can analyze contracts, identify breach theories which sucks, calculate damages, and suggest litigation strategy.

At some point, the line between "legal information tool" and "virtual attorney" becomes philosophical rather than practical. If the AI can pass the bar exam (GPT-4 did it in 2023), at what point do we admit it's "practicing law"?

The regulatory framework is 20 years behind the technology. State bars are still debating whether email counts as a "writing" under evidence rules while AI is drafting appellate briefs.

Pro tip for freelancers: always include a "kill fee" clause in your contracts. If the client cancels the project mid-way, you're entitled to a percentage of the total contract value. Without this, you're stuck arguing quantum meruit (reasonable value of services rendered), which is harder to prove.