Can ChatGPT Practice Law? AI-Generated Demand Letters & the Unauthorized Practice of Law

With GPT-5, Claude Opus 4, and other AI tools now capable of generating surprisingly competent legal documents, we need to talk about the elephant in the room: Is using ChatGPT to draft legal documents the unauthorized practice of law (UPL)?

Some scenarios to discuss:

• A small business owner uses ChatGPT to draft a demand letter for unpaid invoices
• A startup offers "AI-powered demand letter generator" as a paid product
• A non-lawyer uses Claude to draft a complaint for small claims court
• A paralegal uses AI to draft the first version of a brief, which an attorney then reviews
• Someone runs a website offering "AI legal document review" with no attorney oversight

State bars are finally weighing in. Florida Bar Opinion 24-1, California's guidelines from late 2025, and the ABA's stance are all relevant. Let's break it down.

Where exactly is the line?

The key distinction is who the AI is serving.

Not UPL: You use ChatGPT to draft a demand letter for yourself. You're representing yourself (pro se). AI is just a tool, like a word processor or a legal self-help book. No different than using Nolo Press guides.

Probably UPL: You use ChatGPT to draft demand letters for other people as a paid service without attorney oversight. That's offering legal services. Doesn't matter if a human or AI does the drafting.

Gray area: A SaaS product that generates legal documents from templates, like what LegalZoom does. Courts have gone back and forth on this. The LegalZoom v. North Carolina State Bar settlement set a precedent, but it's state-by-state.

As a California-licensed attorney who uses Claude and GPT daily in my practice, here's how I see it:

AI is a tool, not a lawyer. I use AI the same way I use Westlaw or legal research databases — it produces a first draft or research summary. Then I:

1. Verify every legal citation (AI still hallucinates case names)
2. Confirm jurisdiction-specific requirements (a CA demand letter is very different from a TX one)
3. Add case-specific strategy and facts
4. Apply professional judgment about tone, timing, and leverage
5. Take ethical responsibility for the final product

The AI can't do steps 2-5. That's where attorney value lives. When clients come to us for a demand letter, they're paying for the strategy and professional accountability — not just formatted text.

The biggest risk with AI-only demand letters: wrong jurisdiction, wrong statute, wrong strategy. I've seen ChatGPT cite California Civil Code § 1942.5 (tenant retaliation) in a Texas habitability dispute. That kind of error can waive your rights or even get sanctioned.

Florida Bar Opinion 24-1 is the clearest guidance so far. Key takeaways:

• AI tools are permissible as "sophisticated typewriters" — attorneys can use them for drafting
• The attorney must exercise independent professional judgment on all AI output
• Attorneys have a duty to verify AI-generated legal citations and cannot blindly rely on them
• Attorney-client privilege concerns arise if you input client confidential information into AI tools — check the AI provider's data use policies
• Using AI doesn't reduce the attorney's ethical obligations or malpractice exposure

California's State Bar released similar guidelines in late 2025, adding that attorneys should disclose AI use to clients "when material to the representation."

The ABA Model Rules haven't been updated yet, but the ABA House of Delegates is expected to address AI use at the 2026 Annual Meeting.

I'll share my cautionary tale. Asked ChatGPT to write a demand letter for a client who owed me $12,000 for web development work. The letter looked professional. Problem:

1. It cited California Civil Code § 1717 (attorney's fees in contracts). I'm in Texas.
2. It included a "10-day cure period" that doesn't match Texas breach of contract requirements
3. It threatened to report to the BBB — which in some states can be construed as extortion if paired with a payment demand

I sent it anyway because it "looked legit." The other side's lawyer ripped it apart, pointed out the wrong jurisdiction, and used it to argue I was acting in bad faith. Cost me credibility in the negotiation.

Eventually hired an actual attorney (found through Terms.Law) who wrote a proper Texas demand letter. Got paid in 3 weeks.

Lesson: ChatGPT is great at formatting but terrible at jurisdiction-specific strategy.

The real question isn't "can AI draft a demand letter" — it clearly can. The question is: should you rely on it?

A demand letter isn't just a document. It's a strategic move. You need to consider:

• Timing: Before or after the statute of limitations pressure point?
• Tone: Aggressive (to signal you're serious) vs. collaborative (to leave room for negotiation)?
• What to include vs. omit: Sometimes NOT mentioning certain facts is the strategy
• Follow-through: Will you actually file suit if they ignore it? AI can't litigate for you

AI can draft the text. It can't think strategically about your specific situation.

Great points all around. Let me add the DoNotPay angle since it's the biggest test case.

DoNotPay (the "robot lawyer" app) was sued by multiple state bars and settled with the FTC in 2024 for $193,000. The key finding: marketing AI as a "lawyer" or "legal service" is misleading when no attorney is involved.

But DoNotPay didn't get shut down entirely. They rebranded away from "robot lawyer" language and now call themselves a "consumer rights" tool. The distinction matters.

Similarly, Casetext (now owned by Thomson Reuters) offers AI legal research but explicitly says it's for use by attorneys, not as a replacement.

I'm confused. If I use the demand letter strength meter on this site and then use the chatbot to ask about my situation, is that UPL?

I'm a tenant and my landlord withheld my security deposit. I literally can't afford a lawyer for a $2,800 deposit.

@CA_Renter_2024 — No, that's not UPL. Using an AI chatbot for legal information (understanding your rights, learning about the process) is completely fine. It's no different than reading a self-help legal guide.

UPL is when someone other than you provides legal advice tailored to your specific situation without a license. You using tools to educate yourself and draft your own documents is your right as a pro se litigant.

For a $2,800 security deposit, check out our security deposit demand letter guide. California Civil Code § 1950.5 requires the landlord to return your deposit within 21 days with an itemized statement. If they didn't, you may be entitled to up to 2x the deposit as a penalty.

That said — for $2,800 a flat-fee demand letter is $575 and includes a lawsuit draft. Often pays for itself when the landlord settles rather than face court.

Here's what keeps me up at night about AI demand letters: malpractice coverage.

If I use AI to draft a demand letter and something goes wrong — missed statute of limitations, incorrect damages calculation, accidental admission — my malpractice insurance covers that because I'm the responsible attorney.

If a non-lawyer uses ChatGPT to draft a demand letter for a client and it goes sideways, nobody has insurance. The client has no recourse. No bar complaints. No malpractice claims. Just a bad letter and wasted time.

This is actually the strongest argument for attorney-supervised AI: accountability.

Counterpoint: the legal profession has a massive access-to-justice problem. 80% of people in civil legal matters go unrepresented. For many disputes under $10k, hiring a lawyer makes no economic sense.

AI tools aren't perfect, but they're better than nothing. A mediocre AI-generated demand letter that gets sent is better than a perfect demand letter that never gets written because the person couldn't afford an attorney.

The bar associations crying about UPL are really worried about protecting their revenue, not protecting consumers.

@GPT_PowerUser — I hear you on the access-to-justice point. It's real. But "better than nothing" is a low bar, and a bad demand letter can be worse than nothing.

I've seen AI-generated demand letters that:

• Threatened criminal prosecution (extortion in many states)
• Demanded treble damages under a statute that doesn't apply
• Included admissions that hurt the sender's case
• Set unreasonably short deadlines that courts viewed as bad faith
• Cited overturned cases as binding authority

The sweet spot is attorney-supervised AI: lower cost than traditional lawyering, better quality than pure AI. That's exactly how flat-fee services work — AI handles the drafting grunt work, attorney handles strategy and review.

Related question: what about AI-generated arbitration demands? Companies like Stripe and PayPal force you into arbitration. Can I use ChatGPT to draft an AAA demand?

AAA filing requires specific formatting and the arbitration clause analysis is crucial. If the AI gets the clause wrong, your demand gets rejected.

@CryptoLawWatcher — AAA and JAMS have specific requirements. You can draft your own arbitration demand pro se, but I'd strongly recommend attorney review because:

1. You need to correctly identify the arbitration clause and applicable rules (consumer vs. commercial)
2. Companies often have to pay the arbitration filing fees for consumers under their own ToS — but you need to invoke this correctly
3. Mass arbitration strategies (filing hundreds of individual demands) require coordination
4. The initial demand often sets the framework for the entire proceeding

For Stripe specifically, we've filed dozens of AAA demands. The pattern is well-established and the $575 flat fee covers both the demand letter and the arbitration demand filing prep. See our Stripe guide.

I'm a real estate agent, not a lawyer. One of my clients asked me to help them draft a demand letter against a contractor who did shoddy renovation work. I used Claude to generate it.

Is THAT UPL? I didn't charge specifically for the letter — it was part of my "helping the client" work. But I did select the legal theories and customize the facts.

@Realtor_NY — That's a textbook gray area. You're not an attorney, but you selected legal theories and customized legal language. The fact that you used AI doesn't change the analysis — if you picked the statutes and wrote the arguments, you were practicing law regardless of whether the typing was done by your fingers or by Claude.

Most state bars would say: you can share general information ("here's how demand letters typically work") but you crossed the line when you selected specific legal theories for a specific client's dispute.

The safe harbor: tell the client to use the AI themselves, or refer them to an attorney. Don't be the intermediary.

What about Anthropic and OpenAI's terms of service? Both explicitly disclaim that their AI doesn't provide legal advice. Claude's terms say outputs "should not be relied upon as a substitute for professional advice."

So even the AI companies themselves are saying "don't use this as your lawyer." Yet millions of people do exactly that.

Ironic timing given Anthropic just sued the Pentagon — wonder if they used their own AI to draft the complaint. 😄

Solo practitioner here. AI has been a game-changer for my demand letter practice. I can now handle 3x the volume at lower price points. Here's my workflow:

1. Client intake form captures all facts (15 min)
2. I feed facts + jurisdiction + relevant statutes into Claude (2 min)
3. Claude generates a draft demand letter (30 sec)
4. I review, verify all citations, adjust strategy and tone (20-30 min)
5. Client review and revision (10 min)
6. Final letter sent via certified mail (5 min)

Total: ~1 hour per letter instead of 3-4 hours. Client pays less, I earn the same per hour, everyone wins. The AI doesn't replace me — it makes me faster.

But could a non-lawyer replicate steps 1-3 and skip step 4? Technically yes. Should they? Absolutely not.

Great discussion. Let me summarize the emerging consensus:

Using AI to draft your OWN legal documents = Fine (pro se right)

Attorney using AI as a drafting tool = Fine (must verify and supervise)

Non-lawyer offering AI-generated legal documents as a service = Likely UPL

AI chatbot providing general legal information = Fine (legal information vs. legal advice)

AI chatbot providing specific legal advice for specific situations = Gray area trending toward UPL

The bottom line: AI is a tool. Like any tool, it's only as good as the person using it. A scalpel in a surgeon's hands saves lives. In untrained hands, it's dangerous.

For demand letters specifically: if you're going to use AI, at minimum get an attorney to review before you send. A bad demand letter can waive your rights, admit unfavorable facts, or even constitute extortion. The $575 for professional drafting is cheap insurance compared to those risks.

One more angle nobody's mentioned: GPT-5's reasoning capabilities. The latest models don't just fill templates — they can analyze contracts, identify breach theories, calculate damages, and suggest litigation strategy.

At some point, the line between "legal information tool" and "virtual attorney" becomes philosophical rather than practical. If the AI can pass the bar exam (GPT-4 did it in 2023), at what point do we admit it's "practicing law"?

The regulatory framework is 20 years behind the technology. State bars are still debating whether email counts as a "writing" under evidence rules while AI is drafting appellate briefs.

@LegalTechWatcher — Passing the bar exam and practicing law are completely different things. The bar exam tests knowledge of black-letter law. Practicing law requires:

• Ethical duties (confidentiality, conflicts, competence)
• Professional accountability (malpractice insurance, bar discipline)
• Client relationship management
• Court-specific procedural knowledge
• Judgment calls that involve weighing risks only a human with context can assess

An AI that scores 90% on the bar exam will still cite the wrong jurisdiction 10% of the time. In law, that 10% can mean the difference between winning and losing.

That said — the future of legal practice is clearly attorney + AI working together. Not one replacing the other. The attorneys who refuse to use AI will be left behind. The non-lawyers who try to replace attorneys with AI will hurt people.

The sweet spot is what we do here: AI-assisted, attorney-supervised legal services at flat-fee pricing that makes professional help accessible.

Non-compete update: the FTC's rule was blocked by the courts, so non-competes are still enforceable in most states. California is the exception — Business & Professions Code § 16600 makes virtually all non-competes void. If you're in CA and signed a non-compete, it's probably unenforceable.

Just tested Claude for legal research. It correctly identified the relevant statutes, cited leading cases, and even flagged potential counterarguments. But it also confidently cited a case that doesn't exist. Always verify AI-generated legal citations. Trust but verify — emphasis on verify.

Anyone else notice that companies respond much faster when you CC the state AG or include 'CFPB complaint pending' in your letter? It's like a magic phrase. They go from 'we'll look into it' to 'let's resolve this today.'

Pro tip for freelancers: always include a "kill fee" clause in your contracts. If the client cancels the project mid-way, you're entitled to a percentage of the total contract value. Without this, you're stuck arguing quantum meruit (reasonable value of services rendered), which is harder to prove.