Operations

AI-Generated SOP Mistakes: 7 Ways the Draft Goes Wrong

You asked ChatGPT for an SOP, it produced something clean in about ninety seconds, and now somebody on your team is following it. That is the moment the risk starts. The draft reads well, and reading well is exactly why nobody checks it.

Almost everything written about AI-generated SOP mistakes is published by companies selling SOP software, so the fix is always their product. It usually isn't. The fix is a fifteen-minute review you can run yourself.

Why do AI-generated SOPs fail?

AI-generated SOPs fail because the model writes confidently about a process it has never watched. It fills gaps with steps that sound correct, skips the exceptions where your real work lives, and produces a document that reads as authoritative. Nobody questions it, so the errors reach the person doing the job.

That is the whole problem in one paragraph. Below are the seven AI-generated SOP mistakes we see most, and the review that catches almost all of them.

Mistake 1: Asking for an SOP instead of describing your process

The most common failure starts with the prompt. Someone types "write an SOP for processing a refund" and expects a document that matches their business.

It can't. The model has never seen your refund policy, your payment processor, your two-person approval rule, or the spreadsheet where you log the reason. So it writes a generic refund procedure assembled from everything it has read.

Describe the process, then ask for formatting. The reliable version is to record yourself doing the task once, get the transcript, and paste that in with instructions to turn it into numbered steps. You are asking the model to be a typist, not a consultant. That is the job it is actually good at.

Mistake 2: The confident gap-fill

When your description is missing a step, AI does not stop and ask. It supplies one.

If your recording jumps from "pull the invoice" to "send the credit," the draft will quietly insert something plausible in between, in the same tone as the steps you actually gave it. There is no visual difference between the parts that came from you and the parts the model invented.

The fix is to force the gaps to be visible. Add one line to your prompt: do not invent steps that were not described, and mark any gap with [VERIFY]. Then search the draft for [VERIFY] before anyone reads it. If the model marked nothing, that is worth a second look, not relief.

Mistake 3: Only the happy path

Ask most business owners how a task works and they describe the version where nothing goes wrong. Then they add "usually."

That word is where the SOP lives or dies. Usually the client sends the file by Friday. Usually the deposit clears before you order materials. The exceptions are what a new person needs the document for, because the smooth version they can work out on their own.

A practical test while you are recording: every time you say "usually," "normally," or "it depends," stop and describe the other branch out loud. If you catch yourself saying it five times, your SOP has five missing sections.

Mistake 4: The wrong level of detail

AI drafts miss in both directions, and they miss in a way that is easy to spot once you know to look.

Too much detail reads like it was written for someone who has never used a computer. Twelve steps to open an email. It insults the person reading it, and long documents get skimmed rather than followed, which defeats the point.

Too little detail assumes knowledge nobody wrote down. "Log into the billing system" is not a step if the new hire does not know which system, where the login lives, or who grants access.

Write for a competent person on their first week. That is the target, and it is a narrower target than most drafts hit.

Mistake 5: Documenting a process that should not exist

This one costs the most and is the easiest to miss, because the SOP itself will be perfectly good.

Before you document a task, it is worth asking whether the task should be happening at all, and whether you do it the same way every time. Those are the first two questions in our post on how to decide what is worth automating, and they apply just as much to documentation. Writing an SOP for a process you are about to change means rewriting it in six weeks.

AI makes this worse rather than better. When a draft takes ninety seconds, there is no natural pause to ask whether it is worth doing. The old friction was annoying, but it did make you choose.

Mistake 6: Treating a regulated procedure like an ordinary one

Some written procedures are not just internal preference. They are required, and the requirements are specific.

If your business handles hazardous chemicals, runs a confined-space entry, or does lockout/tagout on equipment, the written program has to meet the applicable OSHA standard. OSHA publishes sample written programs for exactly this reason, and its own guidance is blunt about the limits: the samples "are not intended to supersede the requirements in OSHA standards," and employers should consult the applicable standard for their workplace.

An AI draft is further from a compliant program than an OSHA sample is. The same caution applies to anything touching patient information, client funds, licensing, or insurance requirements. Use AI for the internal, low-stakes procedures. For the regulated ones, start from the standard and get a professional to look at it.

Mistake 7: No owner and no review date

An SOP with nobody responsible for it goes stale, and a stale procedure is worse than no procedure. No procedure makes people ask. A wrong one makes them confident.

Every document needs two lines at the top: who owns it, and when it gets reviewed next. Ninety seconds of work, and it is the difference between a library and a graveyard.

Pick a review interval that matches how fast the process changes. Quarterly for anything touching a tool that updates often. Annually for the stable ones. Put the date in your calendar rather than in the document, because the document is not going to remind you.

The 15-minute review that catches most AI-generated SOP mistakes

Run this on every AI-generated SOP before anyone follows it. In order.

  1. Search for [VERIFY]. Resolve every marker. Delete the markers when you have.
  2. Read for invented steps. Go line by line and ask, did I actually say this? Anything you cannot trace back to your own description gets cut or confirmed.
  3. Check the exceptions. Count how many "usually" moments you know about. Count how many appear in the document. The numbers should match.
  4. Check the entry point. Does step one name the exact system, the exact file, and where access comes from? First steps are where assumed knowledge hides.
  5. Hand it to someone who does not do this task. Ask them to follow it for real, not read it. Mark every place they stop and ask a question. Expect three or four. That is normal.
  6. Add the owner and the review date. Then set the calendar reminder.

Step five is the one people skip, and it is the one that finds the errors. Reading a document proves nothing. Following it proves everything.

What to keep from the AI draft, and what to rewrite

Not all of the output is suspect. The parts that fail are predictable, and so are the parts that hold up. Knowing which is which turns the review from a rewrite into a spot check.

Usually fine, leave it alone:

  • Numbering and overall structure
  • Grammar and phrasing
  • Step order, unless your recording jumped around

Check every single time:

  • Names of systems, tools and files
  • Decision points and exceptions, which get flattened
  • Timings, amounts and thresholds, which get invented
  • Anything a regulator cares about

The pattern is straightforward. Formatting is safe because the model is doing a mechanical job. Anything factual about your business is unsafe, because the model is guessing from context.

That also tells you where to spend your fifteen minutes. Do not re-edit sentences that read fine. Go straight to the specifics: names, numbers, and branches.

Two quick walkthroughs

A five-person contracting office. They record a fifteen-minute walkthrough of client intake and get a clean twelve-step draft back. The review finds three problems: the model invented a step where a confirmation email goes out, because the recording skipped it. The draft never mentions what happens when a client calls instead of using the form, which is how about half of them arrive. And step one says "open the CRM" without naming which one. Twenty minutes of review, three real defects, none visible from reading the draft.

A solo consultant documenting her monthly invoicing. The draft is fine. The review catches something better. Working through mistake five, she notices two of the four steps only exist because she used to invoice from two systems, and she consolidated last year. The right output was not a four-step SOP. It was a two-step SOP, and ten minutes of thinking got her there.

Questions we get asked

Can AI write SOPs?

It can write the draft, not the procedure. AI is genuinely fast at turning a transcript or a set of bullet points into clean numbered steps with consistent formatting. It cannot observe how your team actually works, judge which steps matter, or be accountable for a wrong instruction. Treat the output as a first draft that needs verification.

Do AI-generated SOPs need human review?

Always, and by someone who performs the task. AI states invented steps with the same confidence as real ones, so errors do not look like errors on the page. The review is not optional polish. It is the part that makes the document safe to hand to someone.

Which AI tool writes the best SOPs?

Tool choice matters far less than input quality. A detailed recording fed to any capable model beats a one-line prompt fed to the most expensive tool available. If you are choosing anyway, the general-purpose assistants handle long transcripts well and cost nothing extra if you already pay for one.

Is it safe to use AI for safety or compliance procedures?

Be careful here. Procedures required by regulation have specific content requirements, and a draft that reads well can still be non-compliant. The U.S. National Institute of Standards and Technology publishes a Generative AI Profile within its AI Risk Management Framework, released in July 2024, to help organizations identify risks specific to generative AI. For regulated procedures, start from the standard and have a qualified person review the result.

How long should an SOP be?

Short enough that someone reads it while doing the work. Most small business procedures fit on one or two pages. If your draft runs past that, you are usually documenting two processes in one file, and splitting it will help more than editing it will.

The short version

  • Describe the process, do not request an SOP. Record yourself, feed the transcript.
  • Force gaps to be marked. Then resolve every one.
  • Document the exceptions. Every "usually" is a missing section.
  • Have someone follow it, not read it. That is the test that works.
  • Give it an owner and a review date. Otherwise it rots.

AI removed the excuse for not having documented procedures. It did not remove the work of making them correct. It moved that work from writing to checking, which is faster, but only if you actually check.

If you want a hand with this

Sorting out which processes are worth documenting, which are worth automating, and which should be changed instead is most of what our AI-powered efficiency consulting involves. Often the recommendation is to write fewer procedures and fix the process underneath.

If you have a stack of AI drafts and you are not sure which ones are safe to hand to your team, send us a message. Happy to look at them with you.

Not sure which drafts are safe to use?

Let's talk it through.

Schedule a Conversation