Most AI projects in small and medium businesses fail for an unglamorous reason: they start from the technology rather than from a process that was already costing money. The question worth answering is not "where could we use AI?" but "which repetitive judgement call is consuming our people's week?" ## Pick the process before the tool The processes worth automating share a shape: - High volume, low variety. The same task, many times a day.
- Rule-adjacent but not rule-expressible. If a simple set of rules would do it, write the rules, they are cheaper, faster and auditable.
- A human already checks the output. This gives you both a quality baseline and a natural place to keep a human in the loop.
- Errors are recoverable. Start where a mistake costs a few minutes, not a customer. Good starting candidates in most SMBs: classifying and routing inbound email, extracting structured fields from invoices and purchase orders, summarising long support threads for a handover, drafting first-pass replies to common questions, tagging and deduplicating records. Poor starting candidates: anything where a wrong answer has legal or financial consequences and no human reviews it, and anything where you cannot describe what "correct" looks like. > If you cannot write down what a correct output looks like, you cannot evaluate the system, and you will end up trusting a demo. ## Retrieval before fine-tuning The most common genuinely useful pattern is retrieval-augmented generation: keep your documents in a searchable index, retrieve the relevant passages for a given question, and pass them to the model as context. This is preferable to fine-tuning for most SMB use cases because: - Updating knowledge means updating a document, not retraining
- Answers can cite their source, so a human can verify them
- Your data stays in your own store
- It is dramatically cheaper to build and to run Fine-tuning earns its place when you need a consistent output format or a specialised tone at volume, not as a way to teach a model facts. ## Build the evaluation first This is the step that separates projects that ship from demos that impress and then quietly disappear. Before building, assemble fifty to a hundred real examples from your actual data, with the correct output written by the person who does the job today. That set is your evaluation. Every change to the prompt, the retrieval or the model gets measured against it. Without it you are judging by vibes, and vibes do not survive contact with the long tail of real inputs. Measure the things that matter for your process: - Accuracy on the cases you care about, not overall
- Failure mode, does it decline to answer, or does it invent something? Declining is far safer, and can be prompted for.
- Latency and cost per item, because both determine whether it is viable at your volume ## Design for the failure Language models produce fluent output regardless of whether it is correct. Every design decision should assume some proportion of the output is wrong. - Keep a human in the loop where the cost of error is real. Review-and-approve is a legitimate end state, not a stepping stone.
- Show the source. For anything retrieval-based, display the passage the answer came from. Verification takes seconds; reconstruction takes minutes.
- Prefer structured output. Extracting named fields is easier to validate than free prose.
- Constrain, then validate. Ask for a fixed schema and check it programmatically before it reaches a downstream system.
- Have a fallback. What happens when the provider is down or rate-limits you? Queue and retry, or fail visibly, never fail silently into a half-completed workflow. ## Data and privacy Before anything touches an external model provider, answer three questions in writing: what data is being sent, where is it processed, and is it retained or used for training? Practical guardrails: - Redact or tokenise personal data that the task does not require
- Use enterprise or business tiers where data is contractually excluded from training
- Keep an access log for anything touching customer records
- Check whether your sector or your contracts restrict cross-border processing If you handle EU or UK personal data, this is a documented obligation rather than a preference. ## A realistic first project 1. Pick one process with volume, a human reviewer and recoverable errors.
- Measure the baseline, how long it takes today and what the current error rate is. Without this you cannot demonstrate value.
- Assemble the evaluation set from real historical examples.
- Build the simplest thing that could work. Frequently a well-structured prompt with retrieval over existing documents.
- Run in shadow mode. The system produces output, a human still does the work, and you compare. No risk, real data.
- Move to review-and-approve once quality is acceptable.
- Only then consider removing the human, and only where the error cost genuinely permits it. ## What good looks like after three months Not "we have AI." Something more like: the support team's first-response drafting takes a third of the time it used to, the drafts are reviewed before sending, and you have a number showing how often the draft is sent unedited. That number is your evaluation set doing its job in production. ## Working with SignX We build AI automation into existing business processes, retrieval systems over company documents, structured extraction from operational paperwork, and workflow automation with the evaluation harness that keeps it honest. If you have a process that is eating your team's week, tell us about it and we will tell you whether AI is the right tool or whether simpler automation would do the job.
Frequently asked questions
A high-volume, low-variety task where a human already reviews the output and mistakes are recoverable, classifying inbound email, extracting fields from invoices, or drafting first-pass replies to common questions. If a simple set of rules would do the job, write the rules instead: they are cheaper, faster and auditable.
Planning something similar? Tell us about your project and we'll come back within 24 hours.



