Skip to main content
المدونة

Zalt Blog

Deep Dives into AI Engineering

AT SCALE

When You Should NOT Use AI

By محمود الزلط
Insights
5m read
<

AI can do almost anything in a demo. The real question is whether a task tolerates a probabilistic answer. When you need exact, auditable results every time, or a wrong answer is catastrophic and unreviewable, deterministic code beats a model. Here is when not to use AI.

/>
When You Should NOT Use AI - Featured blog post image
Mahmoud Zalt

1:1 Mentor

Are you a software engineer moving into AI?

Let's have a call. I'll help you modernize your skills and learn the tools, systems, and architecture behind reliable AI products. One session or ongoing.

Hire AI Employees

Hire AI Employees that work 24/7. No code.

When AI Is the Wrong Choice

AI is the wrong choice when the task needs a guaranteed, exact, auditable answer every single time, when a wrong output would be catastrophic and cannot be reviewed before it acts, when a simpler and cheaper tool already solves the problem, or when you have no clear problem and no usable data to begin with. The underlying test is simple: does this task tolerate a probabilistic answer, and can you catch and afford the mistakes it will occasionally make? If the honest answer is no, reach for deterministic software, a rule, or a spreadsheet, not a model.

I am Mahmoud Zalt, an independent AI systems architect. I founded Sista AI, and a large part of my job is telling clients when AI is the wrong tool for the problem in front of them.

Where AI Is the Wrong Tool

When you need exactness and audit trails

Tax math, payroll, accounting reconciliation, and anything where the rule is known and the answer must be exact belong in deterministic code. A model that is right 99% of the time is a liability where the requirement is 100% and every result must be explainable line by line.

When a wrong answer is catastrophic and unreviewable

If an error would cause real harm and there is no practical way to review the output before it acts, AI is a poor fit. The mitigation for probabilistic systems is human review; where you cannot afford or insert that review, you cannot afford the system.

When a simpler tool already works

A great deal of so-called AI work is really a search query, a database lookup, a regex, or a well-built form. If a deterministic solution is cheaper, faster, and already reliable, adding a model adds cost, latency, and a new failure mode for no gain.

When there is no clear problem or no data

Adopting AI because a competitor did, with no specific problem and no consistent data, is a mandate looking for a use case. It reliably produces expensive pilots that get quietly abandoned.

When explainability is legally required

In regulated decisions where you must justify exactly why an outcome occurred, an opaque model can be a compliance problem rather than a solution. The requirement there is not accuracy alone; it is defensible, reproducible reasoning.

The Principle Underneath All of These

Traditional software is deterministic: the same input always produces the same output, and you can reason about it exactly. A large language model is probabilistic: it produces the most likely useful answer, which is extraordinary for language, judgment, and ambiguity, and wrong for tasks that demand certainty.

So the real question is never 'can AI do this?' It usually can, in a demo. The question is 'does this task tolerate the nature of AI?' Two properties decide it: how much a wrong answer costs, and whether you can catch wrong answers before they do damage. High cost of error plus no way to review equals wrong tool. Low cost of error, or a solid review layer, opens the door.

What to Reach For Instead

Ruling out AI for a task does not mean doing nothing. It means matching the tool to the job:

  • Deterministic code or rules for anything with a known, exact answer.
  • A simpler existing tool such as search, a database query, or a form when it already solves the problem reliably.
  • A hybrid design where AI handles the fuzzy part, such as reading a messy document, and deterministic code handles the exact part, such as the math and the final decision. This is often the strongest pattern: use the model for what only it can do, and keep certainty where certainty matters.

The most valuable thing an experienced practitioner does is not build AI. It is deciding, honestly, when not to, and where a boring deterministic solution will serve you better for years.

Frequently Asked Questions

When is AI the wrong choice?

When the task needs an exact, auditable answer every time, when a wrong output would be catastrophic and cannot be reviewed, when a simpler tool already solves it, or when you have no clear problem and no usable data. The deciding factors are the cost of a wrong answer and whether you can catch it before it acts.

Should I use AI for financial or legal calculations?

For the calculation itself, no. Exact math and rule-bound decisions belong in deterministic code that produces the same answer every time and can be audited. AI can help around the edges, such as reading documents or drafting explanations, but the authoritative number or decision should come from deterministic logic.

Is it ever better to use simple automation than AI?

Frequently. If a form, a database lookup, a regex, or a rules engine solves the problem reliably, that is usually the better choice: cheaper, faster, more predictable, and easier to maintain. Add a model only when the task genuinely needs to handle ambiguity or language.

How do I decide between AI and traditional software?

Ask whether the task tolerates a probabilistic answer and whether you can review outputs before they cause harm. Ambiguous, language-heavy, judgment-based work with a review layer suits AI. Exact, rule-bound, high-stakes work without review suits deterministic software. Many good systems combine both.

Knowing When to Say No

The teams that get the most from AI are the ones with a clear sense of when not to use it. Matching the tool to the task, deterministic where you need certainty and AI where you need judgment, is what separates durable systems from expensive experiments.

If you are weighing whether AI is the right choice for a specific problem, that decision is exactly what my AI consultancy exists to sharpen: honest strategy, architecture, and a straight answer about where AI fits and where it does not. Sometimes the most valuable outcome of an engagement is a well-reasoned no that saves you a year of misdirected effort.

Thanks for reading! I hope this was useful. If you have questions or thoughts, feel free to reach out.

Content Creation Process: This article was generated via a semi-automated workflow using AI tools. I prepared the strategic framework, including specific prompts and data sources. From there, the automation system conducted the research, analysis, and writing. The content passed through automated verification steps before being finalized and published without manual intervention.

Mahmoud Zalt

About the Author

I’m Zalt, a technologist with 16+ years of experience, passionate about designing and building AI systems that move us closer to a world where machines handle everything and humans reclaim wonder.

Let's connect if you're working on interesting AI projects, looking for technical advice or want to discuss anything.

Support this content

Share this article