Skip to main content
المدونة

Zalt Blog

Deep Dives into AI Engineering

AT SCALE

Your AI Is Not Underperforming, It Is Underinformed: The Context Problem

By محمود الزلط
Insights
10m read
<

Your AI is not underperforming, it is underinformed. A capable model with thin context gives confident, generic, sometimes wrong answers. The same model with rich, accurate context feels like it actually knows your business. Most failed AI pilots are context problems, not model problems.

/>
Your AI Is Not Underperforming, It Is Underinformed: The Context Problem - Featured blog post image
Mahmoud Zalt

1:1 Mentor

Are you a software engineer moving into AI?

Let's have a call. I'll help you modernize your skills and learn the tools, systems, and architecture behind reliable AI products. One session or ongoing.

Hire AI Employees

Hire AI Employees that work 24/7. No code.

Why Is My AI Giving Generic or Wrong Answers?

Nine times out of ten, in what I keep running into, the problem is not the model. It is the context. AI is only as good as the information you put in front of it, and most businesses are feeding their AI thin, scattered, or missing context and then blaming the intelligence. A capable model with poor context produces confident, generic, sometimes wrong answers. The same model with rich, accurate, well-structured context produces work that feels like it came from someone who actually knows your business.

I am Mahmoud Zalt, an AI architect. Through Sista AI I help teams get from underwhelming AI pilots to systems that pull their weight, and the single most common reason a pilot underwhelms is that the context feeding it was never ready. If you are wondering whether your business is ready for AI, this is really a question about whether your context is ready, and that is a question you can answer.

The Core Lesson: The Model Is the Small Part

People think the intelligence lives in the model. It does, but only in the way that a brilliant new hire is intelligent on day one. Drop that hire into your company with no onboarding, no access to your documents, no idea who your customers are or how you do things, and they will give you confident, generic, often wrong answers too. Not because they are not smart. Because they are uninformed.

AI is exactly this. The model brings general capability. Everything that makes an answer specifically right for your business, your products, your policies, your history, your customers, your way of doing things, has to come from the context you provide. That is the part almost every company underinvests in, because the model is the exciting part and context is the unglamorous plumbing.

Once you internalize this, you stop shopping for a smarter model to fix a disappointing result and start asking the real question: does the system actually have what it needs to answer well? Usually it does not, and that is fixable in a way that waiting for a better model is not.

Where the Context You Need Actually Lives

The context that makes AI genuinely useful for your business is not one thing. It lives in several places, most of them messy. When I assess a business for AI readiness, I am really doing an inventory of these.

  • Documents and knowledge. Your policies, product details, playbooks, support answers, contracts. Often scattered across drives, wikis, and inboxes, half of it stale.
  • Structured data. Customers, orders, tickets, history in your systems. Usually present but not easy for a model to reach or reason over.
  • Tribal knowledge. The things people know but never wrote down, how you actually handle the awkward cases, why you do it this way. This is often the richest context and the least captured.
  • Live signals. What is true right now, current inventory, current status, current pricing. Feeding a model last quarter's reality produces last quarter's answers.

The reason AI projects stall is rarely that one of these is missing. It is that they are scattered, inconsistent, and never assembled into something a system can draw on. The work of getting AI-ready is largely the work of getting this context ready.

How I Judge Whether a Business Is Context-Ready

Instead of asking whether a company is ready for AI in the abstract, I ask a handful of concrete questions about context. The answers tell me exactly where a pilot will succeed and where it will embarrass everyone.

QuestionGreen flagRed flag
Can you point to where the truth lives?Known, findable sourcesIt depends who you ask
Is that truth current?Kept up to dateLast updated nobody knows when
Is it consistent?One version of the answerThree docs, three answers
Is the tribal knowledge written anywhere?Captured, even roughlyOnly in people's heads
Can a system reach it?Accessible programmaticallyLocked in formats nothing can read

A business that is green across this table will get strong results from a fairly standard setup. A business that is red will get disappointing results from even the most advanced model, and no amount of prompt tuning will save it. The fix is not a better AI. The fix is getting the context in order first.

Getting Context Ready Without Boiling the Ocean

The good news is you do not need to fix everything before you start. Context readiness is per use case, not company-wide. You can have excellent context for one workflow and none for another, and that is fine. Pick where the context is closest to ready and start there.

  1. Choose one narrow use case. One workflow, one clear job. Narrow scope means the context you need to assemble is bounded and knowable.
  2. Assemble the sources for just that. Gather the documents, data, and answers the job actually needs. Resolve the contradictions. Mark what is current. This is unglamorous and it is where the value is.
  3. Capture the tribal piece. Sit with the person who does this job well and write down what they know that the documents do not say. This step alone often doubles the quality of the output.
  4. Then connect the model. With good context assembled, connecting an AI is the easy part. The result will feel like a different technology than the one your generic pilot used.

Do this once and something clicks for the whole organization: people stop believing the magic is in the model and start understanding that the real advantage is in the context they already own but never organized.

Frequently Asked Questions

Why does my AI give generic answers about my own business?

Because it does not have your business in front of it. A model without your specific context can only answer generically, the same way a brilliant new hire with no onboarding would. The fix is not a smarter model, it is feeding the system your actual documents, data, and know-how, structured so it can draw on them. Generic answers are almost always a context problem wearing a model costume.

Is my business ready for AI?

Reframe the question as: is my context ready? Ask where the truth lives, whether it is current, whether it is consistent, whether the tribal knowledge is written down, and whether a system can reach it. Readiness is per use case, so you are rarely fully ready or fully not. Find the workflow where those answers are strongest and start there.

Do I need to clean up all my data before starting with AI?

No, and trying to is how projects die. Context readiness is scoped to a single use case. Pick one narrow workflow, assemble and clean only the context that workflow needs, capture the relevant tribal knowledge, and start. Expand to the next use case after the first one works. Boiling the ocean first guarantees you never ship.

Will a more advanced model fix disappointing results?

Usually not. If the disappointment comes from thin or missing context, a stronger model just gives you a more confidently worded version of the same underinformed answer. Spend the effort on the context, the sources, the currency, the consistency, the captured know-how, and even a standard model will produce results that feel bespoke to your business.

Feed It Well, Then Judge It

The market will keep pushing the next, smarter model as the answer to underwhelming AI. Sometimes a better model helps. Far more often, the disappointing result was never the model's fault. It was underinformed, working from context that was thin, stale, contradictory, or locked away. AI is only as good as what you give it, and most businesses have not yet given it much.

Two things to walk away with. First, when AI disappoints, audit the context before you shop for a new model, because that is where the problem almost always is. Second, treat context readiness as a per-workflow effort you can start today, not a company-wide project you postpone forever. The businesses that get real value from AI are simply the ones that did the unglamorous work of getting their own knowledge in order.

If you want a clear read on where your business is context-ready and where a pilot would fall flat, that assessment is exactly what I do. Let us find your AI-ready starting point. More on how I work is on my about page.

Thanks for reading! I hope this was useful. If you have questions or thoughts, feel free to reach out.

Content Creation Process: This article was generated via a semi-automated workflow using AI tools. I prepared the strategic framework, including specific prompts and data sources. From there, the automation system conducted the research, analysis, and writing. The content passed through automated verification steps before being finalized and published without manual intervention.

Mahmoud Zalt

About the Author

I’m Zalt, a technologist with 16+ years of experience, passionate about designing and building AI systems that move us closer to a world where machines handle everything and humans reclaim wonder.

Let's connect if you're working on interesting AI projects, looking for technical advice or want to discuss anything.

Support this content

Share this article