Pulse
7 7IT Solutions
AI

Should You Build an AI Chatbot or Buy One?

Lior Aharonov Lior Aharonov 15 min read

Buy an off-the-shelf AI chatbot when the job is deflecting common questions from information that is already public on your site, and you want it answering by Friday. Build a custom assistant when it has to speak accurately about your private data, take real actions inside your systems, sound like your business rather than a template, and reliably refuse to say certain things. What tips the decision is not the general build-or-buy logic that applies to any software. It is four factors specific to a talking machine that can be confidently wrong: how accurate it has to be, who controls the data flowing through it, what it costs per conversation as you grow, and what happens when it should hand off to a human. Get clear on those four and the path is usually obvious.

The short version

  • The generic build-or-buy method still applies, but AI adds four twists. Accuracy, data control, per-conversation economics, and escalation are where chatbot decisions actually turn.
  • "Build" here does not mean training a model. It means assembling a proven foundation model with your data, your guardrails, and your integrations. Nobody sensible trains an LLM from scratch for a small business.
  • A bought widget answers from what you paste into it. A custom assistant answers from your live systems. That difference decides whether it can quote a real price or check a real order.
  • A confidently wrong bot is worse than no bot. Accuracy is not a nice-to-have; an assistant that invents an answer damages trust faster than a slow human ever could.
  • Per-conversation pricing is a tax on your own success. The busier your bot gets, the more a usage-metered platform costs, while a custom build's cost curve flattens.
  • The smartest first move is often to buy the cheap one to learn. The questions people actually ask it become the specification for the good one.

What are you really choosing between?

The word "build" scares owners off AI because they picture a research team and a data center. Set that image aside, because it describes almost nobody's real choice. The decision on the table is between three things.

There is the bought widget: a subscription chatbot you drop on your site, feed a handful of documents or FAQs, and style with your logo. There is the configured platform, a more capable middle tier where you connect some data sources and design flows without writing much code. And there is the custom assistant, which is not a model you invent but an assembly: a proven foundation model from a major provider, connected to your own data through retrieval, wrapped in guardrails you define, and wired into the systems it needs to act on. That last option is what "build" means in practice for a small business, and it is a matter of weeks of assembly, not years of research. The general trade of owning versus renting, cost curves, differentiation, reversibility, is the same one we lay out in the build versus buy framework; this piece is about the parts that framework does not cover, the parts unique to software that holds a conversation.

Everything that follows assumes you have already decided a chatbot is worth having at all. If you are still weighing whether AI belongs in your business this year, practical AI for small business is the more basic starting point.

Why does accuracy separate the two paths?

Regular software fails loudly. It throws an error, shows a blank screen, or refuses to save. A language model fails quietly and fluently: it produces a confident, well-written, completely wrong answer, and it does so in the same reassuring tone it uses when it is right. This is the single most important thing to understand before buying or building one, because it flips the usual risk calculation. A slow human who says "let me check" costs you a minute. A chatbot that tells a customer you offer next-day installation when you do not costs you a refund, a review, and possibly a legal headache.

What controls accuracy is grounding, meaning where the answer comes from. A bought widget typically answers from whatever text you pasted into its knowledge box, which goes stale the moment your prices or hours change and cannot see anything that lives in your actual systems. A custom assistant is grounded through retrieval, pulling the answer from your live data at the moment of the question, so it quotes the price that is true right now and can say "I don't have that information" instead of inventing it. That technique, retrieval-augmented generation, is the difference between a bot that guesses and one that looks things up, and we cover how it works in the guide to building a retrieval assistant on your own data. The deeper question of keeping a language model reliable once it is live, monitoring, testing, catching bad answers, is its own discipline, which we treat in running an LLM in production.

If your bot only ever needs to repeat information that is already static and public, a bought widget's shallow grounding is fine. The moment it needs to speak about anything that changes, or anything private, shallow grounding becomes the reason to build.

What does an AI chatbot actually cost over time?

The pricing shapes of the two paths are fundamentally different, and the difference matters most exactly when the bot is working well.

A bought platform almost always meters usage: a price per conversation, per resolution, per message, or per seat that scales with how much the bot is used. When traffic is light, this feels cheap and it is. But a chatbot that succeeds gets used more, and every one of those successful conversations rings the meter. You end up paying more precisely because it is working, which is a strange incentive to sign up for. Worse, that pricing is the vendor's to change, and usage-based AI pricing has been anything but stable.

A custom assistant inverts the curve. You pay to build it once, you pay the underlying model provider for tokens consumed (a genuine variable cost, but usually a small fraction of what platforms charge per conversation), and you pay to host and maintain it. As volume grows, the per-conversation cost falls rather than rises, and you are insulated from a platform vendor tripling its price or sunsetting the plan you built on. The honest catch is the upfront cost and the maintenance commitment, the same one any owned software carries. The math that decides it is a volume question: below some conversation count, the widget's convenience wins; above it, the flat build wins and keeps winning. If your bot will handle real volume, run the numbers past the point where success starts taxing you.

Who controls the data flowing through it?

Every message a customer sends your bot is data, and some of it is sensitive: order details, account questions, occasionally things people should not paste into a chat box but do. Two questions decide whether you are comfortable, and a bought widget often answers both in ways owners never checked.

First, where does that data live and who can see it? With a subscription bot, the conversation passes through the vendor's systems under the vendor's policies, and your customers' questions become records in someone else's database. With a custom assistant, you decide the path: which provider processes the text, whether it is logged, how long it is kept, and what never leaves your control. Second, is your data being used to train someone else's model? Reputable enterprise providers now contractually promise not to train on business data sent through their APIs, but many consumer-grade chatbot tools are far vaguer, and "vague" is not what you want standing between a competitor and your customers' questions. Building lets you choose a provider whose terms you have actually read and pin the behavior in writing.

None of this means bought is reckless and custom is safe. It means data control is a dial, and buying usually sets that dial to the vendor's default without asking you. If your conversations are trivial and public, the default is fine. If they touch anything you would not want copied, the dial is a reason to own the assistant.

What must the bot never do?

A chatbot represents your business with the authority of your website, so its failures are your liability. Before any assistant goes live, bought or built, decide its hard limits. A bought widget gives you a settings page and hopes it is enough; a custom assistant lets you enforce these as real rules.

  • It must never invent facts. When it does not know, it says so and offers a human, rather than generating a plausible answer. Grounding plus an explicit "I don't have that" instruction is how you get this.
  • It must never make commitments you cannot honor. No quoting prices it cannot verify, no promising delivery dates, no agreeing to terms. Anything binding routes to a person.
  • It must never leak or accept things it should not. Customers will paste card numbers and passwords; the bot must refuse to store them, and it must resist attempts to talk it out of its own rules. This class of attack, prompt injection and its cousins, is real and documented in the OWASP Top 10 for LLM Applications, the industry's consensus list of how these systems get abused.
  • It must know when to escalate. A frustrated customer, an angry one, a legal or safety question, or anything outside its competence should reach a human quickly and cleanly, with the conversation handed over so the customer does not repeat themselves.
  • It must stay in character and on topic. It represents your business, not the open internet, and it should decline to write poetry, argue politics, or be steered into embarrassing screenshots.

If your provider cannot show you how it enforces these, that gap is your answer about whether the tool is serious. The assistant on this site's own home page is a custom example built to exactly these limits: grounded in how we actually work, honest when it does not know, and quick to hand a serious prospect to a real conversation, which is precisely what a generic widget does poorly, as we explain in AI assistants that actually work.

How do you decide, step by step?

  1. Write the bot's job as one sentence. "Answer shipping and returns questions from our policy pages" is a different animal from "help a customer find the right product and place an order." The first is a widget job; the second needs to touch your systems.
  2. Check the grounding requirement. Does a correct answer depend on data that changes, or data that is private? If yes, you need retrieval, which points toward custom. If every answer is static and public, a widget can serve it.
  3. Check the action requirement. Does it only talk, or must it do, look up an order, book a slot, update a record? Talking is buyable; doing well usually needs a build wired into your systems.
  4. Estimate the volume. Roughly how many conversations a month at scale? Multiply by a platform's per-conversation price and compare to a build's flat cost plus token usage. Volume is what moves the money.
  5. Set the data line. Decide what is acceptable for customer messages: where they go, how long they are kept, and whether training on them is allowed. Read the terms of any tool against that line.
  6. Define the guardrails. Use the "must never" list above as your baseline, and ask each option to show you how it enforces them.
  7. Pick the cheapest way to learn, then commit. If you are unsure, the buy-then-build path below lets you gather real evidence before spending on a build.

The buy-then-build path

You do not have to choose blind, and the sharpest owners often refuse to. Start with an inexpensive off-the-shelf bot pointed at your FAQs, and treat its first month as research rather than a solution. Read the transcripts. The questions your visitors actually ask, in the words they actually use, are worth more than any planning meeting, because they reveal the real use cases, the real volume, and the exact points where a shallow widget hits its ceiling and starts guessing or escalating everything. That transcript becomes the specification for a custom assistant that is worth building, and by then you are deciding with evidence instead of a vendor's demo. For a store specifically, the same learn-first logic applies to grounding an assistant in live catalog and order data, which we walk through in a Shopify AI assistant that knows your store data.

Common pitfalls

Buying on the demo, which is always rigged to look brilliant. Vendor demos use clean questions the bot was tuned for. Your customers ask messy, misspelled, half-formed questions about edge cases, and that is where a shallow bot falls apart. Test any option against your ugliest real questions, not the demo script.

Treating the chatbot as fire-and-forget. An AI assistant is not an appliance you install and ignore. Your prices change, your policies change, the model provider ships updates, and answers drift. Whoever owns the bot has to read its conversations periodically and correct it, on either path. Budget for that attention or watch quality rot.

Letting it speak with authority it should not have. Here is the pattern that burns people. A home-services company installed a generic chatbot, pasted in an old services page, and let it loose. A customer asked whether they handle a specific repair. The bot, reaching for a helpful answer it did not actually have, said yes and quoted a rough price, both invented. The customer booked, the crew arrived, and the job was one the company does not do at a price it would never charge. The refund and the one-star review cost more than a year of the subscription, and the root cause was not a bad product, it was a confident bot with no grounding and no instruction to admit ignorance. A bot that will speak for your business needs the same guardrails you would give a brand-new employee on their first day at the phones, and more patience about what it is allowed to promise.

Over-building before you understand demand. The mirror-image mistake is commissioning an elaborate custom assistant for questions nobody turns out to ask. This is exactly what the buy-then-build path prevents. Learn cheap, then build to the evidence.

FAQ

Is it cheaper to build or buy an AI chatbot?

It depends on volume. A bought platform is cheaper at low usage because you avoid any upfront build cost, but it meters you per conversation, so the price climbs as the bot succeeds and gets used more. A custom assistant costs more upfront and carries a maintenance commitment, but its per-conversation cost falls as volume grows, since you pay only for model tokens and hosting rather than a platform markup on every chat. Below a certain conversation count the widget wins on cost; above it, the build wins and keeps winning. Estimate your realistic monthly volume and compare at that number, not at zero.

Do I need to train my own AI model to build a custom chatbot?

No, and you almost certainly should not. Building a custom assistant means connecting a proven foundation model from a major provider to your own data and rules, not training a model from scratch, which would cost a fortune and produce something worse. The custom work is in the assembly: retrieving answers from your live systems, defining guardrails, wiring in the actions the bot needs to take, and shaping its voice. That is weeks of focused engineering, not a research project, which is why "build" is a realistic option for a small business rather than a fantasy.

How do I stop an AI chatbot from giving wrong answers?

Ground it and constrain it. Grounding means the bot pulls answers from your live, current data at the moment of the question rather than from a static block of text that goes stale, which is the retrieval technique that separates a bot that looks things up from one that guesses. Constraining means an explicit instruction to say "I don't have that information" and offer a human whenever it is unsure, plus hard rules against quoting unverified prices or making commitments. A bought widget with a shallow knowledge box struggles at both; a custom assistant is built for them. No approach is perfect, so also monitor real conversations and correct drift.

Is it safe to send customer data through an AI chatbot?

It can be, if you control where the data goes and read the terms. With a bought consumer-grade tool, customer messages pass through the vendor's systems under policies you may not have checked, and some tools are vague about whether your data trains their models. Reputable enterprise providers contractually commit not to train on business data sent through their APIs, and building a custom assistant lets you choose such a provider, decide what is logged, and set how long conversations are kept. If your chats touch anything sensitive, treat data handling as a decision to make deliberately rather than a default to accept.

What should an AI chatbot never do?

It should never invent facts, never make commitments your business cannot honor, never store secrets like passwords or card numbers, never be talked out of its own rules, and never fail to hand off to a human when a situation is beyond it. These limits matter because the bot speaks with your website's authority, so its mistakes become your liability. The known ways these systems get abused, including prompt injection, are catalogued in the OWASP Top 10 for LLM Applications, and any tool you buy or build should be able to show you concretely how it enforces these boundaries rather than just listing them on a settings page.

Trying to decide for your business? Tell me what you want the bot to do, in plain words, and I will give you a straight build-or-buy recommendation, including "just buy the simple one and learn from it first" when that is genuinely the right call.

Have a project in mind?

Let's turn it into custom software that moves your business forward.