“We'll set up a chatbot for you, and then it just runs by itself.” You hear that a lot. It's wrong. Setting up an AI chatbot is the easy part. Keeping it good for years is the real work. Why ongoing maintenance is not a luxury, and what actually happens behind the scenes.
What happens to an unmaintained chatbot?
Most small-business chatbots are left to their own devices after launch. You can tell because, six months in, they answer worse than they did on day one. Nobody notices, though, because nobody is measuring.
A concrete example from practice: a chatbot correctly answers questions in English at first. After a model update at OpenAI, it suddenly starts answering in English every time, even when the question is asked in German. The bot's operator doesn't notice. The customers don't say anything. They simply go to a competitor.
Silent degradation is the real problem. Nobody complains, everything looks normal. Until one day you notice that enquiries through the chatbot are dropping off. By then the damage is already done.
Here's what a realistic start looks like: we first build the chatbot around your business's 10 to 20 most common questions, things like opening hours, prices, location, contact details, typical services. The bot answers these core questions reliably from day one.
Once it's live, though, questions come in that nobody thought of during setup. At first it answers these worse, sometimes not at all. A freshly launched chatbot therefore never answers every question well. The question isn't whether it starts out perfect. The question is what happens next.
Answer quality over 12 months, schematic
With and without ongoing maintenance. A schematic of the direction, not measured values. Independent studies on such curves do not exist at this level of detail.
Why do chatbots deteriorate in the first place?
A chatbot isn't a static piece of work. It depends on factors that keep changing:
- Model updates change behaviour. OpenAI, Anthropic and other providers regularly update their AI models. What worked flawlessly yesterday can behave differently today. Sometimes better, sometimes worse, often just different from what you'd expect.
- New questions come up. Customers ask things nobody thought of during setup. Without regularly reviewing conversations, these go unanswered or get answered incorrectly.
- Your content changes. Prices, opening hours, services, staff, locations. The bot has to grow with your business, or it gives out-of-date information.
- Tone drifts. Model updates often change the tone. A bot that used to sound friendly and casual can suddenly come across as stiff and formal after an update. That no longer fits the brand.
- No monitoring, no visibility. Without tools for quality monitoring, you simply don't know what your chatbot is doing. You might see that it's giving answers. Whether those answers are good is a different question.
What we actually do at ServasBot
With ServasBot Inbox we run your chatbot's knowledge base. To keep it good over the long term, a quality process runs in the background. Your part is approving the suggestions from the weekly email. Specifically:
- Random-sample quality checks. Every week we check a sample of answers: is it factually correct, in the right language and in the right tone? With many conversations an AI-assisted pre-check is added. According to peer-reviewed research (Zheng et al., NeurIPS 2023), such checks reach around 80% agreement with human reviewers, roughly the same level of agreement typically seen between humans. Anything flagged then lands on our manual review list.
- Manual review of flagged items. Whatever the automated check flags, we look at personally. A poor answer gets corrected, the bot's knowledge gets extended, the example gets added to training.
- Model updates tested, not adopted blindly. When OpenAI or another provider releases a new model, we first test it against a gold-standard set of typical enquiries from your business. It only goes live for you once the new model is as good as, or better than, the old one. If it performs worse, the old model stays active. Why the model is replaceable in the first place is covered in switching chatbot providers.
- Weekly email with suggested answers. Every week we review the conversations. Open questions reach you in a weekly email with a suggested answer. You approve with one click or correct it. That way the knowledge grows from your customers' real questions.
- Maintaining the knowledge base. As soon as you tell us something has changed (new prices, changed opening hours, new staff), we build it in within 48 hours. The bot always knows the current state of things.
- Monthly report. Once a month you get an overview: how many conversations there were, what share the AI handled without your team, how many were handed over to your team, which topics came up most and where gaps remain.
Self-service vs. ServasBot Inbox: who does what?
There are inexpensive chatbot platforms where you do everything yourself. That works if you have the time and the technical know-how for it. ServasBot's self-service chatbot works on the same principle, from € 49 a month, with a 30-day free trial. This article shows the maintenance effort you should realistically plan for, so you make the decision with your eyes open. Here's the comparison:
| Task | Self-service | ServasBot Inbox |
|---|---|---|
| Regularly review answers | You | We do |
| Test model updates | You (or you don't notice) | We do |
| Correct poor answers | You | We do |
| Keep content up to date | You | You tell us, we build it in (within 48 hours) |
| Quality reporting | Evaluate it yourself | Weekly email and monthly report |
| Time spent per month | 2 to 4 hours, more with many conversations | Approve the suggestions from the weekly email |
Self-service is cheaper in price but more expensive in time. Anyone who takes their chatbot seriously and wants to run it properly needs around 2 to 4 hours a month for ongoing quality assurance, more with many conversations. For a small-business owner with a full-time job on top, that's a real problem.
What you get out of it
- Reliability. Your chatbot stays at the quality level it started at. Ideally it even gets better, because it learns from every customer enquiry.
- Little effort on your side. You look after your business, we look after the chatbot. Your part is approving the suggestions from the weekly email with one click. Get in touch when something changes.
- Your customers' trust. A chatbot that consistently gives good answers builds trust. One that answers differently each time damages it.
- No nasty surprises after model updates. You only hear about updates once they reach you, and only when they're an improvement.
What to watch out for
If you're a small business and want to deploy a chatbot, don't just think about what the initial setup costs. Think about who maintains it over the long run, too. A cheap self-service bot that isn't maintained will cost you more customers in the long run than a pricier managed bot that keeps working consistently well.
With ServasBot Inbox, ongoing maintenance is a built-in part of the package, with no surcharge for the maintenance and no maintenance contract with small print. It costs € 990 a month for up to 1,500 chat conversations or € 1,490 for up to 3,000 chat conversations, plus a one-off € 1,900 setup fee, cancel monthly. Annual partners pay no setup fee. We are taking on 4 customers right now, because we run every knowledge base ourselves. With self-service from € 49 a month, you take care of the maintenance yourself, with the time figures from the table above as a realistic guide. Personally supported from Villach, Carinthia, GDPR-compliant with hosting in Germany. Request a spot.
Data and sources
Solid, independent industry benchmarks for resolution rates of small-business chatbots are rare. Most of the figures circulating come from providers themselves and are not methodologically validated. The following market observations are essentially the reliable ones:
- Gartner (March 2025) predicts that by 2029, agentic AI will autonomously resolve around 80% of common customer-service issues without human intervention. Today, the share is well below that.
- Gartner (December 2024): by 2027, GenAI-powered third-party tools are expected to resolve 40% of customer-service issues.
- Zendesk CX Trends 2026 (a survey of 11,297 consumers and business representatives across 22 countries, June 2025): 74% of consumers expect 24/7 service, and 85% of CX leaders say customers switch providers when issues aren't resolved on first contact.
- Zheng et al. (NeurIPS 2023): Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena — the peer-reviewed primary source for the roughly 80% agreement between AI-based quality checks and human reviewers.
The claim that “a well-maintained chatbot can get better over time, while an unmaintained one gets worse” is widely observable in practice, but it isn't quantifiable as a study finding. The chart above should therefore be understood as a sketch based on experience, not as a proven research result.