IN THIS ARTICLE
- 01Rule-based automation vs AI automation vs hybrid: which should you use?
- 02Step 1: Audit your most common ticket types
- 03Step 2: Build a knowledge base for the AI to draw from
- 04Step 3: Set up routing flows so tickets reach the right agent or AI
- 05Step 4: Configure AI agents for your top query types
- 06Step 5: Measure resolution rate and iterate
- 07What results to expect
AI customer support automation is not a single feature you enable and forget. It is a process — one that starts with understanding your ticket patterns, continues through knowledge base development and AI configuration, and improves over time as resolution data accumulates. When done well, AI handles 30 to 50% of tickets without any human involvement: response time drops from hours to seconds on automated tickets, cost per resolution falls from $3 to $6 (human) to under $0.50 (AI), and your agents spend their time on cases that actually benefit from human judgment.
This guide covers the practical setup for small support teams — what to do, in what order, and what results to expect. It is built around Delyt's actual workflow, but the principles apply to any AI-capable helpdesk.
Rule-based automation vs AI automation vs hybrid: which should you use?
Before setting up automation, it helps to understand the three types available and what each one handles best.
| Type | How it works | Best for | Limitation |
|---|---|---|---|
| Rule-based automation | If-then logic triggers actions based on keywords, tags, or conditions | Routing, assignment, SLA triggers, standard auto-replies | Brittle — breaks when query language varies; cannot handle ambiguity |
| AI automation | AI reads the message, understands intent, and generates a response or action | Complex response generation, intent classification, autonomou resolution | Needs a well-built knowledge base to draw from; quality varies by KB quality |
| Hybrid (rules + AI) | Rules handle routing and triage; AI handles response and resolution | Most production support setups | Requires setup of both layers but produces the most reliable results |
For most small teams, the hybrid approach produces the best results. Rules route incoming tickets to the right queue or AI agent based on category. The AI then reads the ticket, searches the knowledge base, and either resolves it autonomously or drafts a reply for agent review. The combination is more reliable than either approach alone.
Step 1: Audit your most common ticket types
Automation should be built on actual data, not assumptions about what customers ask. Before writing a single routing rule or KB article, export 90 days of closed tickets and categorise them by query type. Most support teams discover that their top five to seven categories account for 70 to 80% of total volume — and that three or four of those categories are highly automatable.
Typical ecommerce ticket distribution: order status (32%), return and refund requests (18%), product questions (14%), delivery issues (12%), account access (8%), general feedback (6%), complex/edge cases (10%). The first five categories are automatable at varying degrees. The sixth — complex and edge cases — is not, and should route directly to human agents.
What to look for in the audit
Mark each ticket category with: Automatable (AI can resolve with good KB), AI-assisted (AI drafts, human reviews), or Human-only (judgment required). Count the tickets in each category. Automate in order of volume × automatable likelihood — start with the highest-volume, most-automatable category first.
Step 2: Build a knowledge base for the AI to draw from
AI agents do not know your product unless you tell them. They generate responses by searching your knowledge base, so KB quality directly determines AI resolution quality. A thin or outdated KB produces low AI resolution rates. A comprehensive, current KB with well-structured articles for each automatable query type enables high-quality autonomous resolution.
For each of your top three automatable ticket categories, create at least three to five KB articles covering the range of queries within that category. Write them in customer language, not product team language. Include specific details: policy timeframes, product names, step-by-step processes. Add a "frequently asked" section to each article answering the three most common follow-up questions on that topic. In Delyt, KB articles are searchable by the AI agents in real time when generating responses — the richer the content, the more confidently the AI can resolve.
Step 3: Set up routing flows so tickets reach the right agent or AI
Routing flows are the rules that determine what happens to a ticket the moment it arrives. A well-designed routing setup means tickets are never waiting in a generic queue waiting for someone to read and manually assign them — they go directly to the right place automatically.
- Route by detected intent: "where is my order" → Order Status AI agent. "I want to return" → Returns flow. "My account won't let me log in" → Account Support queue.
- Route by channel: WhatsApp tickets during business hours → mobile-first agents; after-hours → AI auto-response with a returns-in-1-hour-during-business-hours message.
- Route by sentiment: tickets with negative sentiment signals → senior agents or priority queue.
- Route by SLA risk: any ticket that has been in queue for more than X minutes without assignment → escalate and alert.
- Route by language: auto-detect ticket language and route to agents with matching language proficiency, where available.
In Delyt, routing flows are built in the Flow Engine — a visual no-code builder where you connect triggers, conditions, and actions without writing code. The Flow Engine applies to all channels simultaneously, so a WhatsApp message and an email with the same intent follow the same routing logic.
Step 4: Configure AI agents for your top query types
Start with one or two query categories, not everything at once. The teams that achieve high AI resolution rates quickly are the ones that configure AI agents narrowly and well for specific query types, rather than broadly and superficially for all query types. Pick your highest-volume automatable category, configure an AI agent for that category specifically, and measure its resolution rate for two weeks before expanding.
When configuring an AI agent in Delyt, you define the agent's scope (which ticket categories it handles), its knowledge sources (which KB sections it should draw from), its escalation triggers (when confidence is below 75%, escalate to human), and its tone (matches your brand voice based on examples you provide). The AI agent then handles every ticket in its scope autonomously, only escalating when confidence falls below threshold.
Step 5: Measure resolution rate and iterate
Set a weekly review of three metrics: AI resolution rate (target 30 to 50% in the first 90 days), AI reopen rate (should be below 10%), and AI CSAT (should be within 5 points of human agent CSAT). Each metric tells you something specific.
- 1Low resolution rate → KB gaps. The AI cannot find answers. Identify the ticket categories where resolution rate is lowest and add KB content for those categories.
- 2High reopen rate → incomplete resolutions. The AI is resolving tickets that customers do not consider resolved. Review the resolved conversations and identify where the AI's responses fell short.
- 3Low AI CSAT relative to human CSAT → quality issue. The AI is resolving tickets but customers are not satisfied. Review resolution quality: are responses accurate, clear, and actionable?
- 4High escalation rate on a specific category → confidence threshold calibration. The AI is flagging too many tickets as uncertain. Review whether the category is genuinely ambiguous or whether better KB content could increase confidence.
What results to expect
Realistic outcomes from a well-executed AI support automation setup: 30 to 50% of tickets handled without human intervention within 90 days of full setup; response time on automated tickets dropping from 4 to 24 hours to under 60 seconds; cost per resolution on AI-handled tickets falling from $3 to $6 (human average) to $0.10 to $0.50 (AI); and agent capacity effectively doubling on the ticket types AI handles, freeing them for complex cases. These are achievable numbers, not theoretical maximums, for teams that follow the process outlined above.
Set up AI support automation in Delyt
AI agents, knowledge base, flow engine, and omnichannel inbox — all included from $39/seat/mo. No per-resolution fees.
Book a demoFREQUENTLY ASKED QUESTIONS