Questions to ask an AI setter vendor

Every demo in this category looks the same. A lead arrives, the agent replies in a friendly tone, the meeting lands on a calendar. The demo is not where vendors differ, and it is not where implementations fail.

These are the questions whose answers genuinely differ, grouped by the thing that breaks when nobody asked.

Who writes and maintains the conversation logic

There are three answers and they have very different costs in month three.

You do. Most control, and you own the outcome. Budget real time for it, and make sure one named person owns it — qualification criteria that nobody owns drift quietly.

They do, as a service. Fastest to a working setup, and usually the most expensive tier. Ask what a change costs and how long it takes, because you will want changes.

A template does. Cheapest, and fine if your qualification is genuinely standard. Ask to see the template before assuming yours is.

The follow-up question matters more than the answer: what does it cost, in money or days, to change one qualifying question six weeks from now?

What happens when the lead needs a human

Ask for the specifics, not the reassurance.

• What triggers a handoff — a keyword, a confidence threshold, an explicit request, a number of turns without progress?
• Who gets notified, and through what?
• What does the lead see while they wait?
• What happens at two in the morning, when there is nobody to hand off to?

That last one is the question most worth asking. The whole premise of the category is covering the hours you do not. A handoff rule that assumes somebody is awake is a gap exactly where the value was supposed to be.

Which channels it genuinely supports

“Supports SMS” covers at least three different arrangements: the vendor handles it end to end, the vendor resells a carrier, or you open your own carrier account and connect it. All three work. They differ in setup time, in who you call when delivery fails, and in who is liable for compliance.

Ask specifically about the channel most of your leads actually use, and ask what happens when a message fails to deliver — whether it retries, whether it falls back to another channel, and whether anyone finds out.

Who owns the conversation data

Four questions, all worth a direct answer:

• Can you export the full transcripts, and in what format?
• How long is data retained, and can you set that?
• Is your data used to train models — theirs or anyone else’s?
• If you leave, what happens to it?

If you are in a regulated vertical, ask about compliance at the same time rather than after. It tends to determine the tier, and therefore the price.

How long it takes to go live

Ask for a realistic date and what the vendor needs from you to hit it: calendar access, CRM credentials, carrier approval, qualifying criteria, example conversations. The gating item is usually something on your side, and knowing which one lets you start it early.

Then ask what “live” means. Live on one channel with one agent is a different milestone from live across the funnel, and vendors do not always mean the same thing by it.

One question for yourself

Before any of the above: what does a qualified lead actually look like for you, written down, in a sentence somebody else could apply? Teams that cannot answer that do not get a better outcome from a better vendor — they get a faster version of an unresolved decision.

Which of these questions matters most depends on the tool. The roundup says what each one is built for and what it runs on, and what they cost covers the pricing models the answers above will land you in.