Twenty-Eight Questions Before You Sign
Automation vendors are rarely dishonest, but they are optimistic, and the gap between an impressive demo and a working production workflow is where most budgets disappear. These are the questions that close that gap before money changes hands.
Ticks are saved in this browser, so you can run the same list past several vendors over a fortnight and compare like with like.
Vendor Evaluation Checklist
Twenty-eight questions. Tick each one off when you get a straight answer.
Your ticks are saved in this browser, so you can work through the list over several sessions.
01Scoping and discovery
0/5How they find out what the process really does.
02Build ownership and lock-in
0/5The section most buyers skip and most later regret.
03Reliability and exceptions
0/6What happens when something unexpected arrives.
04Data handling and access
0/6You stay accountable for this data regardless of who processes it.
05Pricing and change
0/5What it costs once the business inevitably changes.
06Support and exit
0/3Get the response time in writing.
General commercial guidance, not legal advice. For questions about data handling obligations or contract terms specific to your circumstances, seek professional advice.
What You Are Actually Testing For
You are not testing whether they can build it. Most competent vendors can. You are testing what happens at the edges: when the scope grows, when something breaks at 2am, and when you eventually want to leave.
Who owns what gets built
This is the question most buyers never ask and most regret. If the workflows live in the vendor’s account under the vendor’s licences, you have rented a capability rather than acquired one, and your leverage at renewal is close to zero.
How exceptions get handled
Every automation meets inputs it was not designed for. Ask specifically what happens then: does it stop, does it guess, does it alert someone, or does it fail silently? Silent failure is by far the worst outcome and by far the most common.
What support really means
“Ongoing support” covers everything from a monitored on-call roster to an email address someone checks on Tuesdays. Get the response time in writing, and ask what happens when a workflow breaks outside business hours on a process that runs overnight.
The Six Areas That Decide the Outcome
Twenty-eight questions grouped into the six areas where automation engagements most commonly go wrong.
Scoping and discovery
How they establish what the process actually does, and what happens when discovery reveals it is more complex than the quote assumed.
Build ownership and lock-in
Whose accounts, whose licences, whose intellectual property, and what you can take with you.
Reliability and exception handling
What the workflow does when something unexpected arrives, and how you find out.
Data handling and access
What data the automation touches, where it goes, and what credentials the vendor holds.
Pricing and change
What the total cost is, and what a change request costs once you are live.
Support and exit
Response times, who fixes it, and how you leave without losing the capability.
The Four Expensive Surprises
These four account for the large majority of automation engagements that end in frustration. All are avoidable by asking in advance.
The build lives in the vendor’s account
Workflows built inside a vendor’s own automation platform account, under their licences and their API keys, cannot be handed over. When the relationship ends, the capability ends with it, and rebuilding from scratch costs as much as the original project. Establish ownership before the first invoice, not at renewal.
- Ask whose account, whose licences and whose API keys the build runs on
- Ask for a written statement that you own the workflows and configuration
- Ask whether you receive a documented export at handover
- Beware “managed service” framing that quietly means you own nothing
Silent failure
The genuinely dangerous automation failure is not the one that stops loudly. It is the one that keeps running while quietly processing things incorrectly, which nobody notices for six weeks. Ask specifically about monitoring, alerting and what a failure looks like from your side.
- Ask what alerts you receive and who receives them, by name
- Ask what happens to an item the workflow cannot process
- Ask whether there is a queue of failed items and who reviews it
- Ask for the actual monitoring dashboard to be shown, not described
Change requests priced as new projects
Business processes change. If every adjustment after go-live is quoted as fresh work at project rates, the automation becomes frozen at the moment it was built and gradually diverges from how the business actually operates until it is abandoned.
- Ask what a small change costs and how long it takes
- Ask whether minor changes are included in any ongoing fee
- Ask whether your team can make changes themselves, and what training that needs
- Get the hourly rate for post-launch work in writing before signing
Credential sprawl
Automation needs access to your systems, which means handing over credentials. Done casually, this ends with a vendor holding admin access to your accounting system through a personal account with no audit trail and no offboarding process.
- Insist on dedicated service accounts rather than a staff member’s login
- Grant the minimum permissions the workflow actually requires
- Ask how credentials are stored and who inside the vendor can access them
- Agree an offboarding process for revoking access when the engagement ends
Next Steps
Automation ROI Calculator
Once you have real quotes, check the numbers actually justify the build.
Run the numbers →Automation Implementation Checklist
Signed? This is the rollout sequence that keeps the project honest.
Open the checklist →How to Choose an AI Automation Agency
The longer written guide to selecting and running an automation partner.
Read the guide →Frequently Asked Questions
Should I pay for a discovery phase before committing to a build?
Usually yes, and being asked to is a good sign rather than a bad one. A paid discovery that produces a documented process map, a list of exceptions and a firm build quote is far cheaper than a fixed-price build scoped from a one-hour conversation, because the latter either carries a large risk premium or turns into variations later. What matters is that discovery produces something you own and could hand to a different vendor: if the output is a proposal rather than documentation, it was a sales exercise you paid for.
Is it better to use a platform like Zapier or Make, or a custom build?
It depends on volume and complexity rather than on preference. Established platforms are quicker to build on, easier for your own team to maintain, and cheaper at low to moderate volume, but per-task pricing becomes expensive at scale and complex logic gets unwieldy. Custom builds cost more upfront and need someone to maintain them, but they handle complexity better and cost less per transaction at volume. Ask any vendor to justify their recommendation in terms of your volumes specifically, and be sceptical if they only ever recommend the approach they happen to specialise in.
How long should an automation project take?
For a single well-scoped process in a business with reasonable documentation, two to six weeks from signature to live is a realistic range. Anything quoted at under a week is either genuinely trivial or has not been scoped properly. Anything running beyond three months for one process usually indicates scope that expanded during the build, which is a sign discovery was inadequate. Multi-process programmes should be sequenced as a series of short projects rather than a single long one, so value arrives early and lessons carry forward.
What should I expect to pay?
The Australian market varies enormously, from a few thousand dollars for a straightforward integration on an existing platform to well into five figures for a complex multi-system workflow with custom logic. Rather than benchmarking against a headline figure, get every vendor to quote the same clearly documented process and compare the totals including ongoing costs. A quote that is dramatically lower than the others usually reflects a narrower reading of the scope, so check what each has assumed about exception handling before treating them as comparable.
Do I need a vendor at all, or could my own team build this?
For straightforward integrations on established platforms, a capable internal person can absolutely build and maintain them, and doing so gives you the fastest change cycle and the lowest ongoing cost. The realistic constraints are capacity and continuity: internal builds tend to stall when the person who built them gets busy, and they become a liability if that person leaves without documentation. If you go internal, insist on the same standards you would demand of a vendor, documentation, monitoring, and a service account rather than a personal login.
What happens to my automations if the vendor goes out of business?
This is exactly why the ownership questions matter more than any other section of this list. If the workflows run in your accounts, on your licences, with documentation you hold, a vendor disappearing is an inconvenience, another provider can pick them up. If everything lives in the vendor’s environment, their failure is your outage, with no notice and no path to recovery. Ask the question directly, get the answer in writing, and treat a vague response as a material risk rather than a formality.
Sources and further reading
- Zapier (Zapier)
Ask Us All Twenty-Eight
We would rather answer the uncomfortable ones now than have you discover the answers in month four. Send the list through.