The Automation Log
Treat Your Systems Like Employees: Job Descriptions, Reviews, Firings
Every automation holds a job. Learn how to write job descriptions, set KPIs, run reviews, and fire systems that stop earning their place.
Every automation in your business holds a job. Most operators never write down what that job is — and then wonder why their stack feels like a mess six months later. Treat each system exactly as you would a hire: define the role before you build it, measure performance on a cadence, and terminate without sentiment when it stops earning its place.
What does a job description for an automation actually look like?
A job description for an automation answers the same questions you’d ask about a new employee: What is this role responsible for? What does success look like in 90 days? Who reviews its output? What is it explicitly not responsible for?
For a lead-intake automation, that might read:
| Field | Detail |
|---|---|
| Role name | Lead intake router |
| Trigger | New form submission on contact page |
| Responsibilities | Qualify lead, log to CRM, send confirmation, notify owner if hot |
| Out of scope | Pricing conversations, contract generation |
| Owner | Kristian (reviewed weekly) |
| Success metric | 100% of submissions logged; owner notified within 5 minutes |
Writing this down takes 15 minutes. Not writing it down costs hours of debugging later when the automation drifts or someone edits a step without understanding the full role. This is the delegation memo — the same discipline that applies when you’re delegating to a human or a system.
How do you set KPIs for a system that isn’t human?
KPIs for automations are the same concept as KPIs for employees: measurable outputs that confirm the role is being performed. The difference is that software can surface these numbers automatically if you build logging in from the start.
Useful automation KPIs by category:
- Reliability — completion rate (jobs finished vs. triggered), error rate, manual intervention rate
- Speed — time from trigger to output (e.g., seconds from form submit to CRM entry)
- Business impact — leads touched, appointments booked, follow-ups sent, pipeline influenced
- Cost — API calls consumed, tool subscription cost per task completed
Run a simple model for yourself: if a follow-up automation should send a sequence to every new lead and you see it only fired on a fraction of records last month, that gap has a dollar value. Multiply your average deal size by your close rate by the number of missed sequences. That number tells you whether a fix is worth prioritizing this week or next quarter. These are illustrative inputs — plug in your own numbers.
For a deeper look at which numbers to surface and how, the owner’s dashboard post covers the reporting layer that makes this practical.
The review cadence: scheduled, not reactive
Most operators only look at an automation when it breaks. That is reactive maintenance, not management. A scheduled review forces a harder question: is this still the right system for this job, even if it hasn’t broken?
A lightweight review template:
- Pull the KPI numbers since the last review.
- Compare against the targets in the job description.
- Check for process drift — has the upstream input changed (new form fields, new CRM, new team member) that the automation doesn’t know about?
- Ask: if I were hiring for this role today, would I hire this system again?
Quarterly is the right default cadence for most workflows. Monthly for anything touching revenue or customer experience directly — a voice agent, a booking flow, a payment reminder sequence.
In the businesses I run — including a real-estate brand and an AI receptionist platform — every active automation has a written role definition and sits on a quarterly review schedule, as of October 2026. The review is not about whether the tool is technically running; it is about whether the role still makes sense, whether the KPIs are being hit, and whether the system would survive a hiring review if I were filling the position today. The ones that would not survive get terminated. This discipline has kept my stack at a manageable size and prevented the accumulation of zombie workflows that quietly consume cost and attention without producing measurable output.
When — and how — to fire an automation
Termination conditions should be written into the job description upfront. Examples:
- Error rate exceeds a defined threshold for two consecutive review periods
- The upstream process it serves has been eliminated
- A better tool now exists and migration cost is justified by the improvement
- The business problem it solved no longer exists
Firing an automation is not just turning it off. Do it properly:
- Document the decision — why it was retired, what replaced it (or why nothing did)
- Revoke credentials and API keys it held
- Remove or archive the workflow so it cannot be accidentally re-triggered
- Update any documentation that referenced it
Skipping these steps creates security exposure and confusion. A zombie workflow with live credentials is a liability — the same point covered in automation debt is real and compounds quietly.
Building the habit
The management discipline here is not technical — it is operational. You already know how to manage people. Apply the same rigor to software.
- Write the job description before you build the automation
- Set KPIs at the same time, not after
- Put the review on your calendar the day you deploy
- Define the termination condition in the job description
If you run Business Runner or any other automation platform, these principles apply to every active workflow in your account. The tools do not manage themselves. You are still the manager — the org chart just looks different now.
For operators who want this governance layer installed without building it from scratch, working with a Fractional Chief Automation Officer is how you get the discipline embedded across the whole stack. For a fuller picture of how this fits into a one-person operating model, how one operator runs multiple companies without an office shows the stack in practice.
Want to audit the automations already running in your business? Start a conversation with the voice agent on this site.
Questions people ask
What does a job description for an automation actually look like?
It answers: what triggers this system, what is it responsible for, what is out of scope, who reviews its output, and what does success look like in 90 days. Writing it down takes 15 minutes and prevents hours of debugging when the workflow drifts from its original purpose.
How do you set KPIs for an automated system?
Track reliability (completion rate, error rate), speed (time from trigger to output), business impact (leads touched, appointments booked), and cost (API calls, subscription cost per task). Build logging in from the start so the numbers surface automatically rather than requiring manual audits.
When should you retire or replace an automation?
Retire it when the error rate exceeds a defined threshold across two review cycles, the upstream process it served is gone, a materially better tool exists and migration is justified, or the business problem it solved no longer exists. Document the decision, revoke credentials, and archive the workflow.