
A huge number of AI jobs, and every one has to finish.
I work on a platform where AI agents research, qualify and prepare accounts for B2B sales teams.
AI work that finishes
The product is not one clever prompt. It is long chains of AI jobs: find the company, read about it, check it against the customer's ideal profile, find the right person, prepare the message. Every step depends on a model that somebody else runs.
And AI is moving faster than the capacity behind it. On an ordinary day one provider times out, another answers that it is overloaded, a third does not offer the model in the region you need, and a fourth says you have reached your rate limit. None of that is a bug in your code. All of it is normal.
With a queue and a scheduled job, each of those failures is a lost job, a duplicate, or a person re-running things by hand. These chains run on a durable workflow engine, Temporal,Durable executionA way of running long multi-step jobs where each completed step is saved. After a crash, a timeout or a deploy, the job continues from the last saved step. Temporal is an open-source engine that does this.Learn more → instead. Every step's result is recorded as it completes. When a provider fails, the workflow does not die: it waits, retries with back-off or moves to another provider, then carries on from the exact step where it stopped, even after a deploy or a crashed worker. A long wait is simply a workflow that is still waiting.
The platform I work on routes each step across the main AI providers, with fallbacks. Work that can wait goes to cheaper capacity. Each kind of task runs on the cheapest model that passes its evaluation. Outputs are checked against a schema and settings are pinned, so the same input gives the same answer. My part is the durable workflows underneath and the compliance engineering, as part of the platform team.
Durable execution turns provider failures into waits, retries and fallbacks.
Compliance and closed doors
I led the technical side of SOC 2SOC 2An independent auditor's report on how a service company protects customer data: security, availability, confidentiality. Large customers, especially in the US, often ask for it before signing.Learn more → and ISO 27001ISO 27001 and Annex AThe international standard for managing information security, certified by an accredited auditor. Annex A is its list of controls (access, logging, supplier security and so on) that an organisation must apply or justify leaving out.Learn more → readiness: the controls engineering is responsible for, and the evidence that proves them. Evidence is collected where the work already happens: reviewed pull requests, release records, threat-detection findings, vulnerability fixes and machine-image rotation.
When the stream of new vulnerabilities outran manual triage, I built a cockpit over the compliance tasks: one AI-assisted session per task, evidence written to documents, export for the auditor.
The doors stay closed while all of this runs. Nobody reaches production directly: access goes through a gateway that issues short-lived certificates. Internal tools sit behind an identity check, off the public internet. Certification is the auditor's to grant; the groundwork is in place.
The same thinking is available for your organisation: compliance readiness and AI workflows in production.