← All writing

RevOps already knows how to manage AI. It's called pipeline.

Teams are treating AI output as a black box they can't measure. But RevOps has spent a decade building exactly the discipline AI needs: define the outcome, instrument it, review it weekly.

There’s a strange anxiety in GTM right now: people deploy AI into their workflows, then have no idea whether it’s working. The drafts look fine. The summaries read well. But “looks fine” is not a metric, and nobody’s quite sure if the thing is actually helping or just confidently producing plausible text.

Here’s the thing — RevOps solved this problem years ago. We just called it something else.

Evals are pipeline reviews for model output

An “eval,” in AI terms, is a repeatable test that scores a model’s output against a definition of good. Define the outcome, instrument it, review the trend, intervene when it drifts.

If that sounds familiar, it should. It’s a pipeline review. RevOps has spent a decade insisting that you can’t manage what you don’t define and instrument:

  • You don’t accept “the deal feels good.” You define stage exit criteria.
  • You don’t eyeball the number. You instrument the funnel and watch conversion.
  • You don’t fix it once. You review weekly and catch drift early.

Point that exact muscle at AI output and the black box opens up.

A concrete version

Say you’ve put an LLM in charge of drafting first-touch emails. The vague version: “the AI writes our emails now.” The RevOps version:

  1. Define good — reply rate and meetings booked, not “sounds human.”
  2. Instrument it — tag AI-drafted vs. human-drafted, compare cohorts.
  3. Review weekly — is the gap widening or closing? Where does it fail?
  4. Intervene — adjust the prompt, the data, or the boundary of what AI owns.

The teams that win the AI transition won’t be the ones with the best models. They’ll be the ones who already had the discipline to measure outcomes.

RevOps has that discipline. The opportunity is to recognize that “managing AI” and “running pipeline” are, underneath, the same job.