Most operators believe their success equals the operations dashboard. It doesn't. On-time delivery, cycle time, and inventory turns are the metrics you manage. They are not the metrics you are judged on.

A COO is measured on a smaller, harder set of questions the CEO and board ask quietly: Did the things we committed to actually happen? Can the CEO stop worrying about how the business runs? Did the leaders under you get stronger, and did the good ones stay? When something broke, did it get handled before it reached the board?

Get those right and a soft quarter is forgiven. Get them wrong and a stack of green KPIs won't save you. This guide separates the operational metrics you run from the personal scorecard that decides your tenure, and shows what strong versus weak looks like on each.

The difference between running metrics and being measured

Operational KPIs measure the machine. Your personal scorecard measures you — your judgement, your reliability, and the effect you have on the people and decisions around you. The two overlap but are not the same, and confusing them is the most common way capable operators lose their seat.

Strong looks like a COO who owns a handful of outcomes the CEO cares about and hits them predictably. Weak looks like a COO who reports thirty metrics, most of them green, while the two things the CEO actually asked for keep slipping. The dashboard is not the point; it is the evidence.

A useful way to see the gap: the operations layer answers "is the process healthy?" (covered in depth in our operations metrics guide). The success layer answers "is this the right second-in-command?" You need the first to earn the right to be judged on the second.

Execution reliability: did the committed things happen

This is the core of the job. A COO exists so the CEO's strategy turns into reality. The single most predictive success signal is your say-do ratio: of the things you committed to this quarter, how many actually shipped, on time, at the promised quality?

Strong: you commit to fewer things and hit nearly all of them. When a commitment is at risk, the CEO hears about it early, with a recovery plan, not an excuse. Weak: you commit to everything, deliver most of it late, and the CEO learns about slips at the review. Reliability, not ambition, is what builds trust.

How to make this measurable: keep a live list of every commitment made to the CEO or board, with a date and a definition of done. At quarter-end, count what landed on time. A firm might set a target of hitting 85-90% of committed milestones; consistently below that and you have a credibility problem regardless of how the individual metrics look. This forward-looking discipline is what turns a busy operator into a reliable one.

The CEO relationship: can they stop worrying

The COO-CEO partnership is not a soft factor — it is a measured outcome. A CEO's job is to look outward: fundraising, strategy, key customers, the board. They can only do that if the inside of the business is handled. Your success is partly defined by how much operational worry you take off the CEO's desk.

Strong: the CEO forwards a problem to you and it is closed without a second conversation. They spend board prep talking about growth, not firefighting. Weak: the CEO still gets pulled into operational decisions, chases you for status, or hears about problems from someone other than you. The HBR "Second in Command" archetypes (Bennett & Miles, 2006) all share this: the role is defined relative to the CEO's needs, not a fixed job description.

A concrete test: after six months, ask what the CEO now delegates without checking that they used to hold onto. If that list is growing, you are succeeding. If it is flat, you are seen as an executor, not a partner. Deepen this deliberately — the mechanics are in our guide on the COO-CEO partnership.

Talent outcomes: did your leaders get stronger and stay

A COO is judged on the bench, not just the numbers. You can hit targets for a year by pushing hard; you cannot sustain it if your best people burn out or leave. Boards read regretted attrition among your direct reports as a leading indicator of trouble, because it shows up in results a year before the financials do.

Strong: your leaders take on more scope over time, your regretted attrition is low, and you have a named successor for each critical role. Weak: your team depends entirely on you, key people leave for lateral moves elsewhere, and a single resignation causes a crisis. Track two things: regretted attrition (good people you wanted to keep) separately from total attrition, and internal promotion rate. A healthy operation promotes from within and loses few of the people it wanted to keep, backed by real succession planning.

No surprises: how you handle what breaks

Everything above assumes things go well. They won't. The board does not expect a COO to prevent every problem — they expect zero surprises. A handled crisis the board never had to worry about is a success. A small issue that reached the board unmanaged is a black mark, even if the underlying damage was minor.

Strong: when something breaks, you contain it, communicate a clear picture early, and present the fix alongside the problem. Weak: you either hide issues until they explode or escalate every wrinkle upward, training the CEO to distrust your judgement on what matters. The skill is calibration — knowing what the CEO needs to know, when, and in what form. Our crisis management guide covers the containment playbook.

Here is how the same event reads on your scorecard depending on how you handle it:

Building a scorecard you can actually win

Do not wait to be graded on criteria you never agreed to. In your first weeks, and again each year, agree the scorecard explicitly with the CEO. This is one of the highest-leverage moves in any COO transition plan.

Ask the CEO to name the three to five outcomes that would make this a great year — in their words, not yours. Convert each into something observable with a target and a date. Confirm how success will be reviewed and how often. Then write it down and send it back so there is a shared record. A COO measured against a scorecard they helped set is judged on the right things; one who never had the conversation is judged on whatever the CEO happened to worry about last week.

Keep the running metrics for managing the business, but keep the scorecard separate and short. Bring it to your reviews. When you sit in front of the board, lead with the committed outcomes and where they stand — that is the language of board communication that senior operators are respected for. The dashboard is your evidence; the scorecard is your case.

Key takeaways

• The operations dashboard measures the machine; your personal scorecard measures your judgement, reliability, and effect on people — don't confuse the two.
• Say-do ratio is the most predictive success signal: commit to fewer things and hit them, and flag risks early rather than at the review.
• A large part of your success is defined relative to the CEO — how much operational worry you take off their desk so they can look outward.
• Regretted attrition and internal promotion rate reveal trouble a year before the financials do; the bench is part of your scorecard.
• Boards forgive handled problems and punish surprises — contain, communicate early, and present the fix with the problem.
• Agree the three to five outcomes you'll be judged on with the CEO up front, make them observable, and write them down.

Frequently asked questions

Is a COO judged on the same KPIs as the operations team? No. The operations team is judged on process metrics like cycle time and defect rate. A COO is judged on those outcomes plus a personal layer: execution reliability, the CEO relationship, talent retention, and freedom from surprises. You can have a green operations dashboard and still be seen as failing on the personal scorecard. What single metric best predicts a COO's success? Say-do ratio — the share of commitments made to the CEO and board that actually land on time and to spec. It captures judgement (committing to the right things and not over-promising) and reliability in one number, and it is the trust currency the whole relationship runs on. A COO who consistently delivers what they promised is forgiven a weak quarter; one who doesn't isn't. How is a first-time COO measured differently in the first year? In year one, the weight sits on establishing trust and the CEO relationship rather than on financial outperformance. The board watches whether you stabilise operations, build a working partnership with the CEO, and avoid surprises. Set an explicit scorecard early so you're judged on the right things while the business learns to rely on you. Should a COO's compensation be tied to these metrics? Usually part of it is. Base pay reflects the role, while variable pay is often tied to the committed outcomes on the scorecard plus company performance. The US Bureau of Labor Statistics lists a median wage for chief executives of $206,420 (May 2024), and senior operating roles typically add a significant bonus and equity component on top, weighted toward the outcomes you agreed to own. How do I measure success if the company is missing its numbers for reasons outside operations? Separate what you control from what you don't. If the market softens, you are still measured on cost discipline, execution against the revised plan, protecting your team, and clean communication with the board. A downturn handled well — decisive, transparent, no surprises — can raise your standing even as headline numbers fall. How often should the COO scorecard be reviewed? Review the committed outcomes with the CEO at least quarterly, with a lighter monthly check on anything at risk, and reset the full scorecard once a year as strategy shifts. The point is that the criteria are agreed and shared, not sprung on you at review time, so you're always working toward the same definition of success the CEO holds.