Back to blog

DORA Metrics: How to Actually Know If Your Engineering Team (or Outsourced Partner) Is Performing

DORA Metrics: How to Actually Know If Your Engineering Team (or Outsourced Partner) Is Performing

Every VP of Engineering has sat through a vendor pitch deck full of logos, and every CTO has run a retro where nobody could agree on whether the team is actually getting faster or just busier. AEGONTECH LLC builds software for a living, and we've watched the same blind spot show up on both sides of the table: teams and vendors alike describe their own velocity in adjectives — "agile," "fast-moving," "highly responsive" — instead of numbers. That gap between how a team feels it's performing and how it's actually performing is where budgets get wasted, deadlines slip, and outsourcing relationships sour. There's a fix for this, and it isn't a new framework or a new tool. It's four numbers, published by Google's DevOps Research and Assessment (DORA) program, that have been validated across thousands of engineering organizations: deployment frequency, lead time for changes, change failure rate, and time to restore service (MTTR).

Key Takeaways

  • DORA's four metrics — deployment frequency, lead time for changes, change failure rate, and mean time to restore (MTTR) — are the closest thing the industry has to an objective scoreboard for engineering performance.
  • Elite-performing teams deploy on demand, often multiple times a day, with lead times under one hour; low performers can take one to six months to ship a single change.
  • These metrics matter as much for evaluating an outsourced development partner as for managing an in-house team — they're observable from the outside, unlike "we use Agile."
  • Chasing the metrics directly backfires; they're outputs of good architecture, CI/CD discipline, and testing culture, not targets to game.
  • AEGONTECH LLC tracks these numbers across its own product line — Dolfy.ai, Dialable.world, Maximus IPTV Player, Mimicall.app, and EmolyTicks — because a client evaluating us as a partner deserves evidence, not adjectives.

What Are the DORA Metrics, and Why Do They Matter?

The DORA metrics matter because they measure the two things every engineering leader actually cares about — how fast the team ships, and how safely it ships — without relying on self-reported velocity or story-point theater. Deployment frequency counts how often code reaches production. Lead time for changes measures the elapsed time from a commit landing to that commit running in production. Change failure rate is the percentage of deployments that cause an incident, rollback, or hotfix. Time to restore service measures how long it takes to recover when something does break.

What makes these four metrics powerful is that they resist gaming in pairs. A team can inflate deployment frequency by shipping trivial commits, but if change failure rate climbs at the same time, the story falls apart. A team can chase a low change failure rate by deploying rarely and cautiously, but then lead time and deployment frequency expose the tradeoff. Used together, the four numbers triangulate on something close to ground truth: is this team shipping value quickly, safely, and sustainably.

Inline blog image 1

How Do Elite, High, Medium, and Low Performers Actually Compare?

Elite performers deploy on demand — often multiple times per day — with lead times measured in minutes to under an hour, while low performers ship changes on a one-to-six-month cycle. That gap is not incremental; it's the difference between a team that treats a production release as routine and one that treats it as an event requiring a change-advisory board, a weekend, and a prayer.

The change failure rate split is just as stark. Elite and high performers typically keep their change failure rate in the 0-15% range — most deployments simply work, and when one doesn't, it's caught fast. Low performers routinely see failure rates in the 45-60% range, meaning roughly half of what they ship to production breaks something. Combine that with mean time to restore — under an hour for elite teams versus a week to a month for low performers — and you get a compounding effect: low performers ship less often, break more of what they ship, and take dramatically longer to recover. It's not one bad number; it's four numbers reinforcing the same underlying story about engineering discipline.

This is also where the classic microservices-vs-monolith and monorepo-vs-polyrepo debates actually resolve into something practical. Architecture choices don't matter in the abstract — they matter because they either shrink or inflate lead time and change failure rate. A tightly coupled monolith with no automated test suite will always produce worse DORA numbers than a well-tested service with a disciplined CI/CD pipeline, regardless of which pattern is fashionable this year.

Why Should a Business Decision-Maker Care About Engineering Metrics They Don't Personally Read Code For?

A business decision-maker should care because DORA performance correlates directly with organizational outcomes, not just engineering pride. Google's own State of DevOps research has consistently found that organizations with elite software delivery performance are roughly twice as likely to meet or exceed their own commercial and productivity goals compared to low performers. Slow, failure-prone delivery isn't just an engineering inconvenience — it's a tax on time-to-market, a drag on customer retention, and, according to ITIC's annual survey, a real line item: 98% of organizations report that a single hour of downtime costs their business more than $100,000, with a meaningful share reporting costs well into the millions for mission-critical systems.

For a CTO or founder evaluating whether to build in-house or bring in a partner, DORA metrics offer something rare: a way to ask a vendor a question that's hard to fake. "How often do you deploy to production, and what's your change failure rate?" is a very different question than "do you use Agile?" Anyone can claim Scrum ceremonies. Far fewer teams can honestly answer that they deploy multiple times a day with a single-digit failure rate, because that answer implies a whole stack of underlying practices: automated testing, feature flags for progressive rollout, infrastructure as code (using tools like Terraform to define and version cloud infrastructure rather than click through the AWS or Azure console by hand), and a CI/CD pipeline that actually gates bad code before it ships.

Inline blog image 2

How Does a Team Actually Improve These Numbers Without Gaming Them?

A team improves these numbers by investing in the underlying engineering practices that produce them as a byproduct, not by treating the metrics themselves as the target. You cannot mandate "deploy more often" and expect quality to hold; you have to remove the reasons deploys are scary in the first place. In practice, that means smaller pull requests reviewed and merged in hours rather than days, a CI/CD pipeline (the automated system that builds, tests, and deploys code on every commit) that runs a real test suite rather than a smoke test, and feature flags that let a team ship code to production dark and roll it out progressively instead of betting an entire release on a single big-bang deploy.

Observability is the other half of the equation. A team can't hit a fast MTTR without knowing something broke within minutes rather than discovering it through a customer support ticket. That means structured logging, distributed tracing, and alerting tied to real user-facing symptoms rather than raw CPU graphs — instrumented consistently whether the stack is a Node.js API on AWS, a Python service on GCP, or a containerized set of microservices on Kubernetes. At AEGONTECH, this is the same architectural due-diligence lens we apply whether we're building a new PostgreSQL-backed backend from scratch or modernizing a client's existing codebase: the goal isn't zero risk, because zero risk means zero deploys — it's making each individual change small and reversible enough that failure is cheap to detect and cheap to undo.

One clarifying comparison here is custom-built delivery pipelines versus off-the-shelf CI/CD SaaS tooling. Off-the-shelf tools (GitHub Actions, CircleCI, and similar) handle the mechanics of running tests and triggering deploys well out of the box, but the DORA numbers a team ends up with are determined far more by test coverage discipline, deployment size, and rollback strategy than by which vendor's YAML syntax they're writing. Buying the tool is the easy 20%; building the practice around it is the other 80%, and that's true whether the work is done in-house or handed to an outsourced partner like AEGONTECH LLC.

Frequently Asked Questions

Is deployment frequency the same as "how many features we ship"? No — deployment frequency measures how often code reaches production, which includes bug fixes, config changes, and small incremental improvements, not just headline features. A team can have high deployment frequency while working on one large feature, because they're shipping it in small, safe increments rather than one massive release.

Can a small startup realistically hit "elite" DORA numbers? Often more easily than a large enterprise, because a startup has less legacy coupling and fewer approval layers to route around — the same lack of process debt that makes production risk feel scarier is also what makes an automated, disciplined pipeline cheaper to bootstrap early.

Do these metrics apply to mobile apps, or just backend services? They apply to both, though lead time and deployment frequency look different for a mobile release gated by App Store or Google Play review versus a backend API deployed continuously — many mobile-first teams manage this by decoupling client releases from server-side logic changes wherever possible.

Should we ask an outsourcing vendor for their DORA numbers before signing a contract? Yes, and treat hesitation or vague answers as a signal — a vendor with real CI/CD discipline and a mature testing culture can usually produce rough deployment frequency and change failure rate figures for a comparable past engagement without much effort, because they're already tracking them internally.

Getting the Numbers to Actually Mean Something

You cannot improve what you refuse to measure, and deployment frequency is the most honest measurement of engineering health there is. A software vendor's sales deck tells you what they built; their DORA metrics tell you how they built it — and how they'll behave the day something breaks in production at 2 a.m. Slow deploys are not a symptom of caution — they are a symptom of unmanaged risk, dressed up as prudence.

None of this requires exotic tooling. It requires deciding, as an organization, that engineering performance deserves the same rigor as revenue or churn — a real number, tracked over time, discussed honestly in the same room as the roadmap. If you're weighing whether your current team's delivery pace is normal, or you're evaluating a development partner and want a technical due-diligence conversation grounded in numbers instead of buzzwords, that's a conversation AEGONTECH LLC has with clients regularly — reach out for a consultation and we'll walk through what your DORA profile might look like today, and what it would take to move it.

DORA Metrics: How to Actually Know If Your Engineering Team (or Outsourced Partner) Is Performing - Aegontech.dev