Skip to main content

Measuring your DevOps performance

Leverage the DORA metrics to track your DevOps performance in Pipelines

Brandon Chin Loy avatar
Written by Brandon Chin Loy
Updated this week

Note: While this article refers to several DORA metrics, deployment frequency is the first to be available in the dashboard. Lead time for changes is currently in development and will be added soon. As we iteratively roll out more metrics and enhancements, we'll update this article to reflect the latest changes.

Understanding your DevOps performance is crucial for continuous improvement. This dashboard brings key DORA (DevOps Research and Assessment) metrics directly into Gearset, offering insights into your team's performance.

The DORA metrics

DORA is a group of metrics originally pioneered by the team at Google, and has become the universal standard by which we measure DevOps performance:

  • Deployment frequency β€” how often an organization successfully releases to production.

  • Lead time for changes β€” the amount of time it takes a pull request to get into production.

  • Time to restore β€” the time it takes to recover from a failure in production.

  • Change failure rate β€” the percentage of deployments causing a failure in production.

The first two metrics measure the speed of your release pipeline, while the other two focus on its stability. They're a crucial way for team leads and managers to understand their DevOps process. You can read more information on our blog.

Getting started

  • You'll need either a Teams Automation Platform licence or an Enterprise Automation Platform license to use this feature.

  • The dashboard can only be accessed by team owners.

  • These metrics rely on the usage of the Gearset pipelines feature with the promotion branch strategy.

  • For more in-depth information about the underlying data that powers this dashboard, please refer to the Gearset Reporting API documentation.

To access the dashboard:

1) Navigate to your account settings by clicking the Gearset icon in the top right and clicking My account as seen below:

2) Under reporting, navigate to the DevOps performance page.

Navigating the dashboard

Filters

There are three options to customise your view of the data:

  • Pipeline: Select the pipeline you wish to report on. This is particularly useful for teams with multiple pipelines for different projects or teams, allowing you to focus on the relevant data.

  • Date Range: Choose the time period you want the data to cover. This filter impacts all metrics displayed on the dashboard.

  • Step: This filter specifically controls the granularity of the data presented in the graphs (the horizontal axis). You can choose to visualize the data split by daily, weekly or monthly intervals.

When you first open the dashboard, it automatically loads with some default selections to give you an immediate view of your performance. The first pipeline in your list will be chosen (or your only pipeline, if you just have one). You'll see data from the last 7 days, up to and including today, with the graph split into daily intervals. You are free to adjust these filters thereafter.

Deployment frequency

Deployment frequency metrics provide a clear overview of how often your team is successfully releasing changes to production.

Overview

This section gives you a quick snapshot of your team's performance within the selected date range:

Here you'll find:

  • Total deployments: The total number of successful deployments that occurred within your selected date range (including the start and end dates).

  • Average deployments per day: Calculated as the total number of successful deployments divided by the number of days in your chosen date range.

  • Deployment success rate: This is the percentage of successful deployments out of the total number of deployments.

It's important to note that these metrics are based on production deployments. Also, a deployment is counted as "successful" only if all intended metadata (and data, if applicable) was deployed.

A deployment is considered 'partially successful' when metadata deploys to the target, but the configuration data (like CPQ) or Vlocity fails to deploy. For the purpose of this dashboard, all partially successful deployments are counted as failures.

For each metric in this section, you'll see a percentage change:

This comparison shows how your current values (for the selected date range) compare against the immediately preceding period of the same length:

  • If you select a two-week date range, the dashboard will show your values for that period and compare them to the previous two-week period.

  • Similarly, if you select a 10-day period, the comparison will be against the preceding 10-day period.

Graph

You will see a graph illustrating your deployment frequency trend over time:

This graph displays the number of successful deployments (on the vertical axis) against the chosen time period (on the horizontal axis). The Step filter at the top controls how the time is broken down on this horizontal axis.

Feedback

We are actively collecting feedback around the metrics you wish to see. If you have any thoughts or suggestions, please get in touch with us via Intercom.

Did this answer your question?