OpsLevel Logo
Product
Developer portal
Software catalog
Understand your entire architecture at a glance
Standards
Your guide to safe, reliable software
Developer self-service
Empower developers to move faster, risk-free
Integrations
Connect your most powerful third-party tools
Use Cases
Ownership
Build accountability and clarity into your catalog
Standardization
Set and rollout best practices for your software
Developer Experience
Free up your team to focus on high-impact work
Customers
Resources
All Resources
Our full library of resources
Pricing
Flexible and designed for your unique needs
Podcast
Podcast
Conversations with technical leaders
Blog
Blog
DevOps resources, tips, and best practices
Demo
Demo
Videos of our product and features
Tech talk
Tech talk
Our POV on technical topics
Guide
Guide
Practical resources to roll out new programs and features
DocsLog In
Talk to usTry for free
No items found.
Share this
Table of contents
 
Resources
Blog

How Scorecards work in OpsLevel: a truly flexible model

Product
Standardization
Engineering leadership
Checks
How Scorecards work in OpsLevel: a truly flexible model
Haley Hnatiw
|
August 24, 2023
How Scorecards work in OpsLevel: a truly flexible model

We’ve always been opinionated about Service Maturity—but one of our strongest held beliefs is that there’s no one-size-fits-all approach. Some organizations want to set global service standards to monitor software health org-wide. Others want total team autonomy to establish a unique culture and related service expectations. And most fall somewhere in between. That’s exactly why we’ve been thoughtful in how we build out our Service Maturity feature suite to include Scorecards and the Rubric. 

We want to support organizations across the entire spectrum by providing flexibility where you want it, and consistency where you need it. 

In OpsLevel, you can start building a Service Maturity program on day 0, and trust that our product offering will empower it to scale however you need long-term. Here’s why.

Flexibility at the foundation

Scorecards are important, but they are one part of the larger Service Maturity picture in OpsLevel. We offer a global Rubric that makes tracking global standards easy and individual Scorecards that allow you to track standards scoped by team, group, category, or focus area.

Both features are built on Checks (the specific tests you’re running against your service at any given moment) and Filters (the conditions set to determine which services a Check is applied to). 

This sample Scorecard shows a series of checks that apply to all Ruby services owned by the Payments Team.

While most IDPs offer a scorecard feature to set and measure progress at the team or group level, this combination guarantees that we can meet any engineering organization where they’re at. This gives them the freedom to get started as a team, while still giving cross-functional guilds (like DevOps or Platform) an easy way to rollout org-wide best practices if and when they’re ready. 

Consistency built on a shared taxonomy

We believe that to support the continuous growth of your organization’s Service Maturity program, all Scorecards must be built using a consistent structure. Service Maturity levels need to be standardized across Scorecards in order to provide any meaningful context into where a service stands. After all, having one Scorecard set up as bronze/silver/gold and another as A/B/C really starts to muddy the water.

In OpsLevel, the taxonomy for service maturity levels is set at the account level, to ensure each new Scorecard is measuring against the same general definition of “good”, “better”, and “best”—even if all of the standards themselves are different.

A preview of the Settings panel where Service Maturity levels are set as Beginner, Bronze, Silver, and Gold with related definitions.

Giving engineering teams a shared language and taxonomy ensures that: 

  • Service owners can easily toggle between Scorecards, without losing context into what each level indicates and what it means for their services
  • Leaders and cross-functional stakeholders can easily compare service health across any layer of the organization

When to use Scorecards

We’ve talked at length about why Scorecards exist in conjunction with the Rubric. But when, specifically, do they come in handy? While the Rubric is great for global standards across your org, here are some examples where Scorecards are useful:

  • A new team or group wants to set standards for themselves, without impacting the global Rubric
  • A new guild or practice area wants to establish a set of checks that’s relevant for multiple teams but isn’t globally applicable yet
  • Different divisions have different sets of standards and want to scope their checks differently as a result
  • A team wants to A/B test check structure across different teams, before adding something new to the Rubric
  • An individual product development team wants to track OKRs or other KPIs within OpsLevel

Ready to take your team’s Service Maturity to the next level… literally? Read our guide on when and why to use Scorecards, or go straight to our technical documentation. 

Not an OpsLevel customer just yet? Try things out with a free trial account. 

More resources

Blog
September 19, 2023
by
Fernando Villalba
The OpsLevel Developer Experience (DevEx) series. Part 1: What is DevEx?

Great developer experience (DevEx) is what you get when developers can easily achieve and maintain flow state at work. This article begins a series where we tackle all of the areas that affect flow state and impair your developer experience at your company and provide example metrics and suggestion to help you operate like a potential future unicorn.

Blog
August 31, 2023
by
OpsLevel
August 2023 release notes

This month included an update to our Service Maturity features—to give you even more flexibility—plus more sorting and syncing improvements. Read on to learn more!

Blog
May 31, 2023
by
Haley Hnatiw
May 2023 release notes

See what we’ve shipped in the month of May.

OpsLevel Logo
Subscribe
Join our newsletter to stay up to date on features and releases.
By subscribing you agree to with our Privacy Policy and provide consent to receive updates from our company.
SOC 2AICPA SOC
Product
Software CatalogMaturityIntegrationsSelf-serviceRequest a demo
Company
About usCareersContact UsCustomersPartnersSecurity
Resources
Docs
Blog
Demo
© 1999 J/K Labs Inc. All rights reserved.
Cookie Preferences
Terms of Use
Privacy Policy
Responsible Disclosure
By using this website, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Data Processing Agreement for more information.
Okay!