Now GA: Repo Grep Check. Find and fix issues in your codebase faster, with our open-ended repo search capability. Read all about it!

Add a Prometheus Integration

  1. In the OpsLevel app, mouse over Integrations in the left sidebar
  2. Click Add New Integration in the pop up menu
  3. Search for Prometheus
  4. Click Add Integration on the Prometheus card
  5. Follow the instructions in the new Integration page to configure Prometheus Alert Manager to send alerts to OpsLevel

Configuring Prometheus and Alert Manager to send data to OpsLevel

1. Configure the alert rules for your SLO Alert with labels to identify the service alias and the event type


labels:
  alias: "{{ $labels.instance }}" # Use an appropriate template
  event_type: metric_slo_alert

2. Add OpsLevel as a webhook receiver and set it as a route in your alertmanager.yml


route:
  group_by: ['alertname']
  group_wait: 30s
  group_interval: 1m
  repeat_interval: 1m
  receiver: 'web.hook'
receivers:
  - name: 'web.hook'
    webhook_configs:
      - url: "${WEBHOOK_URL}"

Reload your Prometheus and Prometheus Alert Manager configurations.

Create a Check

1. Navigate to the Rubrics sub menu under the Service Maturity menu in OpsLevel.

2. Hover over the cell that corresponds to the level and category you want your check to live in and click the + Add Check button.

3. Create a Prometheus check under Integrations

4. The Check for SLO error budget alert will be pre-selected

This check will pass or fail if an alert for a service is triggered from Prometheus Alert Manager