Relic Solution: How to Integrate with Mona to monitor your ML models in New Relic

How to Integrate New Relic with Mona

What you’ll get

Follow the instructions to get instant observability of the state of your AI/ML models as monitored by Mona and obtain a centralized operational view in New Relic. You’ll get:

  • A guided integration set up for Mona to automatically share processed contextual data with New Relic.

  • Configure Mona insights dashboards containing active insights.

  • Set up New Relic’s Incident Intelligence for an overview of all your incidents, their sources, and related events.

What you’ll need

Before you begin, ensure you have a New relic account, or sign up for a free account here (no credit card needed).

You will also need to have a Mona account. ​​If you don’t have a Mona account yet, start your free 30-day trial here.

Set up the integration key and integrate data from Mona to New Relic

Login into your New Relic account: Log into one.newrelic.com and click on Explorer. On the upper hand corner, on the main navigation menu, click on +Add more data.

Click on Mona: In the search bar, type Mona or scroll down to the MLOps Integration section and click on the Mona icon.

Configure Mona with the following keys:

Account ID: Select the account ID you want Mona to integrate with.

Ingest license key: This key is needed for Mona to send processed contextual data with New Relic to later allow exploration using NRQL.

Set keys via your dashboard

In the configurations page, under the integration tab, choose “New Relic” and set your “account number” and “Ingest license key”.

This can also be achieved by adding the following to the configuration JSON file:

{
  "user_id": {
    "context_class": {
      "fields": {...},
      "stanzas": {...},
      "integrations": {
        "new_relic": {
          "account_number": 111,
          "x_insert_key": "yyy"
        }
      }
    }
  }
}

NOTE - New Relic does not currently support sending historical data, and can only process new data coming into the platform. The integration will only show data and insights from the point of integration.

Set notifications to send insights and create dashboards in New Relic

Go to the Integration Dashboard: Once you’ve set up your integration, return to the New Relic integration page and click on “See your data”.To send insights to New Relic dashboards, configure Mona with the following key:

User API Key: In the New Relic Integration page, select or create a User API Key under Active Insights. Copy this key.

Set keys to create dashboards

Once the integration key is set up, a new notification option will be opened. In the notification tab, add a new notification and under “New Relic dashboards” add your “User API key”.

This can also be achieved by adding the following to the configuration JSON file:

{
  "user_id": {
    "context_class": {
      "fields": {...},
      "stanzas": {...},
      "integrations": {...},
      "notifications": {
        "dashboard_notification": {
          "nr_dashboards": ["user_api_key"]
        }
      }
    }
  }
}

Set notifications to send insights to New Relic’s Incident Intelligence

Go to the Integration Dashboard: Once you’ve set up your integration, return to the New Relic integration page and click on “See your data”.

In order to send insights to New Relic dashboards, configure Mona with the following key:

security_token_for_rest: In the New Relic Integration page, copy the auth token under Intelligent Incident Correlation.

Set keys via your dashboard for Incident Intelligence

Once the integration key is set up, a new notification option will be opened. In the notification tab, add a new notification and under “New Relic incident intelligence” add your “Security Token for REST”.

Note: This can also be achieved by adding the following to the configuration JSON file:

{
  "user_id": {
    "context_class": {
      "fields": {...},
      "stanzas": {...},
      "integrations": {...},
      "notifications": {
        "incident_intelligence_notification": {
          "nr_incident_intelligence": ["security_token_for_rest"]
        }
      }
    }
  }
}

Filter notifications

If you want to filter out less relevant insights from being sent to New Relic, you can do so by adding notification rules in the notification section, as detailed here.

Congratulations, you’ve now successfully integrated New Relic with Mona and should be able to see new data and insights. from your ML Models.

Get the dashboard, install this quickstart from New Relic I/O.

Happy Monitoring!

Support

For more information about this integration, follow the New Relic Docs. For support with setting up your Mona account, please reach out to support@monalabs.io

About Mona

Mona is a monitoring platform for AI systems, providing you with unparalleled visibility into how your data and models behave in production, using highly configurable anomaly detection mechanisms and analytical tools to make sure you can find drifts, biases, data integrity issues and more.