New Relic Expands AI Observability with Transaction-Level Evaluation…

Event summary

New Relic introduced AI Evaluation, a framework for advanced AI evaluation within its AI Observability platform.
The new capability provides transaction-level business impact insights across the full developer-to-production lifecycle.
AI Evaluation automates real-time insights into AI guardrail performance, replacing manual reviews with an asynchronous 'LLM-as-a-judge' service.
The feature will be available in public preview in November 2026.
New Relic aims to address the shift from deterministic code to probabilistic systems in the AI era.

The big picture

As generative AI becomes deeply embedded in enterprise workflows, traditional application signals are insufficient for monitoring AI-driven systems. New Relic's AI Evaluation framework addresses this gap by providing end-to-end visibility and real-time AI evaluations, which are critical for controlling costs, mitigating security risks, and safely scaling enterprise AI. This move positions New Relic as a key player in the AI observability space, catering to the needs of SREs, developers, and engineers who require holistic insights into AI performance across the entire application lifecycle.

What we're watching

Adoption Pace: The pace at which enterprises will integrate AI Evaluation into their existing workflows and the impact on operational efficiency.
Competitive Response: How competitors in the observability space will react to New Relic's expanded AI capabilities and whether they will introduce similar features.
Market Differentiation: Whether New Relic can sustain its market differentiation with this new offering in an increasingly crowded AI observability market.