New Relic has launched a monitoring product aimed at businesses that run applications inside ChatGPT, with a focus on visibility into how embedded interfaces render and how users interact with them.
The company said the product targets a gap that developers face when their software runs inside constrained embedded environments. These apps often appear inside an i-frame within a ChatGPT conversation, which can limit what standard browser monitoring tools can observe.
New Relic said its approach combines browser telemetry such as errors, network activity, and timing data with visual session replay. The company said this mix gives teams a way to inspect what happened within the ChatGPT experience when a user reports a problem or when a transaction fails.
In the company's description, engineering teams can use the product to see how AI-generated and dynamic content renders for users. It also highlights user interface issues such as broken or misaligned buttons and layout shifts. The company said it can show points where users experience friction or abandon flows.
Brian Emerson, Chief Product Officer, New Relic, said the product addresses what he described as an observability blind spot for embedded applications.
"Bringing business services into the natural flow of a ChatGPT conversation is a powerful, intuitive, and revenue-generating strategy," said Brian Emerson, Chief Product Officer, New Relic.
"But once your carefully crafted application instantiates inside ChatGPT, it traditionally enters a black box where standard browser monitoring tools can fail. At New Relic, we've worked quickly to stay steps ahead of customers who want to maximize this opportunity, ensuring that businesses monetizing gen AI aren't flying blind when it comes to user experience and system health."
I-frame limits
New Relic tied the launch to the growth of consumer usage of ChatGPT and the emergence of applications that sit inside the conversational interface. The company described these apps as a route for businesses to surface goods and services directly in that environment.
The company also set out technical reasons why monitoring can prove difficult. It said standard tools struggle with restricted execution contexts and browser security constraints.
It highlighted content security policies, i-frame sandbox rules, and limitations on client-side storage as factors that can obscure performance and user experience data.
New Relic also pointed to issues specific to AI-rendered results. It cited "hallucinated" user interface elements that look correct but do not work as expected. It also referenced AI-generated text that breaks CSS layouts, and "ghost citations" where an AI references data that the application backend did not provide.
Telemetry and replay
New Relic said its browser agent collects data from within the GPT i-frame.
It said the agent measures latency and connectivity inside the embedded environment. It also said it can detect when a dynamic AI response triggers script or syntax failures in the user's browser, and capture console log items.
The company said the product also tracks user interaction with embedded content. It described tracking actions such as clicking a call-to-action and cases where users do not engage at all. It said customers can set benchmarks and use event-driven analytics.
New Relic gave an example of a custom event for when a large language model populates a chart according to specification. It said teams can then build dashboards that compare an "AI Render Success" measure against "User Bounce Rate".
Product features
New Relic listed "User Frustration Detection" as one feature, including rage clicks, error clicks, and dead clicks. It said these signals can indicate friction in the user experience.
It also listed "Layout Instability Monitoring" to track Cumulative Layout Shift within the i-frame as AI streams content. It said excessive CLS can create a frustrating experience for users.
The company also described "Cross-Origin Insights" for cases where the application does not control the top-level browser window. It said this provides information about how the application performs in different host environments.
Another feature it highlighted was "End-to-End Traceability". New Relic said this links a user interaction in the ChatGPT i-frame through to backend services, with a view of each transaction.
Availability
New Relic said the ChatGPT app monitoring product is available as part of the New Relic Intelligent Observability Platform. It said existing customers can install the latest New Relic browser agent and define "value" actions that reflect critical user journeys.
The company said new customers can sign up for a free account.