Dynatrace enhances AI observability for better insights

Dynatrace has announced it has enhanced its AI observability capabilities, which aim to support the generative AI initiatives of its customers.

The company now provides extended capabilities that allow teams to access comprehensive insights into their AI applications to drive improved reliability, performance, security, and compliance.

These advancements are intended to give organisations clarity into their AI investments, thereby assisting them in understanding their return on investment.

IDC has forecasted that worldwide spending on AI-supporting technologies will surpass USD $749 billion by 2028. This highlights the necessity for enterprises to not only invest in these technologies but also to observe them closely to ensure they deliver optimal business value and security.

Dynatrace's new platform advancements include enhanced analytics for large language models (LLM), which in addition to monitoring standard key performance indicators, utilise predictive capabilities to forecast cost changes associated with LLM usage. This helps teams optimise model performance and manage costs more effectively.

Furthermore, Dynatrace introduces input and output guardrails for AI applications to build trust and prevent issues such as model hallucinations, malicious prompt injections, and the leakage of personally identifiable information. It also offers multi-model tracing, mapping dependencies between LLMs to ensure seamless interactions within complex systems.

The platform supports responsible AI integrations by tracking every piece of data without sampling, providing an audit trail for full observability. Real-time queries and data storage are facilitated via Dynatrace Grail for comprehensive archival and review.

Chris Kronenthal, President at FreedomPay, an enterprise leveraging Dynatrace, highlighted their value, stating, "An increasing number of enterprise and mid-market merchants are leveraging artificial intelligence to empower their end-to-end payment strategy. At FreedomPay, our challenge is to support merchants who look to seamlessly connect back-end systems with customer-facing channels."

"Dynatrace enables FreedomPay to adopt advanced analytics and intelligence to solve complex data problems for our customers. This is required to deliver a world-class solution to improve compliance, security and overall costs."

Stephen Elliot, Group Vice President at IDC, explained the importance of observability in AI developments. "AI represents a transformational change in technology and business. Data and LLM observability are essential requirements for building and deploying reliable, trustworthy, and cost-effective AI solutions. These capabilities provide the critical insights needed to ensure that models perform as expected, meet business objectives, and deliver outcomes to the organisation," he said. He also noted the benefits for technology leaders in monitoring data quality in real-time to manage and prevent issues like drifts and performance degradation.

Alois Reitbauer, Chief Technology Strategist at Dynatrace, commented on the growing dependency on AI applications, "We see a large portion of our global customer base moving their AI applications into production. AI Observability is key for ROI, governance, and explainability. Dynatrace delivers AI-powered observability with real-time insights which enables data and systems to work together effortlessly."

Dynatrace continues to support its customers with its Observability for AI solutions as part of its ongoing commitment to enabling efficient and secure AI deployments across industries.