Middleware
AI DIAL system acts as a middleware between language models, business applications and end-users, that brings value to your products and customers, improves time-to-market and lets you focus on the core business instead of reinventing the wheel.
Observability
AI DIAL uses OpenTelemetry, an open-source observability framework, that provides a vendor-agnostic, unified approach to collecting, processing, and exporting telemetry data in cloud-native environments.Learn moreAnalytics
AI DIAL can be configured to analyze the conversation data and extract the needed artifacts, which can be used in tools such as Grafana for visualization and analysis.Learn moreGuardrails
AI DIAL provides pluggable components called Interceptors to enable a Responsible AI approach and compliance with regulations. Interceptors help to prevent harmful content from reaching users or models.Learn moreAccess Control
The system integrates with a variety Identity Providers (IDPs) to allow creating a custom permissions model with attribute-based access control to regulate access to system and user resources.
Learn moreCost Control
A flexible configuration of rate limits enables you to have control over the total number of tokens that can be sent to a model. Rate limits can be set for both users and API keys.
Learn moreEvaluation
AI DIAL features RAG Eval Toolkit, with libraries and UI for retrieving, visualizing, and evaluating RAG-like apps. You can also leverage user sentiments to analyze a broader spectrum of applications.
Learn moreLoad Balancing
AI DIAL load balancer is designed to effectively distribute traffic and workload among your organization's provisioned throughput units (PTU), enabling optimal resource allocation and predictable performance.Learn moreUnified API
AI DIAL provides a single Unified API, based on Azure OpenAI API, for accessing all language models, embedding models and applications. It enables all models and apps to be interchangeable, delivering a cohesive conversational experience.Learn morePersistence
AI DIAL uses resilient and scalable cloud BLOB storages for centralized and secure storage of all users data, eliminating the need for traditional databases.Learn more