Skip to main content

8 docs tagged with "area:llm"

Configure Budgets and Receipts

Budgets

Dynamic AI Model Routing — How It Works

Overview

Enable Dynamic Model Routing

Steps

LLM Routing Configuration Reference

Environment

LLM Routing PDP Reference

Policy examples

LLM Routing Quickstart

Prerequisites

Observe and Troubleshoot LLM Routing

Observability

Override Model Pricing

Use LLMPRICINGJSON or LLMPRICINGPATH to override pricing used for estimates during routing.