Add Azure AI Gateway as an AI provider
Add the provider, point it at your API Management endpoint, then register the models your gateway serves. Every field after the API key sits on the Form tab.1
Add the provider
Go to Settings > AI providers, then click Organization provider or Project provider, depending on the scope you want.Select Azure AI Gateway.
2
Enter your API key
Paste the API key for your Azure AI Gateway.
API keys are stored as one-way cryptographic hashes, never in plaintext.
3
Set the API base URL
Set API base URL to your Azure API Management endpoint, including a path.For example:
https://<gateway-name>.azure-api.net/default/modelsThe Raw tab edits these same settings as YAML, if you’d rather paste a configuration than fill in fields.4
Add request headers
Under Request configuration, click Additional header for any header your API Management endpoint requires. Braintrust forwards these with every request to your gateway.Skip this step if your endpoint needs only the API key.
5
Register your models
Under Models, click Custom model for each model your gateway serves. Enter the model name your gateway exposes, then click and, under Model options, set the Format to match the API that model uses, as described in Model formats.Braintrust ships no registry models for Azure AI Gateway. Only the custom models you register are available, even when Registry models is set to All models.
6
Set the endpoint options
Under Request behavior, configure how Braintrust calls your gateway:
- Enable failover by default: Off by default. When on, a failed request retries on another configured provider that serves the same model.
- This endpoint supports streaming: On by default. Turn it off if your endpoint can’t stream, and Braintrust requests a complete response, then streams it back to your client.
7
Save the provider
Click Create, or Update when editing an existing provider.
Model formats
Braintrust appends a format-specific path to your API base URL, so each model’s Format determines which endpoint on your gateway receives the request.
Models that require the OpenAI Responses API go to
openai/v1/responses instead, whichever Format you set. That covers o1-pro, o3-pro, gpt-5-pro, gpt-5.3 and later, and any gpt-5 model with -codex in its name.
The Gemini format can’t be used with a custom API base URL, so it isn’t available for Azure AI Gateway.
Configure your API Management endpoint to route these paths to the corresponding backend.