Reference

Implementation Details

coderd runs an in-memory instance of aibridged, whose logic is mostly contained in https://github.com/coder/aibridge. In future releases we will support running external instances for higher throughput and complete memory isolation from coderd.

Supported APIs

API support is broken down into two categories:

• Intercepted: requests are intercepted, audited, and augmented - full AI Gateway functionality
• Passthrough: requests are proxied directly to the upstream, no auditing or augmentation takes place

Where relevant, both streaming and non-streaming requests are supported.

OpenAI

Intercepted

• /v1/chat/completions
• /v1/responses

Passthrough

• /v1/models(/*)

Anthropic

Intercepted

• /v1/messages

Passthrough

• /v1/models(/*)

Troubleshooting

To report a bug, file a feature request, or view a list of known issues, please visit our GitHub repository for AI Gateway. If you encounter issues with AI Gateway, please reach out to us via Discord.