docs: clarify Coder Agents AI Gateway routing#25852
Conversation
Docs preview📖 View docs preview for |
|
|
||
| - **Intercepted**: requests are intercepted, audited, and augmented - full AI Gateway functionality | ||
| - **Passthrough**: requests are proxied directly to the upstream, no auditing or augmentation takes place | ||
| - **Intercepted**: requests are intercepted, audited, and augmented. Full AI Gateway functionality applies |
There was a problem hiding this comment.
Nit: can you revert these unrelated changes pls?
There was a problem hiding this comment.
Mux responding on behalf of Mike.
Done. Reverted docs/ai-coder/ai-gateway/reference.md to origin/main for this PR, removing the unrelated punctuation and route coverage changes.
| Provider base URLs point to upstream providers or upstream proxies. The public | ||
| `/api/v2/aibridge/...` routes are client-facing AI Gateway URLs, not upstream | ||
| provider base URLs. | ||
|
|
There was a problem hiding this comment.
| Provider base URLs point to upstream providers or upstream proxies. The public | |
| `/api/v2/aibridge/...` routes are client-facing AI Gateway URLs, not upstream | |
| provider base URLs. |
There was a problem hiding this comment.
Mux responding on behalf of Mike.
Done. Removed the added provider base URL paragraph from docs/ai-coder/ai-gateway/setup.md. The only remaining setup.md change is the Azure OpenAI OpenAI-compatible base URL example.
1bf0cc6 to
fb3b090
Compare
david-fraley
left a comment
There was a problem hiding this comment.
I really only care about the manifest.json comment. approving so this isn't blocking, but what's up there?
| @@ -47,7 +53,40 @@ status.</small> | |||
| <img src="../../images/guides/ai-agents/models-add-provider.png" alt="Screenshot of the add provider form"> | |||
|
|
|||
| <small>Adding a provider usually requires an API key. AWS Bedrock can also use | |||
There was a problem hiding this comment.
We should update screenshots at some point, but not going to worry about this for now
dannykopping
left a comment
There was a problem hiding this comment.
Non-blocking comments but otherwise LGTM
| models, internal gateways, or third-party proxies like LiteLLM. | ||
|
|
||
| Coder Agents route model requests through AI Gateway automatically by using | ||
| the provider configuration stored in Coder. Configure the provider endpoint/base |
There was a problem hiding this comment.
| the provider configuration stored in Coder. Configure the provider endpoint/base | |
| the provider configuration stored in Coder's database. Configure the provider endpoint/base |
There was a problem hiding this comment.
Mux responding on behalf of Mike.
Done. Updated this sentence to say the provider configuration is stored in Coder's database.
| For the default Agents path through AI Gateway, set the endpoint/base URL to | ||
| the upstream provider or proxy endpoint. Do not set it to Coder's public AI | ||
| Gateway route, such as `https://<coder-host>/api/v2/aibridge/openai/v1`. |
There was a problem hiding this comment.
This is duplication; let's only define this in one place ideally.
There was a problem hiding this comment.
Mux responding on behalf of Mike.
Done. Removed the duplicate endpoint guidance from the intro paragraph and left the detailed guidance in the endpoint/base URL section.
| provider and model settings from the Agents dashboard. They do not use the AI | ||
| Gateway external client base URL flow. |
There was a problem hiding this comment.
| provider and model settings from the Agents dashboard. They do not use the AI | |
| Gateway external client base URL flow. | |
| provider and model settings from the Agents dashboard. |
There was a problem hiding this comment.
Mux responding on behalf of Mike.
Handled by deleting docs/ai-coder/ai-gateway/clients/coder-agents.md entirely. With Coder Agents removed from the AI Gateway client flow, keeping an orphan pointer page was not adding value.
| ## Prerequisites | ||
| For setup, configure providers and models in | ||
| [Coder Agents models and providers](../../agents/models.md). Set each provider's | ||
| endpoint/base URL to the upstream provider or proxy, not |
There was a problem hiding this comment.
More duplication; thought this was removed?
There was a problem hiding this comment.
Mux responding on behalf of Mike.
Done. Deleted docs/ai-coder/ai-gateway/clients/coder-agents.md so the Agents models page is the only place that defines this behavior.
582434f to
51d103d
Compare
Clarifies that Coder Agents route through AI Gateway automatically, while admins configure Agents providers with upstream provider or proxy endpoint/base URLs.
Moves Agents-specific setup and credential guidance into the Agents models page, removes the obsolete AI Gateway Coder Agents client page, removes Coder Agents from the AI Gateway external client list, points provider setup to Admin settings > AI, and keeps provider-specific details such as AWS Bedrock in the AI Gateway provider docs.