Docs
Tool integrations
Being OpenAI-compatible, most tools connect by swapping base_url alone. Here are the combinations we have verified.
Official SDKs
openai-python and openai-node need only base_url and api_key changed. The Anthropic SDK uses the Messages path.
| Tool | Change | Path |
|---|---|---|
| openai-python | base_url, api_key | /chat/completions |
| openai-node | baseURL, apiKey | /chat/completions |
| anthropic-sdk | baseURL, apiKey | /messages |
| LangChain | openai_api_base | /chat/completions |
| LlamaIndex | api_base | /chat/completions |
Developer tools
IDE extensions and CLI tools generally support a custom endpoint. Put your routing path where the model name goes.
Frameworks
LangChain and LlamaIndex use their OpenAI-compatible adapters as-is. Streaming and tool calls work too.
Caution
If a tool hardcodes its own model list, a routing path may be rejected for not being on it. Pass a model ID directly in that case.