Connect LangChain to Gonka Broker
LangChain is a framework for building applications on top of language models. Its OpenAI chat-model integration accepts a custom base URL, so you can point it at Gonka Broker and build on open-source models — the only change from a standard OpenAI setup is the base URL, the key, and the model id.
The integration is the same in Python and JavaScript/TypeScript; only the package name and the constructor differ. Pick your language below.
Prerequisites
Section titled “Prerequisites”- A Gonka API key (starts with
gnk-prx-). See Create a Gonka API Key. - Python 3.9+ or Node.js 18+, depending on your stack.
Install and configure
Section titled “Install and configure”Install the OpenAI integration package:
pip install langchain-openaiPoint ChatOpenAI at Gonka Broker:
from langchain_openai import ChatOpenAI
llm = ChatOpenAI( model="moonshotai/Kimi-K2.6", base_url="https://proxy.gonkabroker.com/v1", api_key="gnk-prx-your-api-key",)
response = llm.invoke("Say hello from Gonka Broker.")print(response.content)Install the OpenAI integration package:
npm install @langchain/openaiPoint ChatOpenAI at Gonka Broker:
import { ChatOpenAI } from "@langchain/openai";
const llm = new ChatOpenAI({ model: "moonshotai/Kimi-K2.6", apiKey: "gnk-prx-your-api-key", configuration: { baseURL: "https://proxy.gonkabroker.com/v1", },});
const response = await llm.invoke("Say hello from Gonka Broker.");console.log(response.content);The model must match a Gonka-supported id exactly — for example moonshotai/Kimi-K2.6 or MiniMaxAI/MiniMax-M2.7 (see Supported Models). Once the model is configured, use it anywhere a LangChain chat model goes — chains, agents, and LCEL pipelines all work unchanged.
Verify
Section titled “Verify”Run the snippet above. A printed reply confirms LangChain is reaching Gonka Broker through your key.
Troubleshooting
Section titled “Troubleshooting”- 401 / invalid API key — wrong or paused key. Create a fresh one from Create a Gonka API Key.
- Model not found / unsupported — the
modelmust match a model Gonka Broker serves exactly (see Supported Models). - Connection errors — confirm the base URL is exactly
https://proxy.gonkabroker.com/v1. - Visible
<think>reasoning in the output — reasoning models such asMiniMaxAI/MiniMax-M2.7emit their thinking inline, which LangChain returns verbatim incontent(wrapped in<think>…</think>). The example usesmoonshotai/Kimi-K2.6, which returns clean text; strip the<think>block yourself if you prefer a reasoning model.