OpenAI with LangChain - Helicone OSS LLM Observability

Warning

This integration method is maintained but no longer actively developed. For the best experience and latest features, use our new AI Gateway with unified API access to 100+ models.

How to Integrate#

Create an account and generate an API key

Log into Helicone or create an account. Once you have an account, you can generate an API key here.

Set up your Helicone API key in your .env file

HELICONE_API_KEY=<your-helicone-api-key>OPENAI_API_KEY=<your-openai-api-key>

Modify the base URL path

import { OpenAI } from "@langchain/openai";const llm = new OpenAI({  apiKey: process.env.OPENAI_API_KEY,  baseURL: "https://oai.helicone.ai/v1",  defaultHeaders: {    "Helicone-Auth": `Bearer ${process.env.HELICONE_API_KEY}`  }});

Use the LangChain SDK

const response = await llm.invoke("What is the meaning of life?");console.log(response);

Verify your requests in Helicone

With the above setup, any calls to OpenAI will automatically be logged and monitored by Helicone. Review them in your Helicone dashboard.

This step-by-step guide covers function calling, response formatting and monitoring with Helicone.

Trace, replay, and debug LLM sessions

Learn how to replay and modify LLM sessions using Helicone to optimize your AI agents and improve their performance.

How to Integrate#

Related Guides#