Anthropic LangChain Integration - Helicone OSS LLM Observability

Warning

This integration method is maintained but no longer actively developed. For the best experience and latest features, use our new AI Gateway with unified API access to 100+ models.

Create an account + Generate an API Key

Log into helicone or create an account. Once you have an account, you can generate an API key.

Set HELICONE_API_KEY as an environment variable

export HELICONE_API_KEY=<your API key>

Modify the API base and add the `Helicone-Auth` header

const llm = new ChatAnthropic({  modelName: "claude-2",  anthropicApiKey: "ANTHROPIC_API_KEY",  clientOptions: {    baseURL: "https://anthropic.helicone.ai",    defaultHeaders: {      "Helicone-Auth": `Bearer ${HELICONE_API_KEY}`,    },  },});

Using AnthropicMultiModal with Helicone#

Enhance your integration by using AnthropicMultiModal with Helicone to process images and generate text descriptions. Follow the code below to add this functionality to your application.

import osfrom llama_index.multi_modal_llms.anthropic import AnthropicMultiModalfrom llama_index.core.multi_modal_llms.generic_utils import load_image_urls# Initialize the AnthropicMultiModal class with your Anthropic API keyanthropic_mm_llm = AnthropicMultiModal(    max_tokens=300,    default_headers={        "Helicone-Auth": f"Bearer {os.environ['HELICONE_API_KEY']}",    },    api_key="<your Anthropic API key>",    api_base="https://anthropic.helicone.ai",)# Provide image URLsimage_urls = ["https://example.com/image1.png"]# Load image URLs into documentsimage_url_documents = load_image_urls(image_urls)# Generate a response based on the imagesresponse = anthropic_mm_llm.complete(    prompt="Describe the images as alternative text",    image_documents=image_url_documents,)print(response)