Azure OpenAI with Python - Helicone OSS LLM Observability

Warning

This integration method is maintained but no longer actively developed. For the best experience and latest features, use our new AI Gateway with unified API access to 100+ models.

How to Integrate#

Create an account and generate an API key

Log into Helicone or create an account. Once you have an account, you can generate an API key here.

Set up your Helicone API key in your .env file

HELICONE_API_KEY=<YOUR_HELICONE_API_KEY>AZURE_OPENAI_API_KEY=<YOUR_AZURE_OPENAI_API_KEY>

Modify the base URL path

Note

Make sure to include the api-version in all of your requests.

from openai import AzureOpenAIfrom dotenv import load_dotenvimport osload_dotenv()helicone_api_key = os.getenv("HELICONE_API_KEY")azure_openai_api_key = os.getenv("AZURE_OPENAI_API_KEY")client = AzureOpenAI(    api_version="[API_VERSION]" # "2024-12-01-preview",    azure_endpoint="https://[AZURE_DOMAIN].openai.azure.com/",    api_key=azure_openai_api_key,    default_headers={        "Helicone-Auth": f"Bearer {helicone_api_key}",        "Helicone-OpenAI-Api-Base": "https://[AZURE_DOMAIN].openai.azure.com",        "Helicone-Model-Override": "[MODEL_NAME]",        "api-key": azure_openai_api_key    })

Info

Recomendation: Model Override

When using Azure, the model displays differently than expected at times. We have implemented logic to parse out the model, but if you want to guarantee your model is consistent, we highly recommend using model override:

Helicone-Model-Override: [MODEL_NAME]

Click here to learn more about model override

Start using Azure OpenAI with Helicone

response = azure_openai.chat.completions.create(  model="[MODEL_NAME]",  messages=[{"role": "User", "content": "What is the meaning of life?"}])print(response)

Verify your requests in Helicone

With the above setup, any calls to Azure OpenAI will automatically be logged and monitored by Helicone. Review them in your Helicone dashboard.

To learn more about the differences between OpenAI and AzureOpenAI, review the documentation here.

Related Guides#

Environment Tracking

Effortlessly track and manage your environments with Helicone across different deployment contexts.

Getting User Requests

Retrieve user-specific requests to monitor, debug, and track costs for individual users.