Helicone Community Page

Updated 11 months ago

The organization within your azure

Is this updated? I don't know what's the organization within my azure.
Attachment
image.png
A
J
25 comments
I've changed the code to resemble more like the normal OpenAI, and now it's going through without errors but not appearing on the helicone dashboard.
Can you share a code snippet?
Plain Text
new ChatOpenAI({
              temperature: 0.2,
              ...config.azureOpenAI,
              ...options,
              configuration: {
                  baseURL: "https://oai.hconeai.com/v1",
                  defaultHeaders: {
                      "Helicone-Auth": `Bearer ${config.helicone.key}`,
                      ...(llmArgs.userId
                          ? {
                                "Helicone-User-ID": llmArgs.userId
                            }
                          : {}),
                      "Helicone-Property-Environment": process.env.NODE_ENV || "development",
                      ...headers
                  }
              }
          })
and the config is
Attachment
image.png
basically I just added the defaultHeaders, and the baseURL like I did for the OpenAI which works.
since what you have on the screenshot is outdated
i need to be using azure because we got a big grant there, and I'd rather not spend more cash so we're pushing this to prod right now even though is not being tracked by helicone
Sounds good, I am going to try to reproduce this with our Azure account + LangChain
Hi! I was able to get it to work with the original configuration


Can you try?

Plain Text
  new ChatOpenAI({
    temperature: 0.2,
    ...config.azureOpenAI,
    ...options,
    azureOpenAIBasePath: "https://oai.hconeai.com",
    configuration: {
        defaultHeaders: {
            "Helicone-OpenAI-Api-Base": "https://[YOUR INSTANCE].openai.azure.com",
            "Helicone-Auth": `Bearer ${config.helicone.key}`,
            ...(llmArgs.userId
                ? {
                      "Helicone-User-ID": llmArgs.userId
                  }
                : {}),
            "Helicone-Property-Environment": process.env.NODE_ENV || "development",
            ...headers
        }
    }
})


You might need to remove azureOpenAIApiInstanceName from your azureOpenAI object
well on my end nothing shows up on helicone
actually now im getting this:
Attachment
image.png
it's saying gpt-3.5-turbo but its not?
not sure what to do
ok got it my deployment name needs to be openai/deployments/azure-gpt4-1106-preview instead
i think there needs to be extra warning, since azure works fine without openai/deploymentsprefix but helicone doesnt?
maybe its langchain stuff details here
however, costs for these are marked as zero... which is not very convenient if we want to analyze the costs
Can I have permission to look at your Organization and add myself to test the cost calculation issues?
awesome! Thanks, we will update the docs to make it clearer
Add a reply
Sign up and join the conversation on Discord