Helicone Community Page

N
Nick
Offline, last seen 4 months ago
Joined August 29, 2024
Hey guys, found the issue with tokens calculation which affects cost projection. Instead of 2-4k we get ~22 tokens πŸ˜€. Noticed that for all OpenAI models almost a month ago (streaming is on). Have you met the same before πŸ˜€ ? We're using proxy integration (https://docs.helicone.ai/integrations/openai/python) with the following headers

headers = {
"Helicone-Auth": f"Bearer AUTHKEY",
"Helicone-Cache-Enabled": "true",
"Helicone-Property-CUSTOMPROPERTY": "custom_prop_value",
"Helicone-User-Id": user_id
}
39 comments
J
O
N
a
A