Helicone Community Page

C
K
m
H
E
Members
Nick
N
Nick
Offline, last seen 2 months ago
Joined August 29, 2024
Hey guys, found the issue with tokens calculation which affects cost projection. Instead of 2-4k we get ~22 tokens πŸ˜€. Noticed that for all OpenAI models almost a month ago (streaming is on). Have you met the same before πŸ˜€ ? We're using proxy integration (https://docs.helicone.ai/integrations/openai/python) with the following headers

headers = {
"Helicone-Auth": f"Bearer AUTHKEY",
"Helicone-Cache-Enabled": "true",
"Helicone-Property-CUSTOMPROPERTY": "custom_prop_value",
"Helicone-User-Id": user_id
}
33 comments
J
O
N
a