Helicone Community Page

Updated 4 months ago

tokens not found

I'm using streaming from OpenAI and log async. I send both collected response as a single message and streamed_chunks. Usage is set to -1. Isn't Helicone responsible for calculating the tokens?
Attachment
image.png
1
L
a
H
5 comments
PS. I tried searching across all Discord and nothing comes up. I'm not a fan of discord as it seems to me that many valuable answers get lost.
Thanks for flagging this! It should calculate the tokens here. Do you mind sharing your integration strategy and the raw inputs / outputs?

Cc and
Yes, this is also happening for me. A function that is streaming.
no changes were made to this function in the past weeks, and it worked before. Just started happening today.
Hi, apologies, this was resolved. Our token counter service went down and the fallbacks failed. We’re looking into improving this to prevent this happening again in the future.
Add a reply
Sign up and join the conversation on Discord