Helicone Community Page

Updated 4 months ago

tokens not found

I'm using streaming from OpenAI and log async. I send both collected response as a single message and streamed_chunks. Usage is set to -1. Isn't Helicone responsible for calculating the tokens?

Attachment

5 comments

LLuka

PS. I tried searching across all Discord and nothing comes up. I'm not a fan of discord as it seems to me that many valuable answers get lost.

aayoKho

Thanks for flagging this! It should calculate the tokens here. Do you mind sharing your integration strategy and the raw inputs / outputs?

Cc and

HHellenKeller-D9R

Yes, this is also happening for me. A function that is streaming.

HHellenKeller-D9R

no changes were made to this function in the past weeks, and it worked before. Just started happening today.

CCole

Hi, apologies, this was resolved. Our token counter service went down and the fallbacks failed. We’re looking into improving this to prevent this happening again in the future.

Add a reply