Dropped requests?

iilaffey

I am trying to do some debugging around costs and Helicone- when searching for a specific request string:
https://www.helicone.ai/requests?filters=%22%25220%253A2%253Alabel%2522%22&page=5&page_size=100
I see that these requests began yesterday at 3:10 PM.

However, these requests have been going on for longer than that, we shipped this feature before November 2nd and have not made any changes to the LLM call.

We are seeing a large cost discrepancy between OpenAI and Helicone (~$300 vs ~$90) / day and I am worried that the requests are not being properly handled

3 comments

JJustin

Hi ! Sorry to hear the discrepancy - can you provide more information? And would it be okay if I took at look at your org’a data?

nnate_

Might be related, I noticed that I'm not getting any requests logged that are sent from the updated OpenAI python libraries (>=1.1.1)

JJustin

Hi Nate! Thanks for flagging - someone else reported an issue with the newest 1.1.1+ packages as well. We are looking into this

Add a reply

Helicone Community Page

Dropped requests?