Helicone Community Page

Updated 6 months ago

Seeing request timeouts

At a glance

The community members are experiencing timeouts when making requests to the oai.hconeai.com API. They are looking for an uptime checker to track the health of the API. The community members have tried using the status.helicone.ai service, but it does not seem to be showing the timeouts they are experiencing. They are unsure if the timeouts are coming from their own system or from the OpenAI API. The community members have a large volume of requests, making it difficult to identify the specific requests causing the timeouts in the Helicone dashboard. One community member has reported that the issue is happening intermittently, especially with the gpt-3.5-turbo-1106 model, but not with the gpt-4 model. Another community member has requested to be added to the organization so they can investigate further.

Hi there, we're seeing an increased volume of these errors in our app:

Plain Text
Request timed out: HTTPSConnectionPool(host='oai.hconeai.com', port=443): Read timed out. (read timeout=600)


Is there an uptime checker we can use to track the health of the API?
1
J
a
V
13 comments
there is status.helicone.ai
Can you share what your request looks like?
Thank you -- it seems like our timeouts are not showing up on this status page
I'm not sure what the request looks like, this is a production system where I'm just observing the logs. My guess is its an embedding call to OpenAI
Are you seeing the request at all in Helicone?
I would also like to rule out that the timeouts are not coming from OpenAI if possible
We have a really large volume of requests, so its difficult for me to identify which one it is in the helicone dashboard
We are facing the same issue since an hour. It is happening intermittently and especially with models like gpt-3.5-turbo-1106. We noticed that it wasn't happening with gpt-4
Hi , sorry you're experiencing this. Are you seeing the requests in Helicone at all?
Could you add me to your organization so I can take a look? My email is [email protected]. Thanks!
hey no, I could not see the requests that were hanging up.
Add a reply
Sign up and join the conversation on Discord