Helicone Community Page

Updated 3 months ago

No Response with status 'success' gpt-3.5-turbo-1106

Sometimes, even when the status is 'success', the responses from the GPT-3.5-Turbo model are empty. Additionally, I'm encountering an error message stating 'Response body too large'. Has anyone else experienced this, and if so, could you share any insights or solutions to resolve this issue?

Thanks in advance!"
Attachment
image.png
m
C
8 comments
Hi ! The message "Response body too large" is generated when the size of the data we're attempting to send to our frontend exceeds the capacity limits set by our current serverless infrastructure. This message doesn't reflect the actual request or response exchanged with the language model; it's more about the constraints we have on the data we can transmit in one go.

We will be addressing these limitations very soon as we are switching to dedicated servers!

https://github.com/Helicone/helicone/blob/7e7a2f561cfe5d15c4fb8c1f07231dc53a147367/web/lib/api/request/request.ts#L290
Regarding the empty response bodies, could you add me to your organization so I can take a look? My email is [email protected]. Thanks
I added you to the organization 'Propilot'
Thanks, will take a look
Hi, so I took a look at one of the requests where the body is missing. This is due to the response body size. Since you're streaming, the stream data is quite large. We only support the large bodies for enterprise users at this time, however we're in the middle of adding support for all users.

Is there a current way for me to solve this issue now?
If I upgrade to the Pro plan, will it fix the problem?
Sorry, but pro will not solve it at the moment. We are working hard to switch to dedicated servers ASAP! It won't be long!
Add a reply
Sign up and join the conversation on Discord