Helicone Community Page

Updated 3 months ago

Unfinished streams are not logged

For speed and cost purposes, I'm using streams in my app but terminating the streams early when all needed text is received. If I do that, Helicone doesn't register the stream althought the proxy works as expected.
C
J
5 comments
If you are terminating the stream early, the connection to our worker will close. This will cause the worker to terminate and not log.

Is there a need to terminate the stream early? Also, for when you need to terminate the stream early, maybe using async logging would be best for you.
There are a couple reasons. One is that we sometimes detect that no more useful information will come out of the request. Another is that a user might end the request part-way through, but we still want to keep the log.
For now, I'll keep it as is and just wait for the stream to finish. It's not a serious issue.
Ideally we log even if the stream is canceled, so I will look into a solution.
Happy that it's on your radar!
Add a reply
Sign up and join the conversation on Discord