Helicone Community Page

Updated 6 months ago

Streaming behavior with Anthropic

At a glance

The community member is using Anthropic and has noticed that when they stream, if the response takes more than 60 seconds, the number of completion tokens shows '1' and the status is marked as Cancelled, even though the full response seems to be captured by Helicone. The community member notes that this is not a big deal since they don't need to stream, but they are unsure if this is expected behavior.

Question on streaming. I'm using Anthropic and, when I don't stream, everything is fine. When I DO stream and the response takes more than 60 seconds to come back (it seems,) the number of completion tokens shows '1' and the status is marked as Cancelled... though the full response seems to be captured by Helicone. Not a big deal because I don't NEED to stream but am not sure if this is expected behavior.
M
1 comment
Add a reply
Sign up and join the conversation on Discord