Helicone Community Page

Updated 7 months ago

Retrieving the Helicone id in streaming mode

Hi! We're using the anthropic SDK to proxy thru helicone. Is there a way to get the helicone ID back in streaming mode?
J
s
7 comments
Hi Shree! There is no way right now, however, you can pre-define the ID prior to making the request
Would you mind sharing what you are trying to do so we can update our docs appropiately?
https://docs.helicone.ai/helicone-headers/header-directory#supported-headers

Here shows you can add the helicone-request-id which is a UUID that can be predefined that can be later used to give feedback
we want to save it off for logging/debugging/analytics attribution
We're using this approach for proxying helicone: https://docs.helicone.ai/getting-started/integration-method/anthropic

Except, the anthropic API is now messages, their completions api is deprecated. And we're using the stream variant. https://docs.anthropic.com/en/api/messages-streaming
Add a reply
Sign up and join the conversation on Discord