Error using Helicone with the Claude 3 + streaming

When streaming responses from Claude 3 using the Anthropic Typescript SDK, after several tokens, I get an error:

Plain Text

Could not parse message into JSON: 
From chunk: [ 'event: content_block_delta' ]
 ⨯ Error: failed to pipe response

This error doesn't happen if I go directly to Anthropic's API by omitting the baseURL and defaultHeaders in the client constructor:

``function getAnthropic() {
  return new Anthropic({
    apiKey: process.env.ANTHROPIC_API_KEY,
    // baseURL: 'https://anthropic.hconeai.com/',
    // defaultHeaders: {
    // 'Helicone-Auth':

Bearer ${process.env.ANTHROPIC_API_KEY}`,
// },
});
}

4 comments

aayoKho

Thanks for flagging this!! The team will look into this first thing this morning and update you when we have a fix

JJustin

Hi ,

https://github.com/Helicone/helicone/issues/1508

There is an issue with their SDK
https://github.com/anthropics/anthropic-sdk-typescript/issues/318

I am working on a temp patch now

JJustin

hi this should be fixed with the latest version of anthropic. see https://github.com/anthropics/anthropic-sdk-typescript/issues/318

aassaf

Just updated to 0.17.1 and it works! Thanks

Add a reply

Helicone Community Page

Error using Helicone with the Claude 3 + streaming