assaf

·

Negative token count

I noticed when using gpt-4-vision-preview and sending image parts, the token calculations are negative. The token counts are positive when sending messages with no image parts, and using other models like Anthropic seem to count tokens correctly.

1 comment

J

aassaf

·

Error using Helicone with the Claude 3 + streaming

When streaming responses from Claude 3 using the Anthropic Typescript SDK, after several tokens, I get an error:

Plain Text

Could not parse message into JSON: 
From chunk: [ 'event: content_block_delta' ]
 ⨯ Error: failed to pipe response

This error doesn't happen if I go directly to Anthropic's API by omitting the baseURL and defaultHeaders in the client constructor:

``function getAnthropic() {
  return new Anthropic({
    apiKey: process.env.ANTHROPIC_API_KEY,
    // baseURL: 'https://anthropic.hconeai.com/',
    // defaultHeaders: {
    // 'Helicone-Auth':

Bearer ${process.env.ANTHROPIC_API_KEY}`,
// },
});
}

4 comments

a

J

a

Helicone Community Page

Negative token count

Error using Helicone with the Claude 3 + streaming