Hi team, thanks for this amazing product.
I'm having an issue with using Anthropic on Vertex with Helicone. Basically, I can no longer stream the responses. It arrives in one block. Here is my setup:
export const anthropic = new AnthropicVertex({
baseURL: 'https://gateway.helicone.ai/v1',
projectId: process.env.ANTHROPIC_VERTEX_PROJECT_ID,
region: process.env.CLOUD_ML_REGION,
googleAuth: new GoogleAuth(getAuthClient()),
defaultHeaders: {
'Helicone-Auth': `Bearer ${process.env.HELICONE_API_KEY}`,
'Helicone-Target-URL': `https://${process.env.CLOUD_ML_REGION}-aiplatform.googleapis.com`,
'User-Agent': 'node-fetch',
},
fetch: fetchAnthropic,
maxRetries: 3,
})When I remove the Helicone baseURL, streaming works as expected. It would be great if you could solve that.
