Helicone Community Page

Updated 5 months ago

Async Streaming with Anthropic via LiteLLM Still Doesn't Work

At a glance

A community member is experiencing issues with async streaming using Anthropic's LiteLLM. They have tried setting headers, metadata, callbacks, and the "include_usage": True option, but the issue persists. Another community member responds that they are looking into the issue, and the original poster expresses gratitude.

Hey! async streaming with Anthropic via LiteLLM still doesn't work?

I have set headers, metadata, callbacks the "include_usage": True" and nothing
J
C
2 comments
Hi Caco - thanks for following up - we are looking into this
Add a reply
Sign up and join the conversation on Discord