Helicone Community Page

Updated 7 months ago

Cloudflare 524 error for Anthropic requests over 100 seconds

At a glance

A community member is experiencing a 524 error from Cloudflare for Anthropic requests that take longer than 100 seconds. The community members discuss the issue, with one suggesting it may be fixed for the anthropic.helicone.ai domain. After some back-and-forth, it is revealed that the community member was using anthropic.helicone.ai and that the new upper limit for long-running requests is 6000 seconds, which should be sufficient for their use case.

MMarshall

I'm getting a 524 from Cloudflare for any Anthropic requests that take > 100 seconds. Is this expected and is there a setting that can be changed?

12 comments

JJustin

Hi Marshall which domain are you using? anthropic.hconeai.com or anthropic.helicone.ai

JJustin

Thanks for flagging

JJustin

I think this should be fixed for helicone.ai

JJustin

can you check again

MMarshall

Will check right now!

MMarshall

I've got some good >100 second runs so I think that works! What is the new upper limit?

MMarshall

(Never answered but I was, in fact, using anthropic.helicone.ai... Haven't tested any long runs with the openai endpoint yet.

JJustin

6000 seconds

MMarshall

Don't think I'll be hitting that limit... 🙂

JJustin

Haha definitely not. I think anthropic and most providers have a built in 15 min timeout

MMarshall

Well, thank you so much! Most of our runs are >2 mins (I just kind of ignore the latency dashboards...) so this was the difference between switching observability to Helicone and looking for another provider.

JJustin

phew that's good! thanks for flagging @Marshall and sticking with Helicone 🙏

Add a reply