Getting random "KV PUT failed" failures, causing my app to fail at random times. And it's NOT during heavy loads from my app - you can check our logs, we're pretty boring quite users haha. Here's the message (our app does auto-retry 5x times):
(PID 2922) 2025-01-13T14:02:15.885Z [ERROR] callChatModel.js:2868: Requesting https://oai.hconeai.com/v1/chat/completions hit HTTP error '500' (Request failed with status code 500) {"helicone-message":"Helicone ran into an error servicing your request: Error: KV PUT failed: 429 Too Many Requests","support":"Please reach out on our discord or email us at [email protected], we'd love to help!","helicone-error":"{}"}I'm going to have to turn off routing request thru helicone because we cannot afford to have our users experience this "random crash" - but any way around this?
