We have just starting using Helicone Pro version. Our main use case is to add monitoring and a better control of keys. Vault was the reason for us to test Helicone in prod. We enable the same on a prod app and we are getting latency increase that is not acceptable.
Without Vaulted keys latency incrase vs OpenAI is on <10's ms. with that enable increases to > 2-4 Seconds! For stable requests in a range of 700ms on raw OpenAI hits. Is this something "normal"? We are using python directly with hostname and manual headers for the vaulted keys.