The Pro plan's monthly limit

It's 500k, thanks for spotting our out-dated button there

also free plan is 100k but on pricing page it says 50k

but im glad to have the 100k 😛

haha you caught us in the middle of a price switch 🙂 so not everything is sync right now

sorry for the inconvience

nop

but overall I like this, hopefully will help us know wtf is going on with our costs lol

That's the hope 🙂

i will start tmrw the integration 👍

also does this work for everything like embeddings and images too?

yep - the only thing that does work is images as byte array

those requests will get passed through but we do not store those images

no i mean

dalle3/dalle2

generate

oh yeah! Those requests will get passed through, and should work! @Cole you just added this last week right?

and embeddings too?

embeddings work!

with langchain same thing, just set baseURL?

yep

base64 images are stored but not displayed (supporting that is a priority)
image urls are stored and displayed for about an hour as they expire.

Supporting images is high priority

I recommend using cache with embeddings as well.

https://docs.helicone.ai/features/advanced-usage/caching#cache-parameters

I know embeddings are cheap, but since they are deterministic, why waste the compute 🤷

great