Helicone Community Page

Updated 4 hours ago

Recommended Setup for Ollama Integration with Helicone

Hey all, new to Helicone coming from arize, I run a lot of models with Ollama and I was wondering what the recommended setup is because I followed to docs to use the SDK and it seems like a lot of things aren't properly wired up there for Ollama? Is it recommended to use the OpenAI API interface and pretend that Ollama isn't Ollama, or what is the intended setup for Ollama that will properly capture statistics?
Add a reply
Sign up and join the conversation on Discord