LiteLLM and Langfuse
LiteLLM (opens in a new tab) allows you to call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]
Langfuse is a powerful tool designed to enhance LLM observability, evaluations, and prompt management.
LiteLLM and Langfuse are deeply integrated. You can add Langfuse as your preferred observability provider when using LiteLLM and start logging traces in one-click. You can also take advantage of the additional functionalities that Langfuse offers beyond tracing such as evaluations, prompt management or our LLM playground.