Ten LLMOps Projects You Should Know About

1. Langfuse - Observability, Analytics, Evals, Testing & Playground

2. LiteLLM - OpenAI Format, Loadbalancing, Fallsbacks & spend tracking

3. Mirascope - Pythonic LLM frameowkr

4. Atla-AI - Specialised Foundation Model for Evaluation

5. Llama Index

6. Dify.AI

7. Flowise

8. Haystack

9. Instructor

10. Awesome LLMOps - GitHub List

The Awesome LLMOps (opens in a new tab) list on GitHub