Langfuse
Trace, evaluate, and improve AI agents using production data. Collaborate on fixes and ship better quality at lower cost and latency.
Langfuse is an open-source platform designed to help teams trace, evaluate, and improve AI agents. By leveraging production data, it provides deep insights into agent behavior, enabling teams to collaborate on fixes and optimize performance for better quality, reduced costs, and lower latency.
Key Features
- LLM Observability: Monitor and debug AI agent interactions in real-time with detailed traces and logs.
- Prompt Management: Centralize and version control prompts for consistent AI outputs.
- Evaluation & Metrics: Assess agent performance using built-in evaluation tools and custom metrics.
- Collaboration Tools: Share insights and collaborate on fixes with your team.
- Self-Hosting Support: Deploy Langfuse on your infrastructure using Docker, Kubernetes, or cloud providers (AWS, GCP, Azure).
- Scalability: Handle millions of observations per month with high-performance data processing.
- Integration Ready: Works seamlessly with popular AI frameworks like LangChain and OpenAI.
- Open Source: Fully open-source with a vibrant community and enterprise-grade features.
Tech / Self-Hosting
Langfuse is built with modern technologies and supports multiple deployment options:
- Docker Compose: Quick local or cloud deployment.
- Kubernetes (Helm): Scalable production deployments.
- Cloud Providers: AWS, GCP, and Azure via Terraform.
- Database: Powered by ClickHouse for high-performance analytics.
Langfuse is trusted by over 100,000 engineers and used by 21 of the Fortune 50 companies.