Comprehensive analysis of Comet's strengths and weaknesses based on real user feedback and expert evaluation.
Covers both classical ML and LLM observability — one platform across the stack
Opik is genuinely open source (Apache 2.0) with self-hosting, not a 'source-available' bait-and-switch
Mature integrations with PyTorch, TensorFlow, scikit-learn, XGBoost, Hugging Face, LangChain, LlamaIndex
On-prem and VPC deployment available for regulated industries
Generous free tier for individual researchers
5 major strengths make Comet stand out in the ml & llm observability category.
Older UI in some sections compared to LLM-native competitors like Langfuse or Braintrust
Team and Enterprise pricing is opaque — requires contacting sales for real numbers
Feature surface is broad, which means more learning if you only need LLM evals
Some users report performance issues on very large experiment counts
4 areas for improvement that potential users should consider.
Comet has potential but comes with notable limitations. Consider trying the free tier or trial before committing, and compare closely with alternatives in the ml & llm observability space.
Comet offers several key advantages in the ml & llm observability space, including its core features, ease of use, and integration capabilities. Users typically appreciate its approach to solving common problems in this domain.
Like any tool, Comet has some limitations. Common concerns include pricing considerations, feature gaps for specific use cases, or learning curve for new users. Consider these factors against your specific needs and priorities.
Comet can be worth the investment if its features align with your needs and the pricing fits your budget. Consider the time savings, efficiency gains, and results you'll achieve. Many tools offer free trials to help you evaluate the value before committing.
Comet works best for users who need ml & llm observability capabilities and can benefit from its specific feature set. It may not be ideal for those who need different functionality, have very basic requirements, or work with incompatible systems.
Consider Comet carefully or explore alternatives. The free tier is a good place to start.
Pros and cons analysis updated March 2026