In data, analytics and machine learning, I want to
train and evaluate models
The answer · Companies across the whole market
Your peers use SigNoz first, then LangSmith.
52 of 224 companies in this sample use SigNoz. Every line links to a public source.
- 01
5223% - 02
4721% - 03
41 - 04
32 - 05
17
Which AI tools do companies use for LLM observability & evals? Limited beta
Your role is not listed? Describe the task you want to do.
Train and evaluate models
These results show public use in this category. They do not establish use by your profession or suitability for this exact task. Your requirements have not been evaluated.
Category, industry and company size
Company size describes the employer. It does not establish access for a solo practitioner.
LLM observability & evals
224 companies, 9 tools
About these numbers
Counts cover companies recorded on usedby. They are not market shares. All four proof levels count. Missing size data is excluded only from size-based views. Your requirements have not been evaluated.
Companies with known size: 70%. Vendor companies excluded from this category: 0.

SigNoz
52 companies
10 confirmed42 observed
Mailmodo uses SigNoz as a centralized log management platform across its microservices, giving the technical support team controlled access to search logs and using parameterized dashboards and alerts to monitor environments and services.
Original source text
By providing controlled access to SigNoz dashboards, Mailmodo enabled their technical support team to handle customer queries independently.
Mailmodo · Read the source 
LangSmith
47 companies
1 confirmed1 declared43 observed2 signals
Harvey runs offline evaluations of its agentic search system in LangSmith, using OpenTelemetry traces from the OpenAI Agent SDK. The evaluations track metrics such as hallucination, tool recall, retrieval recall, formatting, and answer quality.
Original source text
Centralized evaluation infrastructure that we built using the OpenAI Agent SDK's OpenTelemetry traces enables us to run offline evaluations in LangSmith. We track metrics like hallucination, tool recall, retrieval recall, formatting, and answer quality.
Harvey · Read the source 
Braintrust
41 companies
16 confirmed24 observed1 signal
Coursera uses Braintrust to evaluate its AI features, the Coursera Coach chatbot and automated grading, through curated datasets, heuristic and LLM-as-a-judge scorers, online monitoring of production traffic, offline regression testing, and playground prototyping.
Original source text
Learners now receive grades within 1 minute of submission and benefit from approximately 45× more feedback, driving a 16.7% increase in course completions within a day of peer review2.
Coursera · Read the source 
Arize AI
32 companies
9 confirmed23 observed
Booking.com uses Arize to trace, monitor and evaluate its GenAI agents and traditional ML models (such as ranking and fraud detection) in production and during development.
Original source text
In one case, an Arize monitor fired when latency for a specific agent suddenly spiked several standard deviations above its baseline.
Booking.com · Read the source






















