The use case: how Harvey deploys LangSmith
Harvey runs offline evaluations of its agentic search system in LangSmith, using OpenTelemetry traces from the OpenAI Agent SDK. The evaluations track metrics such as hallucination, tool recall, retrieval recall, formatting, and answer quality.
Other AI tools used by Harvey
Other public relationships recorded on usedby.
Explore Harvey’s AI stack
Other companies using LangSmith
Customers across industries, with public evidence.
AbridgeObserved
AppFolioObserved
AutodeskObserved
BridgewaterObserved
Bristol Myers SquibbObserved
C.H. RobinsonObservedGo straight to the source
Based on Harvey’s own page about how it uses LangSmith. We check the public evidence; the results are reported by the company.
harvey.ai- Source published
- Dec 10, 2025
- Last checked
- Nov 1, 2026
Open source capture What the story claims, and what we checked
What we compared with the page.
- The passage quoted aboveChecked
Copied word for word from the page, near the name of Harvey.
- The publication dateChecked
Read from the page’s own metadata, never guessed.
- Harvey uses LangSmithChecked
Confirmed line.
- The result itselfNot checked
We quote it; we did not measure it.
Centralized evaluation infrastructure that we built using the OpenAI Agent SDK's OpenTelemetry traces enables us to run offline evaluations in LangSmith. We track metrics like hallucination, tool recall, retrieval recall, formatting, and answer quality.