The use case: how Latent Health deploys Baseten
Latent Health uses Baseten to run its multi-modal clinical search and question-answering system for large US health systems. It deploys OCR, fine-tuned LLM, embedding and reranker models as a compound AI workflow using Baseten Chains.
More reported results
Figures published in Baseten’s case study. They are not independently measured by usedby.
600 millisecond P90 end-to-end latency for question-answering
6x improved GPU utilization by removing processing bottlenecks
In the customer’s words
Baseten has saved us countless hours of experimentation and eliminated the stress of working about inference reliability.Other AI tools used by Latent Health
Other public relationships recorded on usedby.
Explore Latent Health’s AI stack
Baseten users in HealthTech & Digital Health
Companies in the same sector, with public evidence.
See all Baseten customers
Go straight to the source
Based on Baseten’s published case study. We check the public evidence; the results are reported by the vendor.
baseten.co- Source published
- Sep 10, 2025
- Last checked
- Oct 9, 2026
Open source capture What the story claims, and what we checked
What we compared with the page.
- The figure: 99.999%Checked
The figure is on the page; its label is our wording.
- The passage quoted aboveChecked
Copied word for word from the page, near the name of Latent Health.
- The publication dateChecked
Read from the page’s own metadata, never guessed.
- Latent Health uses BasetenChecked
Confirmed line.
- The result itselfNot checked
We quote it; we did not measure it.
Using Chains for their compound AI systems, the Basten platform for model management, and the Baseten Inference Stack for performance and reliability, Latent has achieved: