# How Latent Health uses Baseten

**99.999%** uptime

As published on [baseten.co](https://www.baseten.co/resources/customers/latent-delivers-pharmaceutical-search-with-baseten/), September 2025. Captured by usedby on 2026-10-09.

- Company: [Latent Health](https://www.usedby.ai/companies/latent-health.md)
- Tool: [Baseten](https://www.usedby.ai/tools/baseten.md)
- Industry: [HealthTech & Digital Health](https://www.usedby.ai/companies/industry/healthtech-digital-health.md)

## The use case: how Latent Health deploys Baseten

Latent Health uses Baseten to run its multi-modal clinical search and question-answering system for large US health systems. It deploys OCR, fine-tuned LLM, embedding and reranker models as a compound AI workflow using Baseten Chains.

Summary written by usedby from the source page, in English. The figures are those of Baseten and Latent Health, not ours.

> Using Chains for their compound AI systems, the Basten platform for model management, and the Baseten Inference Stack for performance and reliability, Latent has achieved:

- **600 millisecond**: “600 millisecond P90 end-to-end latency for question-answering”
- **6x**: “6x improved GPU utilization by removing processing bottlenecks”

> Baseten has saved us countless hours of experimentation and eliminated the stress of working about inference reliability.
>
> Allan Bishop, Head of Engineering

Source: [baseten.co](https://www.baseten.co/resources/customers/latent-delivers-pharmaceutical-search-with-baseten/), captured 2026-10-09.

## Other AI tools used by Latent Health

- [Together AI](https://www.usedby.ai/tools/together-ai.md) — Confirmed

## Baseten users in HealthTech & Digital Health

- [Magicare.ai](https://www.usedby.ai/companies/magicare-ai.md) — Confirmed
- [OpenEvidence](https://www.usedby.ai/companies/openevidence.md) — Confirmed
- [Sully AI](https://www.usedby.ai/companies/sully-ai.md) — Confirmed
- [Abridge](https://www.usedby.ai/companies/abridge.md) — Observed
- [Ambience](https://www.usedby.ai/companies/ambience.md) — Observed

## What usedby checked

We compared the story with its live page on 2026-10-09.

- Checked: the figure 99.999% is on the page; its label is our wording.
- Checked: the passage quoted above is copied word for word from the page, near the name of Latent Health.
- Checked: the publication date is read from the page’s own metadata, never guessed.
- Checked: Latent Health uses Baseten. Confirmed line. Latest check across sources: 2026-10-15.
- Not checked: the result itself. We quote it; we did not measure it.

---
Source: https://www.usedby.ai/case-studies/latent-health-baseten · How we check: https://www.usedby.ai/methodology