# AI Achieves Clinician-Level Video Consults

_AMIE (Video), a Gemini-based AI, achieves clinician-level performance in real-time video consultations, surpassing text-only models and matching human physicians in key assessment areas._

**Updated:** 2026-08-22
**Published:** 2026-08-11
**Source:** https://www.startuphub.ai/ai-news/ai-research/2026/ai-achieves-clinician-level-video-consults

---

The standard for patient-physician interaction has always been audio-visual, a rich modality that captures subtle non-verbal cues essential for diagnosing illness. Text-based AI, while promising, inherently discards these vital perceptual dimensions and disadvantages patients unable to articulate symptoms in writing. Early attempts to imbue medical AI with audio-visual capabilities have shown feasibility but have fallen short of clinician-level performance.

Text AI limitationsDriver

discards vital non-verbal cues, disadvantaging patients unable to articulate symptoms in writingFrom the article 3 mentionsLimitations persist in fine anatomical precision, discerning subtle affective nuances, and processing high-frequency movements, indicating areas for future refinement.Early AV AIDrivershowed feasibility but fell short of clinician-level performance in medical assessmentsFrom the articleEarly attempts to imbue medical AI with audio-visual capabilities have shown feasibility but have fallen short of clinician-level performance.AMIE (Video)Corea new Gemini-based multi-agent system integrating dialogue, reasoning, and real-time perceptionFrom the article 5 mentionsA new Gemini-based multi-agent system, AMIE (Video), is now demonstrating expert-level performance in real-time clinical video consultations.usesReal-time AV perceptionContextFrom the article 2 mentionsThis system integrates low-latency dialogue, clinical reasoning, and crucially, real-time audio-visual perception.enablesExpert assessmentEffectdemonstrates expert-level assessment across modalities, including subtle non-verbal cuesleads toClinician-level performanceOutcomeachieves clinician-level performance in real-time video consultations, matching human physiciansFrom the article 2 mentionsEarly attempts to imbue medical AI with audio-visual capabilities have shown feasibility but have fallen short of clinician-level performance.meansSurpasses text modelsOutcomesurpasses text-only models in key assessment areas, bridging the sensory gap

## Bridging the Sensory Gap in Clinical AI

A new Gemini-based multi-agent system, [AMIE (Video)](https://arxiv.org/abs/2608.09861v1), is now demonstrating expert-level performance in real-time clinical video consultations. This system integrates low-latency dialogue, clinical reasoning, and crucially, real-time audio-visual perception. The researchers developed a taxonomy and automated evaluations specifically for clinical audio-visual cues in telehealth settings to guide its development. In a randomized Objective Structured Clinical Examination (OSCE) study involving 30 primary care physicians (PCPs), 15 patient actors, and 100 clinical scenarios, AMIE (Video) was directly compared against its text-only counterpart, AMIE (Text), and human PCPs conducting video consultations.

## Expert-Level Assessment Across Modalities

The results are striking. Clinical evaluators rated AMIE (Video) as on par with or superior to PCPs in history-taking, diagnosis, management, and physical observation and examination. Patient actors expressed a preference for AMIE's approach to assessing and explaining conditions, finding it more effective than human physicians in these specific areas. While patient actors favored AMIE (Video) for its communicative effectiveness, convenience, and sense of being understood over text chat interfaces, they did note a preference for PCPs in rapport and partnership building. Limitations persist in fine anatomical precision, discerning subtle affective nuances, and processing high-frequency movements, indicating areas for future refinement.

---

Original analysis from [startuphub.ai](https://www.startuphub.ai), the #1 AI startup directory.