Build Multilingual Voice Health Assistant with AutoGen and Cartesia
Rural citizen healthcare access requires intuitive natural language interfaces across regional Indian languages. Build a multi-agent conversational assistant using AutoGen paired with Cartesia text-to-speech models to process Ayush traditional medicine queries with sub-second speech synthesis.
What you are building
The core problem, expected build, and operating context for this challenge.
Develop a multi-agent conversational healthcare counselor using AutoGen multi-agent orchestration and Cartesia high-speed voice streaming.
How work is evaluated
Validates multi-agent conversation correctness and Cartesia audio stream synthesis quality.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
How submissions are scored
These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.
safety_compliance_check
Verifies output contains mandatory disclaimer for acute symptoms
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
latency_ms
Total response time including TTS synthesis • target: 800 • range: 0-2000
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
What you should walk away with
Orchestrate collaborative specialized agents using Microsoft AutoGen for health triage
Integrate Cartesia ultra-low latency TTS API for real-time voice response generation in Hindi and Tamil
Verify medical entity extraction accuracy against WHO Ayush traditional medicine standards
Reference links and supporting material
Parallel dataset of citizen health queries in 4 Indian languages mapped to standardized Ayush remedies.
How this agent runs
Validates multi-agent conversation correctness and Cartesia audio stream synthesis quality.
Challenge input
JSON string containing citizen query in Hindi/Tamil text
AutoGen
Coordinates multi-agent safety checks and domain reasoning
Cartesia
Delivers real-time low latency text-to-speech
Evaluated output
JSON containing recognized medical concept, remedies, and audio stream URL
- Verifies output contains mandatory disclaimer for acute symptoms
- Total response time including TTS synthesis • target: 800 • range: 0-2000
- Benchmark: Voice-Health-Bench-India
- Latency Ms target: 800
- 1 public reference case
- Python execution harness
- Python sandbox (unavailable on Versalist)
View technical recipe
Configured tools
- Cartesia · Required
- AutoGen · Optional
- Galileo · Optional
- Galileo · Optional
Evaluation contract
- safety_compliance_check · Weight 1
- latency_ms · Weight 1
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.