How to View Turn-by-Turn Transcripts on AudioArena

Updated

To view a turn-by-turn transcript on AudioArena, you select three things in sequence: a benchmark, a model, and a specific run. The transcript then shows how the voice agent handled each turn of that conversation. This works for any of the six static multi-turn voice agent benchmarks on the site — Appointment, Assistant, Conversation, Event, Grocery, and Product — and any model or run available for them.

Steps

  1. Select a benchmark. Choose one of the six AudioAgentBench benchmarks: Appointment, Assistant, Conversation, Event, Grocery, or Product. Each is a static multi-turn voice agent scenario, so pick the one closest to the interaction you want to inspect.
  2. Select a model. Choose the voice model whose behavior you want to examine. Results are scored across five dimensions, so the model you pick determines which scores and transcripts you'll see.
  3. Select a run. A model can have more than one run on a benchmark. Pick the specific run you want to inspect — the transcript belongs to that run, not to the model in general.
  4. Read the transcript. The turn-by-turn transcript opens for that benchmark/model/run combination, letting you follow the conversation one turn at a time.

What you get

Selection What it determines
Benchmark Which scenario and task the agent was tested on
Model Which voice model's behavior and scores you're viewing
Run Which individual attempt's transcript you open

The transcript is the record of a single run, so two runs of the same model on the same benchmark can be compared by opening each separately.

Common snags

  • No transcript appears: confirm all three selections are made. The transcript is tied to a specific run, so a benchmark and model alone aren't enough.
  • Comparing models: keep the benchmark and, where possible, the run conditions consistent so differences reflect the model rather than the scenario.
  • Understanding the scores: the five scoring dimensions and the benchmark setup are explained in AudioArena's methodology, which is worth reading before drawing conclusions from a single transcript.

AudioAgentBench is published by Arcada Labs, By The Intelligence Company, with the project available on GitHub.