rtpbench results

Reference columns: calls with the expected verdict over every behaviour of a case (the good agent passes, each bad one fails). Target columns: verdicts over every profile and repeat. Each links to the case's first call.

aivc-b95f5af

README

casereference-carrierreference-directaivc-carrieraivc-direct
greeting 9/9 9/9 pass 30/30 pass 30/30
bye 6/6 6/6 pass 30/30 pass 30/30
cancel 6/6 6/6 inconclusive 30/30 inconclusive 30/30
hold 9/9 9/9 fail 30/30 fail 30/30
dtmf-rfc4733 6/6 6/6 fail 30/30 fail 30/30
dtmf-info 6/6 6/6 fail 30/30 fail 30/30
refer 9/9 9/9 flips: pass 29, fail 1 pass 30/30
refer-fail 9/9 9/9 pass 30/30 pass 30/30
codec-pcmu- 6/6- pass 30/30
codec-pcma- 6/6- pass 30/30
timer 9/9 9/9 fail 30/30 fail 30/30
compact-headers 6/6- pass 30/30-
sdp-ssrc 6/6- pass 30/30-
late-offer 6/6- fail 30/30-
ptime-30 6/6- pass 30/30-
ssrc-change 6/6 6/6 pass 30/30 pass 30/30
large-invite- 6/6- pass 30/30
reinvite 6/6 6/6 pass 30/30 pass 30/30
reinvite-nosdp 6/6 6/6 fail 30/30 fail 30/30
hold-zero- 6/6- fail 30/30
codec-change- 6/6- fail 30/30
setagentdate (UTC)profilesrunscodefiles
reference-carrierreference agent2026-10-20 22:49clean, lte, lte-bad1rtpbench:f026db2ef9a8report · summary · conditions
reference-directreference agent2026-10-20 22:49clean, lte, lte-bad1rtpbench:f026db2ef9a8report · summary · conditions
aivc-carrieraivc2026-10-20 17:35clean, lte, lte-bad10rtpbench:f026db2ef9a8report · summary · conditions
aivc-directaivc2026-10-20 17:35clean, lte, lte-bad10rtpbench:f026db2ef9a8report · summary · conditions

ava

README

casereference-carrierreference-directava-audiosocket-carrierava-audiosocket-directava-audiosocket-direct-nopacerava-externalmedia-carrierava-externalmedia-direct
greeting 9/9 9/9 pass 30/30 pass 30/30- pass 30/30 pass 30/30
bye 6/6 6/6 pass 30/30 pass 30/30- pass 30/30 pass 30/30
cancel 6/6 6/6 inconclusive 30/30 inconclusive 30/30- inconclusive 30/30 inconclusive 30/30
hold 9/9 9/9 inconclusive 30/30 inconclusive 30/30- inconclusive 30/30 inconclusive 30/30
dtmf-rfc4733 6/6 6/6 fail 30/30 fail 30/30- fail 30/30 fail 30/30
dtmf-info 6/6 6/6 fail 30/30 fail 30/30- fail 30/30 fail 30/30
refer 9/9 9/9 flips: pass 27, fail 3 pass 30/30- pass 30/30 pass 30/30
refer-fail 9/9 9/9 fail 30/30 fail 30/30- fail 30/30 fail 30/30
codec-pcmu- 6/6- pass 30/30-- pass 30/30
codec-pcma- 6/6- pass 30/30-- pass 30/30
timer 9/9 9/9 fail 30/30 fail 30/30- fail 30/30 fail 30/30
compact-headers 6/6- pass 30/30-- pass 30/30-
sdp-ssrc 6/6- flips: pass 29, fail 1-- pass 30/30-
late-offer 6/6- pass 30/30-- pass 30/30-
ptime-30 6/6- flips: pass 29, fail 1-- pass 30/30-
ssrc-change 6/6 6/6 flips: pass 29, fail 1 pass 30/30- pass 30/30 pass 30/30
large-invite- 6/6- pass 30/30-- pass 30/30
reinvite 6/6 6/6 flips: pass 29, fail 1 flips: pass 29, fail 1- pass 30/30 pass 30/30
reinvite-nosdp 6/6 6/6 pass 30/30 pass 30/30- pass 30/30 pass 30/30
hold-zero- 6/6- inconclusive 30/30-- inconclusive 30/30
codec-change- 6/6- pass 30/30-- pass 30/30
setagentdate (UTC)profilesrunscodefiles
reference-carrierreference agent2026-10-20 07:36clean, lte, lte-bad1rtpbench:0397e3c41635report · summary · conditions
reference-directreference agent2026-10-20 07:36clean, lte, lte-bad1rtpbench:0397e3c41635report · summary · conditions
ava-audiosocket-carrierava2026-10-20 05:29clean, lte, lte-bad10rtpbench:0397e3c41635report · summary · conditions
ava-audiosocket-directava2026-10-20 05:29clean, lte, lte-bad10rtpbench:0397e3c41635report · summary · conditions
ava-audiosocket-direct-nopacerava2026-10-20 07:36clean, lte, lte-bad10rtpbench:0397e3c41635report · summary · conditions
ava-externalmedia-carrierava2026-10-20 05:29clean, lte, lte-bad10rtpbench:0397e3c41635report · summary · conditions
ava-externalmedia-directava2026-10-20 05:29clean, lte, lte-bad10rtpbench:0397e3c41635report · summary · conditions

Other runs (summary): calibrate, calibrate-carrier

baseline

README

casereference-carrierreference-directaivc-carrieraivc-directlivekit-carrierlivekit-direct
greeting 90/90 90/90 pass 30/30 pass 30/30 pass 30/30 pass 30/30
bye 60/60 60/60 pass 30/30 pass 30/30 pass 30/30 pass 30/30
cancel 60/60 60/60 inconclusive 30/30 inconclusive 30/30 pass 30/30 pass 30/30
hold 90/90 90/90 fail 30/30 fail 30/30 fail 30/30 fail 30/30
dtmf-rfc4733 60/60 60/60 fail 30/30 fail 30/30 fail 30/30 fail 30/30
dtmf-info 60/60 60/60 fail 30/30 fail 30/30 fail 30/30 fail 30/30
refer 90/90 90/90 pass 30/30 pass 30/30 flips: pass 29, fail 1 pass 30/30
refer-fail 90/90 90/90 fail 30/30 fail 30/30 pass 30/30 pass 30/30
codec-pcmu- 60/60- pass 30/30- pass 30/30
codec-pcma- 60/60- pass 30/30- pass 30/30
timer 90/90 90/90 fail 30/30 fail 30/30 fail 30/30 fail 30/30
compact-headers 60/60- fail 30/30- pass 30/30-
sdp-ssrc 60/60- fail 30/30- pass 30/30-
late-offer 60/60- fail 30/30- fail 30/30-
ptime-30 60/60- pass 30/30- pass 30/30-
ssrc-change 60/60 60/60 pass 30/30 pass 30/30 pass 30/30 pass 30/30
large-invite- 60/60- fail 30/30- pass 30/30
reinvite 60/60 60/60 pass 30/30 pass 30/30 pass 30/30 pass 30/30
reinvite-nosdp 60/60 60/60 fail 30/30 fail 30/30 pass 30/30 pass 30/30
hold-zero- 60/60- fail 30/30- fail 30/30
codec-change- 60/60- fail 30/30- fail 30/30
setagentdate (UTC)profilesrunscodefiles
reference-carrierreference agent2026-10-17 20:36clean, lte, lte-bad104b0b7bcreport · summary · conditions
reference-directreference agent2026-10-17 20:36clean, lte, lte-bad104b0b7bcreport · summary · conditions
aivc-carrieraivc2026-10-17 20:37clean, lte, lte-bad104b0b7bcreport · summary · conditions
aivc-directaivc2026-10-17 20:37clean, lte, lte-bad104b0b7bcreport · summary · conditions
livekit-carrierlivekit2026-10-17 20:38clean, lte, lte-bad104b0b7bcreport · summary · conditions
livekit-directlivekit2026-10-17 20:37clean, lte, lte-bad104b0b7bcreport · summary · conditions

Other runs (summary): calibrate, calibrate-carrier

media-path

README

caseaivc-directlivekit-direct
setagentdate (UTC)profilesrunscodefiles
aivc-directaivc2026-10-19 17:41clean, lte, lte-bad10rtpbench:72e41c264960report · summary · conditions
livekit-directlivekit2026-10-19 17:41clean, lte, lte-bad10rtpbench:72e41c264960report · summary · conditions

metrology

README

Other runs (summary): barge-in, methods

retransmit

README

casereference-directaivc-directava-directlivekit-direct
refer-lost 2/2 pass 10/10 pass 10/10 pass 10/10
bye-lost 2/2 pass 10/10 pass 10/10 pass 10/10
invite-retransmit 3/3 pass 10/10 pass 10/10 pass 10/10
setagentdate (UTC)profilesrunscodefiles
reference-directreference agent2026-10-21 15:58clean1rtpbench:fe41c0856bb3report · summary · conditions
aivc-directaivc2026-10-21 15:46clean10rtpbench:fe41c0856bb3report · summary · conditions
ava-directava2026-10-21 15:52clean10rtpbench:fe41c0856bb3report · summary · conditions
livekit-directlivekit2026-10-21 15:40clean10rtpbench:fe41c0856bb3report · summary · conditions

tls-srtp

README

casereference-carrierreference-directaivc-carrier
greeting 3/3 3/3 pass
bye 2/2 2/2 pass
cancel 2/2 2/2 inconclusive
hold 3/3 3/3 fail
dtmf-rfc4733 2/2 2/2 fail
dtmf-info 2/2 2/2 fail
refer 3/3 3/3 pass
refer-fail 3/3 3/3 fail
codec-pcmu- 2/2-
codec-pcma- 2/2-
timer 3/3 3/3 fail
compact-headers 2/2- fail
sdp-ssrc 2/2- fail
late-offer 2/2- fail
ptime-30 2/2- pass
ssrc-change 2/2 2/2 pass
reinvite 2/2 2/2 pass
reinvite-nosdp 2/2 2/2 fail
hold-zero- 2/2-
codec-change- 2/2-
setagentdate (UTC)profilesrunscodefiles
reference-carrierreference agent2026-10-20 16:57clean1rtpbench:f026db2ef9a8report · summary · conditions
reference-directreference agent2026-10-20 16:44clean1rtpbench:f026db2ef9a8report · summary · conditions
aivc-carrieraivc2026-10-20 17:11clean1rtpbench:f026db2ef9a8report · summary · conditions

Other runs (summary): calibrate, calibrate-carrier