Sortformer 2.1
Identify up to four speaker channels in speech recordings with incremental timed segments.
Desktop app
Run Sortformer 2.1 on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Streaming Sortformer 2.1 Desktop
60 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms | 0.005 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms | 0.005 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms | 0.005 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms | 0.005 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms | 0.005 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 16 ms / 0 ms | 0.005 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 176 ms / 0 ms | 0.008 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 179 ms / 0 ms | 0.008 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 182 ms / 0 ms | 0.008 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 144 ms / 0 ms | 0.008 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 145 ms / 0 ms | 0.008 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 146 ms / 0 ms | 0.008 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 317 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 320 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 321 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 322 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 322 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 323 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 319 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 320 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 320 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 320 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 321 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 321 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 326 ms / 0 ms | 0.009 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 327 ms / 0 ms | 0.010 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 330 ms / 0 ms | 0.010 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 346 ms / 609 ms | 0.010 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 346 ms / 617 ms | 0.010 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 349 ms / 643 ms | 0.010 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 62 ms / 0 ms | 0.021 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 0 ms | 0.021 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 0 ms | 0.021 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 0 ms | 0.021 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 65 ms / 0 ms | 0.022 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 66 ms / 0 ms | 0.022 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 909 ms / 0 ms | 0.049 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 917 ms / 0 ms | 0.049 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 921 ms / 0 ms | 0.050 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 1170 ms / 0 ms | 0.050 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 1180 ms / 0 ms | 0.050 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 1190 ms / 0 ms | 0.051 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2391 ms / 0 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2396 ms / 0 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2400 ms / 0 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2402 ms / 0 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2405 ms / 0 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2443 ms / 606 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2375 ms / 0 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2379 ms / 0 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2387 ms / 0 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2387 ms / 0 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2391 ms / 0 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2391 ms / 0 ms | 0.069 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2402 ms / 0 ms | 0.070 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2493 ms / 684 ms | 0.070 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2436 ms / 0 ms | 0.071 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2442 ms / 0 ms | 0.071 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2527 ms / 627 ms | 0.071 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 2538 ms / 0 ms | 0.071 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-07T08:43:39.621007+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "MLX Audio0.6.3 / MLX0.32.4", "scope": "Isolated private app-owned CPython probe venv. Model-local snapshot initialization, excludes network/provisioning." }
- Runtime
- mlx-audio 0.6.3
- Artifact revision
- 8541fc3db304f350b544bbcab1cfae4f3eeb2356
- Fixture
{ "file": "model-samples/desktop/nemotron-diarization/two-speakers.wav", "size": 2281320, "sha1": "dd1f5044b4dfa54815d41ae8c786458557b5344e", "sha256": "65ff2090f2ae357a70d7d2b65ba00634a37b60642c9de5857acabe97648f287a", "url": "https://assets.localai.tools/samples/v1/files/65ff2090f2ae357a70d7d2b65ba00634a37b60642c9de5857acabe97648f287a/two-speakers.wav" }- Rerun when
- Artifact/runtime/preprocessing; Fixtures/quality gate; Backend behavior
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.16184971098265896,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 684.0625409968197,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2492.7507499960484,
"inferenceMs": 2492.7507499960484,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06993391664171551,
"audioSecondsPerSecond": 14.299213429203261,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 3176.813290992868,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17212588310854207,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2391.0615829954622,
"inferenceMs": 2391.0615829954622,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06708103545076782,
"audioSecondsPerSecond": 14.907342936498363,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2391.0615829954622,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17469492614001284,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2399.9466249952093,
"inferenceMs": 2399.9466249952093,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06733030457106372,
"audioSecondsPerSecond": 14.85215322239558,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2399.9466249952093,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.21455938697318008,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 1190.3591250011232,
"inferenceMs": 1190.3591250011232,
"audioSeconds": 23.387375,
"realTimeFactor": 0.05089750880554672,
"audioSecondsPerSecond": 19.647327019883964,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 1190.3591250011232,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 64.39670799591113,
"inferenceMs": 64.39670799591113,
"audioSeconds": 3,
"realTimeFactor": 0.021465569331970375,
"audioSecondsPerSecond": 46.58623233023783,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 64.39670799591113,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2386.988999998721,
"inferenceMs": 2386.988999998721,
"audioSeconds": 34.439375,
"realTimeFactor": 0.06930988149461832,
"audioSecondsPerSecond": 14.427957146018878,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2386.988999998721,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2441.574499993294,
"inferenceMs": 2441.574499993294,
"audioSeconds": 34.439375,
"realTimeFactor": 0.07089485508936483,
"audioSecondsPerSecond": 14.105395923857571,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2441.574499993294,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.24598930481283424,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2401.7808329954278,
"inferenceMs": 2401.7808329954278,
"audioSeconds": 34.439375,
"realTimeFactor": 0.0697393850206465,
"audioSecondsPerSecond": 14.339099774165597,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2401.7808329954278,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 920.9682500004419,
"inferenceMs": 920.9682500004419,
"audioSeconds": 18.5855,
"realTimeFactor": 0.04955305211054004,
"audioSecondsPerSecond": 20.180391669301393,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 920.9682500004419,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 65.88883400399936,
"inferenceMs": 65.88883400399936,
"audioSeconds": 3,
"realTimeFactor": 0.02196294466799979,
"audioSecondsPerSecond": 45.531235228990454,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 65.88883400399936,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.16184971098265896,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 606.3782909986912,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2443.072124995524,
"inferenceMs": 2443.072124995524,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06854018691576227,
"audioSecondsPerSecond": 14.589980637622519,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 3049.4504159942153,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17212588310854207,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2538.017624996428,
"inferenceMs": 2538.017624996428,
"audioSeconds": 35.644375,
"realTimeFactor": 0.0712038750853796,
"audioSecondsPerSecond": 14.044179460751446,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2538.017624996428,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17469492614001284,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2401.794749996043,
"inferenceMs": 2401.794749996043,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06738215356549365,
"audioSecondsPerSecond": 14.840724837148855,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2401.794749996043,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.21455938697318008,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 1170.1209590028157,
"inferenceMs": 1170.1209590028157,
"audioSeconds": 23.387375,
"realTimeFactor": 0.05003216303680151,
"audioSecondsPerSecond": 19.987143055646882,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 1170.1209590028157,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 61.90387500100769,
"inferenceMs": 61.90387500100769,
"audioSeconds": 3,
"realTimeFactor": 0.020634625000335898,
"audioSecondsPerSecond": 48.4622327754307,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 61.90387500100769,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2378.9042079952196,
"inferenceMs": 2378.9042079952196,
"audioSeconds": 34.439375,
"realTimeFactor": 0.06907512717623998,
"audioSecondsPerSecond": 14.476991080285316,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2378.9042079952196,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2375.0383340011467,
"inferenceMs": 2375.0383340011467,
"audioSeconds": 34.439375,
"realTimeFactor": 0.06896287560390242,
"audioSecondsPerSecond": 14.500555425554394,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2375.0383340011467,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.24598930481283424,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2390.945125000144,
"inferenceMs": 2390.945125000144,
"audioSeconds": 34.439375,
"realTimeFactor": 0.0694247536431815,
"audioSecondsPerSecond": 14.404084242626826,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2390.945125000144,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 909.3475839981693,
"inferenceMs": 909.3475839981693,
"audioSeconds": 18.5855,
"realTimeFactor": 0.04892779769165044,
"audioSecondsPerSecond": 20.438279407181465,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 909.3475839981693,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 62.717749999137595,
"inferenceMs": 62.717749999137595,
"audioSeconds": 3,
"realTimeFactor": 0.0209059166663792,
"audioSecondsPerSecond": 47.83334861408854,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 62.717749999137595,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.16184971098265896,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 626.5279169965652,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2527.2695409948938,
"inferenceMs": 2527.2695409948938,
"audioSeconds": 35.644375,
"realTimeFactor": 0.07090233847542267,
"audioSecondsPerSecond": 14.103907170094768,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 3153.797457991459,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17212588310854207,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2395.7039580054698,
"inferenceMs": 2395.7039580054698,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06721127689868232,
"audioSecondsPerSecond": 14.878455612552198,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2395.7039580054698,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17469492614001284,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2404.706500004977,
"inferenceMs": 2404.706500004977,
"audioSeconds": 35.644375,
"realTimeFactor": 0.06746384247177786,
"audioSecondsPerSecond": 14.822754876707917,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2404.706500004977,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.21455938697318008,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 1179.7617920019547,
"inferenceMs": 1179.7617920019547,
"audioSeconds": 23.387375,
"realTimeFactor": 0.05044438685410204,
"audioSecondsPerSecond": 19.823811178283393,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 1179.7617920019547,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 63.14900000143098,
"inferenceMs": 63.14900000143098,
"audioSeconds": 3,
"realTimeFactor": 0.021049666667143658,
"audioSecondsPerSecond": 47.506690524505835,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 63.14900000143098,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2391.265416998067,
"inferenceMs": 2391.265416998067,
"audioSeconds": 34.439375,
"realTimeFactor": 0.06943405381189603,
"audioSecondsPerSecond": 14.402154923995974,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2391.265416998067,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2435.856625001179,
"inferenceMs": 2435.856625001179,
"audioSeconds": 34.439375,
"realTimeFactor": 0.07072882783154977,
"audioSecondsPerSecond": 14.138506612630918,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2435.856625001179,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.24598930481283424,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 2386.927042003663,
"inferenceMs": 2386.927042003663,
"audioSeconds": 34.439375,
"realTimeFactor": 0.0693080824493378,
"audioSecondsPerSecond": 14.428331655705106,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 2386.927042003663,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 917.0772500001476,
"inferenceMs": 917.0772500001476,
"audioSeconds": 18.5855,
"realTimeFactor": 0.04934369535391287,
"audioSecondsPerSecond": 20.266013577369854,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 917.0772500001476,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX CPU",
"acceleration": "cpu",
"executionDevice": "Device(cpu, 0)",
"durationMs": 64.905708997685,
"inferenceMs": 64.905708997685,
"audioSeconds": 3,
"realTimeFactor": 0.021635236332561664,
"audioSecondsPerSecond": 46.220895608843925,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 64.905708997685,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.16184971098265896,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 642.8446670033736,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 349.2665419980767,
"inferenceMs": 349.2665419980767,
"audioSeconds": 35.644375,
"realTimeFactor": 0.009798644021618466,
"audioSecondsPerSecond": 102.05493717229942,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 992.1112090014503,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17212588310854207,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 321.3156670026365,
"inferenceMs": 321.3156670026365,
"audioSeconds": 35.644375,
"realTimeFactor": 0.009014484529540397,
"audioSecondsPerSecond": 110.93257709001637,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 321.3156670026365,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17469492614001284,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 320.2506670058938,
"inferenceMs": 320.2506670058938,
"audioSeconds": 35.644375,
"realTimeFactor": 0.008984606042493206,
"audioSecondsPerSecond": 111.30148559329623,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 320.2506670058938,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.21455938697318008,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 179.11816700507188,
"inferenceMs": 179.11816700507188,
"audioSeconds": 23.387375,
"realTimeFactor": 0.007658754648825355,
"audioSecondsPerSecond": 130.5695306681972,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 179.11816700507188,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 15.063708000525367,
"inferenceMs": 15.063708000525367,
"audioSeconds": 3,
"realTimeFactor": 0.005021236000175122,
"audioSecondsPerSecond": 199.15415247662602,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 15.063708000525367,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 327.4847499997122,
"inferenceMs": 327.4847499997122,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009509021287398863,
"audioSecondsPerSecond": 105.16329386339444,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 327.4847499997122,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 319.59316600114107,
"inferenceMs": 319.59316600114107,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009279877059358396,
"audioSecondsPerSecond": 107.76004828550381,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 319.59316600114107,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.24598930481283424,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 320.8313340001041,
"inferenceMs": 320.8313340001041,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009315829163569435,
"audioSecondsPerSecond": 107.34417542891501,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 320.8313340001041,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 145.04583399684634,
"inferenceMs": 145.04583399684634,
"audioSeconds": 18.5855,
"realTimeFactor": 0.007804247074162457,
"audioSecondsPerSecond": 128.13535892664174,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 145.04583399684634,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 14.85066700115567,
"inferenceMs": 14.85066700115567,
"audioSeconds": 3,
"realTimeFactor": 0.004950222333718557,
"audioSecondsPerSecond": 202.0111285080018,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 14.85066700115567,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.16184971098265896,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 617.3439999984112,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 346.30900000047404,
"inferenceMs": 346.30900000047404,
"audioSeconds": 35.644375,
"realTimeFactor": 0.009715670424869956,
"audioSecondsPerSecond": 102.92650494197727,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 963.6529999988852,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17212588310854207,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 317.4555000005057,
"inferenceMs": 317.4555000005057,
"audioSeconds": 35.644375,
"realTimeFactor": 0.008906187862755504,
"audioSecondsPerSecond": 112.28148512135785,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 317.4555000005057,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17469492614001284,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 322.0611669967184,
"inferenceMs": 322.0611669967184,
"audioSeconds": 35.644375,
"realTimeFactor": 0.009035399470371366,
"audioSecondsPerSecond": 110.6757928389522,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 322.0611669967184,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.21455938697318008,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 181.55962500168243,
"inferenceMs": 181.55962500168243,
"audioSeconds": 23.387375,
"realTimeFactor": 0.007763146783325723,
"audioSecondsPerSecond": 128.81374369319875,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 181.55962500168243,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 14.891250000800937,
"inferenceMs": 14.891250000800937,
"audioSeconds": 3,
"realTimeFactor": 0.004963750000266979,
"audioSecondsPerSecond": 201.4605892613879,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 14.891250000800937,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 329.5793750003213,
"inferenceMs": 329.5793750003213,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009569841932390506,
"audioSecondsPerSecond": 104.49493388342769,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 329.5793750003213,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 319.5224169976427,
"inferenceMs": 319.5224169976427,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009277822753683617,
"audioSecondsPerSecond": 107.7839086334092,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 319.5224169976427,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.24598930481283424,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 321.3717499966151,
"inferenceMs": 321.3717499966151,
"audioSeconds": 34.439375,
"realTimeFactor": 0.00933152096972187,
"audioSecondsPerSecond": 107.16366637815159,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 321.3717499966151,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 146.40791700367117,
"inferenceMs": 146.40791700367117,
"audioSeconds": 18.5855,
"realTimeFactor": 0.007877534475998557,
"audioSecondsPerSecond": 126.94327178723518,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 146.40791700367117,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 15.159791997575667,
"inferenceMs": 15.159791997575667,
"audioSeconds": 3,
"realTimeFactor": 0.005053263999191889,
"audioSecondsPerSecond": 197.8918972291807,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 15.159791997575667,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.16184971098265896,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 608.504375006305,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 345.86337500513764,
"inferenceMs": 345.86337500513764,
"audioSeconds": 35.644375,
"realTimeFactor": 0.009703168452389407,
"audioSecondsPerSecond": 103.05911980264032,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 954.3677500114427,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17212588310854207,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 322.7877500030445,
"inferenceMs": 322.7877500030445,
"audioSeconds": 35.644375,
"realTimeFactor": 0.00905578369667148,
"audioSecondsPerSecond": 110.42666581883545,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 322.7877500030445,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.17469492614001284,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 321.6960839999956,
"inferenceMs": 321.6960839999956,
"audioSeconds": 35.644375,
"realTimeFactor": 0.009025157097017289,
"audioSecondsPerSecond": 110.80139539404676,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 321.6960839999956,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.21455938697318008,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 176.48887500399724,
"inferenceMs": 176.48887500399724,
"audioSeconds": 23.387375,
"realTimeFactor": 0.007546331086921779,
"audioSecondsPerSecond": 132.51472649179902,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 176.48887500399724,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 16.043584000726696,
"inferenceMs": 16.043584000726696,
"audioSeconds": 3,
"realTimeFactor": 0.005347861333575565,
"audioSecondsPerSecond": 186.99063749497085,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 16.043584000726696,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 325.5804999935208,
"inferenceMs": 325.5804999935208,
"audioSeconds": 34.439375,
"realTimeFactor": 0.00945372847194587,
"audioSecondsPerSecond": 105.77837124976882,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 325.5804999935208,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.013368983957219251,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 319.5813749989611,
"inferenceMs": 319.5813749989611,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009279534689551163,
"audioSecondsPerSecond": 107.76402410845111,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 319.5813749989611,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0.24598930481283424,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A",
"1": "B"
},
"referenceSpeakers": 2,
"hypothesisSpeakers": 2,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 319.19704199390253,
"inferenceMs": 319.19704199390253,
"audioSeconds": 34.439375,
"realTimeFactor": 0.009268374992110123,
"audioSecondsPerSecond": 107.89377866683952,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 319.19704199390253,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {
"0": "A"
},
"referenceSpeakers": 1,
"hypothesisSpeakers": 1,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 144.46916700399015,
"inferenceMs": 144.46916700399015,
"audioSeconds": 18.5855,
"realTimeFactor": 0.007773219284065005,
"audioSecondsPerSecond": 128.64682745410084,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 144.46916700399015,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"diarizationErrorRate": 0,
"maximumDiarizationErrorRate": 0.25,
"collarSeconds": 0.25,
"evaluationStepSeconds": 0.02,
"speakerMapping": {},
"referenceSpeakers": 0,
"hypothesisSpeakers": 0,
"passed": true
},
"runtime": {
"engine": "mlx-audio",
"version": "0.6.3",
"mlxVersion": "0.32.4",
"loadMs": 0,
"provider": "MLX Metal",
"acceleration": "partial",
"executionDevice": "Device(gpu, 0)",
"durationMs": 15.143709002586547,
"inferenceMs": 15.143709002586547,
"audioSeconds": 3,
"realTimeFactor": 0.005047903000862182,
"audioSecondsPerSecond": 198.1020633378256,
"threshold": 0.5,
"chunkSeconds": 3,
"minDuration": 0.2,
"mergeGap": 0.5,
"stateResetPerRequest": true,
"totalMs": 15.143709002586547,
"grade": "fast",
"artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
"fallback": false
}
}
]Release validation still required
- Complete public dependency archive and separate forced model/runtime-source recovery pending