CosyVoice 3
Generate speech with a reference recording on Apple Silicon. English intelligibility measured locally; returns mono 24 kHz WAV with incremental audio chunks.
Desktop app
Run CosyVoice 3 on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
CosyVoice 3 · 0.5B
25 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 5839 ms / 0 ms | 0.579 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2062 ms / 0 ms | 0.586 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2065 ms / 0 ms | 0.587 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2065 ms / 0 ms | 0.587 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2070 ms / 0 ms | 0.588 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2071 ms / 0 ms | 0.588 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2074 ms / 0 ms | 0.589 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2076 ms / 0 ms | 0.590 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2081 ms / 0 ms | 0.591 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2087 ms / 0 ms | 0.593 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2087 ms / 0 ms | 0.593 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2089 ms / 0 ms | 0.593 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2091 ms / 0 ms | 0.594 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2093 ms / 0 ms | 0.595 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2094 ms / 0 ms | 0.595 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2101 ms / 638 ms | 0.597 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2118 ms / 0 ms | 0.602 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2140 ms / 297 ms | 0.608 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2142 ms / 310 ms | 0.609 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2951 ms / 0 ms | 0.811 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 179729 ms / 0 ms | 18.045 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 88892 ms / 0 ms | 18.994 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 80659 ms / 454 ms | 22.657 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 80752 ms / 646 ms | 22.683 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 86970 ms / 517 ms | 24.430 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-04T21:12:31.852494+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2" }
- Runtime
- mlx-audio-plus 0.1.8+ce39134c
- Artifact revision
- 18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9
- Fixture
{ "file": "model-samples/desktop/chatterbox-reference-input.wav", "size": 314924, "sha1": "5242ae44bc9dc9c91a28ab108af9cb51d88a5246", "sha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe", "url": "https://assets.localai.tools/samples/v1/files/a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe/chatterbox-reference-input.wav" }- Rerun when
- artifact revision; runtime source/dependencies; fixture bytes; quality gate; inference code
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2140.0764590362087,
"durationMs": 2140.802917012479,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6448010467743965,
"realTimeFactor": 0.6079762667716502,
"firstChunkMs": 993.1186669855379,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3762746594,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 297.47150000184774,
"totalMs": 2438.274417014327,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2064.9140829918906,
"durationMs": 2065.5576669960283,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.7046714093304114,
"realTimeFactor": 0.5866233190317871,
"firstChunkMs": 944.219124969095,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763107102,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2065.5576669960283,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2064.6239580237307,
"durationMs": 2065.239375049714,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.7049109530673874,
"realTimeFactor": 0.5865408971658326,
"firstChunkMs": 936.6236670175567,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763107102,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2065.239375049714,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2086.8449169793166,
"durationMs": 2087.445916957222,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.686756869837342,
"realTimeFactor": 0.5928536695963967,
"firstChunkMs": 954.2798339971341,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763107102,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2087.445916957222,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2117.694540997036,
"durationMs": 2118.3857080177404,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6621849524826853,
"realTimeFactor": 0.6016177673287033,
"firstChunkMs": 942.778582975734,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763107102,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2118.3857080177404,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2070.5547500401735,
"durationMs": 2071.3580829906277,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.700027492599123,
"realTimeFactor": 0.5882257812614129,
"firstChunkMs": 945.8095830050297,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763107102,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2071.3580829906277,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0.2,
"maximumWordErrorRate": 0.2,
"asrText": "The meeting starts at 9.30. Please bring three notebooks.",
"passed": true
},
"runtime": {
"inferenceMs": 2950.979291985277,
"durationMs": 2951.6762089915574,
"audioSeconds": 3.64,
"audioSecondsPerSecond": 1.2334888319569275,
"realTimeFactor": 0.810708596699252,
"firstChunkMs": 942.9038749658503,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3770136058,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03760986402630806,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2951.6762089915574,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
"passed": true
},
"runtime": {
"inferenceMs": 5838.829750020523,
"durationMs": 5843.877875013277,
"audioSeconds": 10.08,
"audioSecondsPerSecond": 1.7263733370483307,
"realTimeFactor": 0.5792489831369566,
"firstChunkMs": 946.0897090029903,
"chunks": 4,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4534014332,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.032798882573843,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 5843.877875013277,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2100.869624991901,
"durationMs": 2101.5501670190133,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6754966410700376,
"realTimeFactor": 0.5968379616454265,
"firstChunkMs": 976.2080000364222,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3762755390,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 637.8450830234215,
"totalMs": 2739.395250042435,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2091.384250030387,
"durationMs": 2092.166709015146,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6830957773297066,
"realTimeFactor": 0.5941432528495418,
"firstChunkMs": 965.5318339937367,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763115962,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2092.166709015146,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2062.368874961976,
"durationMs": 2063.1505419733003,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.7067751762229726,
"realTimeFactor": 0.5859002485687431,
"firstChunkMs": 940.5042919679545,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763115962,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2063.1505419733003,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2088.7039590161294,
"durationMs": 2089.2894999706186,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6852555790903339,
"realTimeFactor": 0.5933818065386731,
"firstChunkMs": 937.6668339828029,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763115962,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2089.2894999706186,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2075.6134999683127,
"durationMs": 2076.3074579881504,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6958841325968144,
"realTimeFactor": 0.5896629261273616,
"firstChunkMs": 951.8374169711024,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763115962,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2076.3074579881504,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2086.8957500206307,
"durationMs": 2087.5505000003614,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.686715783462208,
"realTimeFactor": 0.5928681108013155,
"firstChunkMs": 962.5822500092909,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763115962,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2087.5505000003614,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2142.2654999769293,
"durationMs": 2143.0477499961853,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6431203322080796,
"realTimeFactor": 0.6085981534025368,
"firstChunkMs": 988.4036249713972,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3762764186,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 309.81733300723135,
"totalMs": 2452.8650830034167,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2069.742708001286,
"durationMs": 2070.4493329976685,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.7006944807160125,
"realTimeFactor": 0.5879950875003653,
"firstChunkMs": 937.6084580435418,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763124662,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2070.4493329976685,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2092.6807079813443,
"durationMs": 2093.373666983098,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6820530655130308,
"realTimeFactor": 0.5945115647674274,
"firstChunkMs": 952.0539999939501,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763124662,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2093.373666983098,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2074.1055840044282,
"durationMs": 2074.733625049703,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.697117074051754,
"realTimeFactor": 0.5892345409103489,
"firstChunkMs": 950.5260000005364,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763124662,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2074.733625049703,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2093.7408750178292,
"durationMs": 2094.3738750065677,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6812013568632391,
"realTimeFactor": 0.5948127485846105,
"firstChunkMs": 954.7310000052676,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763124662,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2094.3738750065677,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 2081.1844999552704,
"durationMs": 2081.875082978513,
"audioSeconds": 3.52,
"audioSecondsPerSecond": 1.6913445204284643,
"realTimeFactor": 0.5912455965782019,
"firstChunkMs": 952.0446250098757,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3763124662,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03765134513378143,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 2081.875082978513,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "MLX Metal",
"acceleration": "partial",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 86969.6428750176,
"durationMs": 86970.90975003084,
"audioSeconds": 3.56,
"audioSecondsPerSecond": 0.04093382337002358,
"realTimeFactor": 24.429674964892584,
"firstChunkMs": 23667.464833008125,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4779701373,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.039496589452028275,
"clippedFraction": 0,
"loadMs": 516.7881249799393,
"totalMs": 87487.69787501078,
"grade": "slow",
"device": "cpu",
"precision": "fp32",
"provider": "MLX CPU",
"acceleration": "cpu",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0.2,
"maximumWordErrorRate": 0.2,
"asrText": "The meeting starts at 9.30. Please bring three notebooks.",
"passed": true
},
"runtime": {
"inferenceMs": 88891.84762502555,
"durationMs": 88893.06945801945,
"audioSeconds": 4.68,
"audioSecondsPerSecond": 0.05264824756193332,
"realTimeFactor": 18.99398453526187,
"firstChunkMs": 18357.944417046383,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4887672109,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.04377385973930359,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 88893.06945801945,
"grade": "slow",
"device": "cpu",
"precision": "fp32",
"provider": "MLX CPU",
"acceleration": "cpu",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
"passed": true
},
"runtime": {
"inferenceMs": 179728.8392080227,
"durationMs": 179731.16645799018,
"audioSeconds": 9.96,
"audioSecondsPerSecond": 0.05541681593164938,
"realTimeFactor": 18.04506417751232,
"firstChunkMs": 18309.06529101776,
"chunks": 4,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 5417272928,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.032228972762823105,
"clippedFraction": 0,
"loadMs": 0,
"totalMs": 179731.16645799018,
"grade": "slow",
"device": "cpu",
"precision": "fp32",
"provider": "MLX CPU",
"acceleration": "cpu",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 80752.06112500746,
"durationMs": 80752.68304202473,
"audioSeconds": 3.56,
"audioSecondsPerSecond": 0.044085562032763176,
"realTimeFactor": 22.683163237361647,
"firstChunkMs": 18375.37700001849,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4779665985,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.039496589452028275,
"clippedFraction": 0,
"loadMs": 646.1042920127511,
"totalMs": 81398.78733403748,
"grade": "slow",
"device": "cpu",
"precision": "fp32",
"provider": "MLX CPU",
"acceleration": "cpu",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"asrText": "Hello, this is a local speech synthesis test.",
"passed": true
},
"runtime": {
"inferenceMs": 80659.16499996092,
"durationMs": 80659.78529199492,
"audioSeconds": 3.56,
"audioSecondsPerSecond": 0.044136335901837374,
"realTimeFactor": 22.65706882021374,
"firstChunkMs": 18605.24499998428,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4779708801,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.039496589452028275,
"clippedFraction": 0,
"loadMs": 453.8941669743508,
"totalMs": 81113.67945896927,
"grade": "slow",
"device": "cpu",
"precision": "fp32",
"provider": "MLX CPU",
"acceleration": "cpu",
"engine": "mlx-audio-plus",
"version": "0.1.8+ce39134c",
"mlxVersion": "0.31.1",
"artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
"fallback": false
}
}
]CosyVoice 3 · 0.5B · 2512 · RL
6 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 5295 ms / 532 ms | 0.607 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1992 ms / 532 ms | 0.682 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3179 ms / 532 ms | 0.819 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 54368 ms / 628 ms | 19.699 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 180309 ms / 628 ms | 19.771 RTF |
FP32 | cpu | Passed | Slow | macos · aarch64 | 90353 ms / 628 ms | 23.049 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-14T10:25:40.615348+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2" }
- Runtime
- mlx-audio-plus 0.1.8+ce39134c
- Artifact revision
- e13102ae60a1f350cad1960051acf3811c489ccb
- Fixture
{ "file": "model-samples/desktop/chatterbox-reference-input.wav", "size": 314924, "sha1": "5242ae44bc9dc9c91a28ab108af9cb51d88a5246", "sha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe", "url": "https://assets.localai.tools/samples/v1/files/a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe/chatterbox-reference-input.wav" }- Rerun when
- artifact revision; runtime source/dependencies; fixture bytes; quality gate; inference code
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"asrText": " Hello, this is a local speech synthesis test.",
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"inferenceMs": 1991.9540000264533,
"durationMs": 1992.5379159976728,
"audioSeconds": 2.92,
"audioSecondsPerSecond": 1.4658973048379742,
"realTimeFactor": 0.6821760274063197,
"firstChunkMs": 979.5292500057258,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3730399440,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.03468957170844078,
"clippedFraction": 0,
"loadMs": 532.193083956372,
"provider": "MLX Metal",
"artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
"version": "0.1.8+ce39134c",
"device": "mps",
"precision": "fp16",
"totalMs": 2524.730999954045,
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"asrText": " The meeting starts at 9.30. Please bring three notebooks.",
"wordErrorRate": 0.2,
"maximumWordErrorRate": 0.2
},
"runtime": {
"inferenceMs": 3178.6988329840824,
"durationMs": 3179.3967909761705,
"audioSeconds": 3.88,
"audioSecondsPerSecond": 1.2206252318523532,
"realTimeFactor": 0.8192522765422893,
"firstChunkMs": 956.8867500056513,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 3784074088,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.04117831215262413,
"clippedFraction": 0,
"loadMs": 532.193083956372,
"provider": "MLX Metal",
"artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
"version": "0.1.8+ce39134c",
"device": "mps",
"precision": "fp16",
"totalMs": 3711.5898749325424,
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"asrText": " Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"inferenceMs": 5295.209417003207,
"durationMs": 5296.800083015114,
"audioSeconds": 8.72,
"audioSecondsPerSecond": 1.6467715086016437,
"realTimeFactor": 0.6072487863535788,
"firstChunkMs": 944.6944580413401,
"chunks": 4,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(gpu, 0)",
"dispatchStream": "Stream(Device(gpu, 0), 0)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float16",
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4292726524,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.044313348829746246,
"clippedFraction": 0,
"loadMs": 532.193083956372,
"provider": "MLX Metal",
"artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
"version": "0.1.8+ce39134c",
"device": "mps",
"precision": "fp16",
"totalMs": 5828.993166971486,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"asrText": " Hello, this is a local speech synthesis test.",
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"inferenceMs": 54368.06216696277,
"durationMs": 54368.72066697106,
"audioSeconds": 2.76,
"audioSecondsPerSecond": 0.05076509792686961,
"realTimeFactor": 19.698573248899557,
"firstChunkMs": 26704.15658300044,
"chunks": 2,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4730616069,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.036379624158144,
"clippedFraction": 0,
"loadMs": 628.1056249863468,
"provider": "MLX CPU",
"artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
"version": "0.1.8+ce39134c",
"device": "cpu",
"precision": "fp32",
"totalMs": 54996.826291957404,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"asrText": " The meeting starts at 9.30. Please bring three notebooks.",
"wordErrorRate": 0.2,
"maximumWordErrorRate": 0.2
},
"runtime": {
"inferenceMs": 90353.42737502651,
"durationMs": 90354.10883300938,
"audioSeconds": 3.92,
"audioSecondsPerSecond": 0.04338518320649205,
"realTimeFactor": 23.049343718119008,
"firstChunkMs": 18746.6163749923,
"chunks": 3,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 4818508749,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.05708228424191475,
"clippedFraction": 0,
"loadMs": 628.1056249863468,
"provider": "MLX CPU",
"artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
"version": "0.1.8+ce39134c",
"device": "cpu",
"precision": "fp32",
"totalMs": 90982.21445799572,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"asrText": " Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"inferenceMs": 180309.13850001525,
"durationMs": 180317.48616701225,
"audioSeconds": 9.12,
"audioSecondsPerSecond": 0.05057979909320696,
"realTimeFactor": 19.77073887061571,
"firstChunkMs": 19925.255417008884,
"chunks": 4,
"seed": 42,
"referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
"placement": {
"dispatchDevice": "Device(cpu, 0)",
"dispatchStream": "Stream(Device(cpu, 0), 1)",
"neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
"parameterDtypes": [
"mlx.core.float32"
]
},
"mlxPeakMemoryBytes": 5325348485,
"memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
"rms": 0.04648175463080406,
"clippedFraction": 0,
"loadMs": 628.1056249863468,
"provider": "MLX CPU",
"artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
"version": "0.1.8+ce39134c",
"device": "cpu",
"precision": "fp32",
"totalMs": 180945.5917919986,
"grade": "slow"
}
}
]