A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

CosyVoice 3

Generate speech with a reference recording on Apple Silicon. English intelligibility measured locally; returns mono 24 kHz WAV with incremental audio chunks.

Desktop inferencePrivate · Runs on your computer
About this model

Generate speech with a reference recording on Apple Silicon. English intelligibility measured locally; returns mono 24 kHz WAV with incremental audio chunks.

Created by
FunAudioLLM
License
Apache-2.0
Model released
Dec 15, 2025
Source repository created
Dec 11, 2025
Model weights · FP16
2.7 GB

Best for

  • Local narration drafts with an authorized reference voice
  • English speech synthesis and accessibility experiments

Keep in mind

  • English fixtures only; other languages, accents, emotion and voice similarity remain unverified. Review pronunciation and meaning.
  • Requires 2–30 seconds of clear reference speech. Noise, music, poor recording quality and mismatched language may reduce quality.
  • Synthetic speech may mislead; obtain voice rights and disclose synthetic output. No medical, legal or safety-critical guarantees.
  • Only reference-audio conditioning is exposed; no instruction mode, voice conversion, SSML or transcript-conditioned mode.
  • CPU fallback is much slower than Metal and misses the initial streaming speed target. Apple M3 Max/macOS27.2 is the local test scope; other platforms are unverified.
  • The 0.5B name describes the language model; download includes flow/vocoder/speaker encoder and an additional speech tokenizer, approximately 2.7 GB.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP16 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/FunAudioLLM/Fun-CosyVoice3-0.5B-2512
Release verification
Verified
Release evidence
Official December15 release documentation identifies the exact Fun-CosyVoice3-0.5B-2512 base/RL release. Earlier HF staging uploads and May2025 paper are not used as the public checkpoint announcement.
Source updated
Feb 3, 2026
Native model files
https://huggingface.co/mlx-community/Fun-CosyVoice3-0.5B-2512-fp16
Files updated
Dec 17, 2025
Artifact revision
18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9

Desktop app

Sample result

CosyVoice 3 · 0.5B

Run CosyVoice 3 on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested16.0 GiBRAM estimate
macOS Apple SiliconMPS / FP16Tested16.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

CosyVoice 3 · 0.5B

25 configurations tested
Passed25
Failed0
TestedNov 4, 2026
Runtimemlx-audio-plus 0.1.8+ce39134c

Quality criteria

No explicit quality gate recorded. Review per-case evidence; full certification is pending.

PrecisionDeviceResultPlatformInference / loadTask metric
FP16mpsAcceleratedPassedFastmacos · aarch645839 ms / 0 ms0.579 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642062 ms / 0 ms0.586 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642065 ms / 0 ms0.587 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642065 ms / 0 ms0.587 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642070 ms / 0 ms0.588 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642071 ms / 0 ms0.588 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642074 ms / 0 ms0.589 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642076 ms / 0 ms0.590 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642081 ms / 0 ms0.591 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642087 ms / 0 ms0.593 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642087 ms / 0 ms0.593 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642089 ms / 0 ms0.593 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642091 ms / 0 ms0.594 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642093 ms / 0 ms0.595 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642094 ms / 0 ms0.595 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642101 ms / 638 ms0.597 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642118 ms / 0 ms0.602 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642140 ms / 297 ms0.608 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642142 ms / 310 ms0.609 RTF
FP16mpsAcceleratedPassedFastmacos · aarch642951 ms / 0 ms0.811 RTF
FP32cpuPassedSlowmacos · aarch64179729 ms / 0 ms18.045 RTF
FP32cpuPassedSlowmacos · aarch6488892 ms / 0 ms18.994 RTF
FP32cpuPassedSlowmacos · aarch6480659 ms / 454 ms22.657 RTF
FP32cpuPassedSlowmacos · aarch6480752 ms / 646 ms22.683 RTF
FP32cpuPassedSlowmacos · aarch6486970 ms / 517 ms24.430 RTF
Test setup & sample details
Quality gate
No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
Tested
2026-11-04T21:12:31.852494+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2" }
Runtime
mlx-audio-plus 0.1.8+ce39134c
Artifact revision
18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9
Fixture
{
  "file": "model-samples/desktop/chatterbox-reference-input.wav",
  "size": 314924,
  "sha1": "5242ae44bc9dc9c91a28ab108af9cb51d88a5246",
  "sha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
  "url": "https://assets.localai.tools/samples/v1/files/a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe/chatterbox-reference-input.wav"
}
Rerun when
artifact revision; runtime source/dependencies; fixture bytes; quality gate; inference code
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2140.0764590362087,
      "durationMs": 2140.802917012479,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6448010467743965,
      "realTimeFactor": 0.6079762667716502,
      "firstChunkMs": 993.1186669855379,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3762746594,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 297.47150000184774,
      "totalMs": 2438.274417014327,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2064.9140829918906,
      "durationMs": 2065.5576669960283,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.7046714093304114,
      "realTimeFactor": 0.5866233190317871,
      "firstChunkMs": 944.219124969095,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763107102,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2065.5576669960283,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2064.6239580237307,
      "durationMs": 2065.239375049714,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.7049109530673874,
      "realTimeFactor": 0.5865408971658326,
      "firstChunkMs": 936.6236670175567,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763107102,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2065.239375049714,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2086.8449169793166,
      "durationMs": 2087.445916957222,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.686756869837342,
      "realTimeFactor": 0.5928536695963967,
      "firstChunkMs": 954.2798339971341,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763107102,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2087.445916957222,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2117.694540997036,
      "durationMs": 2118.3857080177404,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6621849524826853,
      "realTimeFactor": 0.6016177673287033,
      "firstChunkMs": 942.778582975734,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763107102,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2118.3857080177404,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2070.5547500401735,
      "durationMs": 2071.3580829906277,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.700027492599123,
      "realTimeFactor": 0.5882257812614129,
      "firstChunkMs": 945.8095830050297,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763107102,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2071.3580829906277,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0.2,
      "maximumWordErrorRate": 0.2,
      "asrText": "The meeting starts at 9.30. Please bring three notebooks.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2950.979291985277,
      "durationMs": 2951.6762089915574,
      "audioSeconds": 3.64,
      "audioSecondsPerSecond": 1.2334888319569275,
      "realTimeFactor": 0.810708596699252,
      "firstChunkMs": 942.9038749658503,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3770136058,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03760986402630806,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2951.6762089915574,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 5838.829750020523,
      "durationMs": 5843.877875013277,
      "audioSeconds": 10.08,
      "audioSecondsPerSecond": 1.7263733370483307,
      "realTimeFactor": 0.5792489831369566,
      "firstChunkMs": 946.0897090029903,
      "chunks": 4,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4534014332,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.032798882573843,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 5843.877875013277,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2100.869624991901,
      "durationMs": 2101.5501670190133,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6754966410700376,
      "realTimeFactor": 0.5968379616454265,
      "firstChunkMs": 976.2080000364222,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3762755390,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 637.8450830234215,
      "totalMs": 2739.395250042435,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2091.384250030387,
      "durationMs": 2092.166709015146,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6830957773297066,
      "realTimeFactor": 0.5941432528495418,
      "firstChunkMs": 965.5318339937367,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763115962,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2092.166709015146,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2062.368874961976,
      "durationMs": 2063.1505419733003,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.7067751762229726,
      "realTimeFactor": 0.5859002485687431,
      "firstChunkMs": 940.5042919679545,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763115962,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2063.1505419733003,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2088.7039590161294,
      "durationMs": 2089.2894999706186,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6852555790903339,
      "realTimeFactor": 0.5933818065386731,
      "firstChunkMs": 937.6668339828029,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763115962,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2089.2894999706186,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2075.6134999683127,
      "durationMs": 2076.3074579881504,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6958841325968144,
      "realTimeFactor": 0.5896629261273616,
      "firstChunkMs": 951.8374169711024,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763115962,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2076.3074579881504,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2086.8957500206307,
      "durationMs": 2087.5505000003614,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.686715783462208,
      "realTimeFactor": 0.5928681108013155,
      "firstChunkMs": 962.5822500092909,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763115962,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2087.5505000003614,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2142.2654999769293,
      "durationMs": 2143.0477499961853,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6431203322080796,
      "realTimeFactor": 0.6085981534025368,
      "firstChunkMs": 988.4036249713972,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3762764186,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 309.81733300723135,
      "totalMs": 2452.8650830034167,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2069.742708001286,
      "durationMs": 2070.4493329976685,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.7006944807160125,
      "realTimeFactor": 0.5879950875003653,
      "firstChunkMs": 937.6084580435418,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763124662,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2070.4493329976685,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2092.6807079813443,
      "durationMs": 2093.373666983098,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6820530655130308,
      "realTimeFactor": 0.5945115647674274,
      "firstChunkMs": 952.0539999939501,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763124662,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2093.373666983098,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2074.1055840044282,
      "durationMs": 2074.733625049703,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.697117074051754,
      "realTimeFactor": 0.5892345409103489,
      "firstChunkMs": 950.5260000005364,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763124662,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2074.733625049703,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2093.7408750178292,
      "durationMs": 2094.3738750065677,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6812013568632391,
      "realTimeFactor": 0.5948127485846105,
      "firstChunkMs": 954.7310000052676,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763124662,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2094.3738750065677,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2081.1844999552704,
      "durationMs": 2081.875082978513,
      "audioSeconds": 3.52,
      "audioSecondsPerSecond": 1.6913445204284643,
      "realTimeFactor": 0.5912455965782019,
      "firstChunkMs": 952.0446250098757,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3763124662,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03765134513378143,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 2081.875082978513,
      "grade": "fast",
      "device": "mps",
      "precision": "fp16",
      "provider": "MLX Metal",
      "acceleration": "partial",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 86969.6428750176,
      "durationMs": 86970.90975003084,
      "audioSeconds": 3.56,
      "audioSecondsPerSecond": 0.04093382337002358,
      "realTimeFactor": 24.429674964892584,
      "firstChunkMs": 23667.464833008125,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4779701373,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.039496589452028275,
      "clippedFraction": 0,
      "loadMs": 516.7881249799393,
      "totalMs": 87487.69787501078,
      "grade": "slow",
      "device": "cpu",
      "precision": "fp32",
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0.2,
      "maximumWordErrorRate": 0.2,
      "asrText": "The meeting starts at 9.30. Please bring three notebooks.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 88891.84762502555,
      "durationMs": 88893.06945801945,
      "audioSeconds": 4.68,
      "audioSecondsPerSecond": 0.05264824756193332,
      "realTimeFactor": 18.99398453526187,
      "firstChunkMs": 18357.944417046383,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4887672109,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.04377385973930359,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 88893.06945801945,
      "grade": "slow",
      "device": "cpu",
      "precision": "fp32",
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 179728.8392080227,
      "durationMs": 179731.16645799018,
      "audioSeconds": 9.96,
      "audioSecondsPerSecond": 0.05541681593164938,
      "realTimeFactor": 18.04506417751232,
      "firstChunkMs": 18309.06529101776,
      "chunks": 4,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 5417272928,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.032228972762823105,
      "clippedFraction": 0,
      "loadMs": 0,
      "totalMs": 179731.16645799018,
      "grade": "slow",
      "device": "cpu",
      "precision": "fp32",
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 80752.06112500746,
      "durationMs": 80752.68304202473,
      "audioSeconds": 3.56,
      "audioSecondsPerSecond": 0.044085562032763176,
      "realTimeFactor": 22.683163237361647,
      "firstChunkMs": 18375.37700001849,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4779665985,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.039496589452028275,
      "clippedFraction": 0,
      "loadMs": 646.1042920127511,
      "totalMs": 81398.78733403748,
      "grade": "slow",
      "device": "cpu",
      "precision": "fp32",
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2,
      "asrText": "Hello, this is a local speech synthesis test.",
      "passed": true
    },
    "runtime": {
      "inferenceMs": 80659.16499996092,
      "durationMs": 80659.78529199492,
      "audioSeconds": 3.56,
      "audioSecondsPerSecond": 0.044136335901837374,
      "realTimeFactor": 22.65706882021374,
      "firstChunkMs": 18605.24499998428,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4779708801,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.039496589452028275,
      "clippedFraction": 0,
      "loadMs": 453.8941669743508,
      "totalMs": 81113.67945896927,
      "grade": "slow",
      "device": "cpu",
      "precision": "fp32",
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "engine": "mlx-audio-plus",
      "version": "0.1.8+ce39134c",
      "mlxVersion": "0.31.1",
      "artifactRevision": "18ccb7fbd7246e8cd3420d02f5dd28595cc0fcd9",
      "fallback": false
    }
  }
]

CosyVoice 3 · 0.5B · 2512 · RL

6 configurations tested
Passed6
Failed0
TestedNov 14, 2026
Runtimemlx-audio-plus 0.1.8+ce39134c

Quality criteria

No explicit quality gate recorded. Review per-case evidence; full certification is pending.

PrecisionDeviceResultPlatformInference / loadTask metric
FP16mpsAcceleratedPassedFastmacos · aarch645295 ms / 532 ms0.607 RTF
FP16mpsAcceleratedPassedFastmacos · aarch641992 ms / 532 ms0.682 RTF
FP16mpsAcceleratedPassedFastmacos · aarch643179 ms / 532 ms0.819 RTF
FP32cpuPassedSlowmacos · aarch6454368 ms / 628 ms19.699 RTF
FP32cpuPassedSlowmacos · aarch64180309 ms / 628 ms19.771 RTF
FP32cpuPassedSlowmacos · aarch6490353 ms / 628 ms23.049 RTF
Test setup & sample details
Quality gate
No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
Tested
2026-11-14T10:25:40.615348+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2" }
Runtime
mlx-audio-plus 0.1.8+ce39134c
Artifact revision
e13102ae60a1f350cad1960051acf3811c489ccb
Fixture
{
  "file": "model-samples/desktop/chatterbox-reference-input.wav",
  "size": 314924,
  "sha1": "5242ae44bc9dc9c91a28ab108af9cb51d88a5246",
  "sha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
  "url": "https://assets.localai.tools/samples/v1/files/a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe/chatterbox-reference-input.wav"
}
Rerun when
artifact revision; runtime source/dependencies; fixture bytes; quality gate; inference code
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "asrText": " Hello, this is a local speech synthesis test.",
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2
    },
    "runtime": {
      "inferenceMs": 1991.9540000264533,
      "durationMs": 1992.5379159976728,
      "audioSeconds": 2.92,
      "audioSecondsPerSecond": 1.4658973048379742,
      "realTimeFactor": 0.6821760274063197,
      "firstChunkMs": 979.5292500057258,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3730399440,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.03468957170844078,
      "clippedFraction": 0,
      "loadMs": 532.193083956372,
      "provider": "MLX Metal",
      "artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
      "version": "0.1.8+ce39134c",
      "device": "mps",
      "precision": "fp16",
      "totalMs": 2524.730999954045,
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "asrText": " The meeting starts at 9.30. Please bring three notebooks.",
      "wordErrorRate": 0.2,
      "maximumWordErrorRate": 0.2
    },
    "runtime": {
      "inferenceMs": 3178.6988329840824,
      "durationMs": 3179.3967909761705,
      "audioSeconds": 3.88,
      "audioSecondsPerSecond": 1.2206252318523532,
      "realTimeFactor": 0.8192522765422893,
      "firstChunkMs": 956.8867500056513,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 3784074088,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.04117831215262413,
      "clippedFraction": 0,
      "loadMs": 532.193083956372,
      "provider": "MLX Metal",
      "artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
      "version": "0.1.8+ce39134c",
      "device": "mps",
      "precision": "fp16",
      "totalMs": 3711.5898749325424,
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "asrText": " Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2
    },
    "runtime": {
      "inferenceMs": 5295.209417003207,
      "durationMs": 5296.800083015114,
      "audioSeconds": 8.72,
      "audioSecondsPerSecond": 1.6467715086016437,
      "realTimeFactor": 0.6072487863535788,
      "firstChunkMs": 944.6944580413401,
      "chunks": 4,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(gpu, 0)",
        "dispatchStream": "Stream(Device(gpu, 0), 0)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float16",
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4292726524,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.044313348829746246,
      "clippedFraction": 0,
      "loadMs": 532.193083956372,
      "provider": "MLX Metal",
      "artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
      "version": "0.1.8+ce39134c",
      "device": "mps",
      "precision": "fp16",
      "totalMs": 5828.993166971486,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "asrText": " Hello, this is a local speech synthesis test.",
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2
    },
    "runtime": {
      "inferenceMs": 54368.06216696277,
      "durationMs": 54368.72066697106,
      "audioSeconds": 2.76,
      "audioSecondsPerSecond": 0.05076509792686961,
      "realTimeFactor": 19.698573248899557,
      "firstChunkMs": 26704.15658300044,
      "chunks": 2,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4730616069,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.036379624158144,
      "clippedFraction": 0,
      "loadMs": 628.1056249863468,
      "provider": "MLX CPU",
      "artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
      "version": "0.1.8+ce39134c",
      "device": "cpu",
      "precision": "fp32",
      "totalMs": 54996.826291957404,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "asrText": " The meeting starts at 9.30. Please bring three notebooks.",
      "wordErrorRate": 0.2,
      "maximumWordErrorRate": 0.2
    },
    "runtime": {
      "inferenceMs": 90353.42737502651,
      "durationMs": 90354.10883300938,
      "audioSeconds": 3.92,
      "audioSecondsPerSecond": 0.04338518320649205,
      "realTimeFactor": 23.049343718119008,
      "firstChunkMs": 18746.6163749923,
      "chunks": 3,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 4818508749,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.05708228424191475,
      "clippedFraction": 0,
      "loadMs": 628.1056249863468,
      "provider": "MLX CPU",
      "artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
      "version": "0.1.8+ce39134c",
      "device": "cpu",
      "precision": "fp32",
      "totalMs": 90982.21445799572,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "asrText": " Welcome to the local audio library. You can listen without sending your text to a remote service. Please review the generated speech before sharing it.",
      "wordErrorRate": 0,
      "maximumWordErrorRate": 0.2
    },
    "runtime": {
      "inferenceMs": 180309.13850001525,
      "durationMs": 180317.48616701225,
      "audioSeconds": 9.12,
      "audioSecondsPerSecond": 0.05057979909320696,
      "realTimeFactor": 19.77073887061571,
      "firstChunkMs": 19925.255417008884,
      "chunks": 4,
      "seed": 42,
      "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe",
      "placement": {
        "dispatchDevice": "Device(cpu, 0)",
        "dispatchStream": "Stream(Device(cpu, 0), 1)",
        "neuralExecution": "MLX operations use selected default stream; inspected neural modules do not override to CPU",
        "parameterDtypes": [
          "mlx.core.float32"
        ]
      },
      "mlxPeakMemoryBytes": 5325348485,
      "memoryScope": "MLX allocator peak; not whole-process peak or minimum RAM",
      "rms": 0.04648175463080406,
      "clippedFraction": 0,
      "loadMs": 628.1056249863468,
      "provider": "MLX CPU",
      "artifactRevision": "e13102ae60a1f350cad1960051acf3811c489ccb",
      "version": "0.1.8+ce39134c",
      "device": "cpu",
      "precision": "fp32",
      "totalMs": 180945.5917919986,
      "grade": "slow"
    }
  }
]

Something not quite right?

Tell us what happened with CosyVoice 3. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.