A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

Nemotron ASR 3.5

Transcribe local audio progressively with NVIDIA’s multilingual RNNT model. Returns complete text, approximate word-level timestamps and the native recognition result.

Desktop inferencePrivate · Runs on your computer
About this model

Transcribe local audio progressively with NVIDIA’s multilingual RNNT model. Returns complete text, approximate word-level timestamps and the native recognition result.

Created by
NVIDIA
Model released
Jun 4, 2026
Source repository created
May 15, 2026
Model weights · Q8
741.3 MB

Best for

  • Generate editable captions from short recordings
  • Navigate audio with approximate word timings
  • Compare local streaming ASR on compatible hardware

Keep in mind

  • Speech, names, numbers and punctuation can be misrecognized or omitted. Review output, especially with noise, overlap, accents or music; do not rely on it for consequential decisions.
  • The measured suite is English only. The locale selector includes NVIDIA’s 32 out-of-box locales plus auto; it does not certify each language. Adaptation-only locales are excluded.
  • This adapter streams a complete mono 16 kHz PCM input of 400–1,920,000 samples (up to 120 seconds) through the native encoder. It does not accept a live microphone stream, return diarization or translate.
  • Native word offsets are approximate. Confidence fields preserve the runtime values and are not calibrated probabilities. Interim snapshots can change; use the final word timings for subtitles.
  • Original NVIDIA Q8_0 GGUF contains mixed Q8_0, F16 and F32 tensors. It is one checkpoint and one quantization, with separately measured CPU and Metal builds.
  • Metal uses GPU neural execution with CPU feature extraction and postprocessing. First Metal startup can be much slower than CPU on short recordings. Only the measured Mac is verified.
  • OpenMDW 1.1 is recorded as an SPDX LicenseRef because no standard SPDX identifier is available for this exact license.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

Q8 · cpu (verified platform only)

Sources & technical details
Original model
https://huggingface.co/nvidia/nemotron-3.5-asr-streaming-0.6b
Release verification
Verified
Release evidence
Official model card dates the original Hugging Face checkpoint release June 4, 2026. Repository creation and later GGUF/runtime releases are separate.
Source updated
Sep 10, 2026
Native model files
https://huggingface.co/nvidia/nemotron-3.5-asr-streaming-0.6b
Files updated
Sep 10, 2026
Artifact revision
ea30d66debe3740a08b573244286791d423d6b3e

Desktop app

Sample result

Nemotron 3.5 ASR Streaming 0.6B

Run Nemotron ASR 3.5 on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / Q8Tested8.0 GiBRAM estimate
macOS Apple SiliconMETAL / Q8Tested8.0 GiBRAM estimate
Windows Intel / AMDCPU / Q8Unverified8.0 GiBRAM estimate
macOS Intel / AMDCPU / Q8Unverified8.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

Nemotron 3.5 ASR Streaming 0.6B

26 configurations tested
Passed26
Failed0
TestedNov 3, 2026
Runtimenemo-speech.cpp 0.3.0

Quality criteria

{ "version": 2, "scope": "Cleared English file-input suite: clean JFK, synthetic short speech, shifted start, exact silence, deterministic noise and assembled two-source recording. No human timestamp or diarization certification.", "maximumRealTimeFactor": 1, "maximumFirstTextMs": 3000, "maximumConsecutiveRepeatedWords": 3, "minimumWordTimingCoverage": 1, "maximumNativeEndOverrunSeconds": 0.16, "maximumMedianShiftErrorSeconds": 0.24, "minimumCorrespondingWordFraction": 0.8, "minimumIndependentColdStarts": 3, "minimumTimedWarmRuns": 5, "engine": "NeMo-Speech.cpp 0.3.0 C ABI, official Q8_0", "runtimeOutput": "Complete native alternatives, final marker, audio processed, channel, languages and word offsets; no fabricated token arrays." }

PrecisionDeviceResultPlatformInference / loadTask metric
Q8metalAcceleratedPassedVery fastmacos · aarch642541 ms / 0 ms0.073 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64797 ms / 0 ms0.074 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64852 ms / 0 ms0.075 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64816 ms / 0 ms0.075 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64823 ms / 0 ms0.076 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64828 ms / 0 ms0.076 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64830 ms / 0 ms0.077 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64839 ms / 0 ms0.077 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64866 ms / 108 ms0.080 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64875 ms / 101 ms0.081 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64886 ms / 18125 ms0.082 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64161 ms / 0 ms0.082 RTF
Q8metalAcceleratedPassedVery fastmacos · aarch64287 ms / 0 ms0.086 RTF
Q8cpuPassedVery fastmacos · aarch641008 ms / 0 ms0.089 RTF
Q8cpuPassedVery fastmacos · aarch64985 ms / 0 ms0.091 RTF
Q8cpuPassedVery fastmacos · aarch64985 ms / 0 ms0.091 RTF
Q8cpuPassedVery fastmacos · aarch64988 ms / 45 ms0.091 RTF
Q8cpuPassedVery fastmacos · aarch641003 ms / 0 ms0.093 RTF
Q8cpuPassedVery fastmacos · aarch643268 ms / 0 ms0.093 RTF
Q8cpuPassedVery fastmacos · aarch641010 ms / 0 ms0.093 RTF
Q8cpuPassedVery fastmacos · aarch641020 ms / 47 ms0.094 RTF
Q8cpuPassedVery fastmacos · aarch641027 ms / 49 ms0.095 RTF
Q8cpuPassedVery fastmacos · aarch641029 ms / 0 ms0.095 RTF
Q8cpuPassedVery fastmacos · aarch641060 ms / 0 ms0.098 RTF
Q8cpuPassedVery fastmacos · aarch64331 ms / 0 ms0.099 RTF
Q8cpuPassedVery fastmacos · aarch64197 ms / 0 ms0.100 RTF
Test setup & sample details
Quality gate
{ "version": 2, "scope": "Cleared English file-input suite: clean JFK, synthetic short speech, shifted start, exact silence, deterministic noise and assembled two-source recording. No human timestamp or diarization certification.", "maximumRealTimeFactor": 1, "maximumFirstTextMs": 3000, "maximumConsecutiveRepeatedWords": 3, "minimumWordTimingCoverage": 1, "maximumNativeEndOverrunSeconds": 0.16, "maximumMedianShiftErrorSeconds": 0.24, "minimumCorrespondingWordFraction": 0.8, "minimumIndependentColdStarts": 3, "minimumTimedWarmRuns": 5, "engine": "NeMo-Speech.cpp 0.3.0 C ABI, official Q8_0", "runtimeOutput": "Complete native alternatives, final marker, audio processed, channel, languages and word offsets; no fabricated token arrays." }
Tested
2026-11-03T01:35:08.493073+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtimeProvisioning": "App-owned isolated CPython probe interpreter, standard-library ctypes only. Managed packaged provisioning tested separately." }
Runtime
nemo-speech.cpp 0.3.0
Artifact revision
ea30d66debe3740a08b573244286791d423d6b3e
Fixture
{
  "file": "model-samples/vosk-jfk.flac",
  "size": 1152693,
  "sha1": "537ddf75dff344f8d31c1cd6ebee23ee8362d921",
  "sha256": "63a4b1e4c1dc655ac70961ffbf518acd249df237e5a0152faae9a4a836949715",
  "url": "https://assets.localai.tools/samples/v1/files/63a4b1e4c1dc655ac70961ffbf518acd249df237e5a0152faae9a4a836949715/vosk-jfk.flac"
}
Rerun when
Checkpoint/runtime archive or helper revision changes; Audio decode or chunking changes; Fixture checksum, locale, quality gate or backend behavior changes
Per-case quality & failure details
[
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 48.931917001027614,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1040.7162079936825,
      "inferenceMs": 1027.1034640609287,
      "firstTextMs": 165.27933298493735,
      "realTimeFactor": 0.09461056436306205,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1119.5833329984453,
      "totalMs": 1089.64812499471,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 9,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 335.980167001253,
      "inferenceMs": 331.18762393132783,
      "firstTextMs": 61.044041998684406,
      "realTimeFactor": 0.09881769617683911,
      "audioBlocks": 11,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 3.4000000953674316,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 362.4402080022264,
      "totalMs": 335.980167001253,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "correspondingWordFraction": 1,
      "medianLeadingSilenceWordShiftErrorSeconds": 0.020000000000000018,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1023.8469590258319,
      "inferenceMs": 1007.9804169363342,
      "firstTextMs": 147.93712500249967,
      "realTimeFactor": 0.08903017035007234,
      "audioBlocks": 36,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11.5,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1103.8622499909252,
      "totalMs": 1023.8469590258319,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 0,
      "maximumConsecutiveRepeatedWords": 0,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 199.1477089759428,
      "inferenceMs": 197.2094159864355,
      "firstTextMs": null,
      "realTimeFactor": 0.0995738544879714,
      "audioBlocks": 7,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 2,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 202.09891599370167,
      "totalMs": 199.1477089759428,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0.025,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 78,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 3313.7776250077877,
      "inferenceMs": 3267.593871918507,
      "firstTextMs": 164.5396669919137,
      "realTimeFactor": 0.09296775788628045,
      "audioBlocks": 112,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 35.64437484741211,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 3549.8319160251413,
      "totalMs": 3313.7776250077877,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0.045454545454545456,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 997.863333002897,
      "inferenceMs": 984.5336659927852,
      "firstTextMs": 118.06249999790452,
      "realTimeFactor": 0.09064892196610619,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11.008000373840332,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1052.4210000003222,
      "totalMs": 997.863333002897,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 998.331041977508,
      "inferenceMs": 984.6343310200609,
      "firstTextMs": 119.72466699080542,
      "realTimeFactor": 0.09075736745250072,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1077.6276249962393,
      "totalMs": 998.331041977508,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1023.5480839910451,
      "inferenceMs": 1009.7902911074925,
      "firstTextMs": 117.18166701029986,
      "realTimeFactor": 0.09304982581736775,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1100.2071670081932,
      "totalMs": 1023.5480839910451,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1042.8899170074146,
      "inferenceMs": 1029.014624946285,
      "firstTextMs": 140.3374579967931,
      "realTimeFactor": 0.09480817427340132,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1120.9884580166545,
      "totalMs": 1042.8899170074146,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1074.2311250069179,
      "inferenceMs": 1060.242626030231,
      "firstTextMs": 118.03645800682716,
      "realTimeFactor": 0.09765737500062889,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1152.152833994478,
      "totalMs": 1074.2311250069179,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1018.0061249993742,
      "inferenceMs": 1003.2498350774404,
      "firstTextMs": 121.3847920007538,
      "realTimeFactor": 0.09254601136357947,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1094.9249170080293,
      "totalMs": 1018.0061249993742,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 45.26295801042579,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1003.1881250033621,
      "inferenceMs": 988.2437080086675,
      "firstTextMs": 161.2908749957569,
      "realTimeFactor": 0.0911989204548511,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1081.0973749903496,
      "totalMs": 1048.4510830137879,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 46.75412498181686,
      "provider": "CPU",
      "device": "cpu",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "cpu",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 1033.7797499960288,
      "inferenceMs": 1020.0524199754,
      "firstTextMs": 159.16333298082463,
      "realTimeFactor": 0.09397997727236626,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 1111.806125001749,
      "totalMs": 1080.5338749778457,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 18125.487957993755,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 898.2600410236046,
      "inferenceMs": 886.3002918369602,
      "firstTextMs": 155.75520801940002,
      "realTimeFactor": 0.0816600037294186,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 974.060875014402,
      "totalMs": 19023.74799901736,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 9,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 290.74145801132545,
      "inferenceMs": 286.7385850404389,
      "firstTextMs": 53.22491700644605,
      "realTimeFactor": 0.08551219353274278,
      "audioBlocks": 11,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 3.4000000953674316,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 315.568042016821,
      "totalMs": 290.74145801132545,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "correspondingWordFraction": 1,
      "medianLeadingSilenceWordShiftErrorSeconds": 0.020000000000000018,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 866.1377920070663,
      "inferenceMs": 852.4712940561585,
      "firstTextMs": 127.33937500161119,
      "realTimeFactor": 0.07531632973974489,
      "audioBlocks": 36,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11.5,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 942.4533749988768,
      "totalMs": 866.1377920070663,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 0,
      "maximumConsecutiveRepeatedWords": 0,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 163.40762499021366,
      "inferenceMs": 161.29195896792226,
      "firstTextMs": null,
      "realTimeFactor": 0.08170381249510683,
      "audioBlocks": 7,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 2,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 166.64220800157636,
      "totalMs": 163.40762499021366,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0.025,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 78,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 2587.1888749825303,
      "inferenceMs": 2541.1905748187564,
      "firstTextMs": 146.5136659971904,
      "realTimeFactor": 0.07258337044716116,
      "audioBlocks": 112,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 35.64437484741211,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 2825.7239579979796,
      "totalMs": 2587.1888749825303,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0.045454545454545456,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 810.2887909917627,
      "inferenceMs": 797.3716650158167,
      "firstTextMs": 93.66512499400415,
      "realTimeFactor": 0.07360908348399006,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11.008000373840332,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 864.7282090096269,
      "totalMs": 810.2887909917627,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 840.7730839971919,
      "inferenceMs": 827.9981248488184,
      "firstTextMs": 104.3352090055123,
      "realTimeFactor": 0.07643391672701744,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 916.926332982257,
      "totalMs": 840.7730839971919,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 842.8447080077603,
      "inferenceMs": 830.3128329280298,
      "firstTextMs": 102.11775000789203,
      "realTimeFactor": 0.07662224618252367,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 918.9952919841744,
      "totalMs": 842.8447080077603,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 828.61416702508,
      "inferenceMs": 816.4698349719401,
      "firstTextMs": 100.32654201495461,
      "realTimeFactor": 0.07532856063864363,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 905.8215410041157,
      "totalMs": 828.61416702508,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 835.62837500358,
      "inferenceMs": 823.3563739340752,
      "firstTextMs": 101.7240000073798,
      "realTimeFactor": 0.07596621590941637,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 912.0962919841986,
      "totalMs": 835.62837500358,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 0,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 851.0567079938482,
      "inferenceMs": 838.5762089747004,
      "firstTextMs": 103.81729097571224,
      "realTimeFactor": 0.07736879163580439,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 926.8837080162484,
      "totalMs": 851.0567079938482,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 101.30887498962693,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 887.851707986556,
      "inferenceMs": 875.4843358765356,
      "firstTextMs": 149.77625000756234,
      "realTimeFactor": 0.08071379163514146,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 964.6469579893164,
      "totalMs": 989.1605829761829,
      "fallback": false,
      "grade": "fast"
    }
  },
  {
    "precision": "q8",
    "device": "metal",
    "status": "pass",
    "quality": {
      "wordErrorRate": 0,
      "finiteOrderedTimes": true,
      "wordReconstruction": true,
      "completeNativeFinal": true,
      "wordCount": 22,
      "maximumConsecutiveRepeatedWords": 1,
      "passed": true,
      "provisionalStreamObserved": true
    },
    "runtime": {
      "engine": "nemo-speech.cpp",
      "version": "0.3.0",
      "loadMs": 107.6443339989055,
      "provider": "MTL0",
      "device": "metal",
      "precision": "q8",
      "cpuThreads": 8,
      "acceleration": "partial",
      "nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
      "accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
      "durationMs": 879.0844160248525,
      "inferenceMs": 865.5332499183714,
      "firstTextMs": 156.39650000957772,
      "realTimeFactor": 0.07991676509316842,
      "audioBlocks": 35,
      "inputBlockSamples": 5120,
      "nativeFinalAudioProcessed": 11,
      "timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
      "artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
      "runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
      "runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
      "requestWallMs": 959.0753330267034,
      "totalMs": 986.728750023758,
      "fallback": false,
      "grade": "fast"
    }
  }
]

Something not quite right?

Tell us what happened with Nemotron ASR 3.5. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.