Nemotron ASR 3.5
Transcribe local audio progressively with NVIDIA’s multilingual RNNT model. Returns complete text, approximate word-level timestamps and the native recognition result.
Desktop app
Run Nemotron ASR 3.5 on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Nemotron 3.5 ASR Streaming 0.6B
26 configurations testedQuality criteria
{ "version": 2, "scope": "Cleared English file-input suite: clean JFK, synthetic short speech, shifted start, exact silence, deterministic noise and assembled two-source recording. No human timestamp or diarization certification.", "maximumRealTimeFactor": 1, "maximumFirstTextMs": 3000, "maximumConsecutiveRepeatedWords": 3, "minimumWordTimingCoverage": 1, "maximumNativeEndOverrunSeconds": 0.16, "maximumMedianShiftErrorSeconds": 0.24, "minimumCorrespondingWordFraction": 0.8, "minimumIndependentColdStarts": 3, "minimumTimedWarmRuns": 5, "engine": "NeMo-Speech.cpp 0.3.0 C ABI, official Q8_0", "runtimeOutput": "Complete native alternatives, final marker, audio processed, channel, languages and word offsets; no fabricated token arrays." }
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 2541 ms / 0 ms | 0.073 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 797 ms / 0 ms | 0.074 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 852 ms / 0 ms | 0.075 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 816 ms / 0 ms | 0.075 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 823 ms / 0 ms | 0.076 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 828 ms / 0 ms | 0.076 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 830 ms / 0 ms | 0.077 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 839 ms / 0 ms | 0.077 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 866 ms / 108 ms | 0.080 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 875 ms / 101 ms | 0.081 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 886 ms / 18125 ms | 0.082 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 161 ms / 0 ms | 0.082 RTF |
Q8 | metalAccelerated | Passed | Very fast | macos · aarch64 | 287 ms / 0 ms | 0.086 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1008 ms / 0 ms | 0.089 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 985 ms / 0 ms | 0.091 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 985 ms / 0 ms | 0.091 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 988 ms / 45 ms | 0.091 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1003 ms / 0 ms | 0.093 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 3268 ms / 0 ms | 0.093 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1010 ms / 0 ms | 0.093 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1020 ms / 47 ms | 0.094 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1027 ms / 49 ms | 0.095 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1029 ms / 0 ms | 0.095 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 1060 ms / 0 ms | 0.098 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 331 ms / 0 ms | 0.099 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 197 ms / 0 ms | 0.100 RTF |
Test setup & sample details
- Quality gate
- { "version": 2, "scope": "Cleared English file-input suite: clean JFK, synthetic short speech, shifted start, exact silence, deterministic noise and assembled two-source recording. No human timestamp or diarization certification.", "maximumRealTimeFactor": 1, "maximumFirstTextMs": 3000, "maximumConsecutiveRepeatedWords": 3, "minimumWordTimingCoverage": 1, "maximumNativeEndOverrunSeconds": 0.16, "maximumMedianShiftErrorSeconds": 0.24, "minimumCorrespondingWordFraction": 0.8, "minimumIndependentColdStarts": 3, "minimumTimedWarmRuns": 5, "engine": "NeMo-Speech.cpp 0.3.0 C ABI, official Q8_0", "runtimeOutput": "Complete native alternatives, final marker, audio processed, channel, languages and word offsets; no fabricated token arrays." }
- Tested
- 2026-11-03T01:35:08.493073+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtimeProvisioning": "App-owned isolated CPython probe interpreter, standard-library ctypes only. Managed packaged provisioning tested separately." }
- Runtime
- nemo-speech.cpp 0.3.0
- Artifact revision
- ea30d66debe3740a08b573244286791d423d6b3e
- Fixture
{ "file": "model-samples/vosk-jfk.flac", "size": 1152693, "sha1": "537ddf75dff344f8d31c1cd6ebee23ee8362d921", "sha256": "63a4b1e4c1dc655ac70961ffbf518acd249df237e5a0152faae9a4a836949715", "url": "https://assets.localai.tools/samples/v1/files/63a4b1e4c1dc655ac70961ffbf518acd249df237e5a0152faae9a4a836949715/vosk-jfk.flac" }- Rerun when
- Checkpoint/runtime archive or helper revision changes; Audio decode or chunking changes; Fixture checksum, locale, quality gate or backend behavior changes
Per-case quality & failure details
[
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 48.931917001027614,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1040.7162079936825,
"inferenceMs": 1027.1034640609287,
"firstTextMs": 165.27933298493735,
"realTimeFactor": 0.09461056436306205,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1119.5833329984453,
"totalMs": 1089.64812499471,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 9,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 335.980167001253,
"inferenceMs": 331.18762393132783,
"firstTextMs": 61.044041998684406,
"realTimeFactor": 0.09881769617683911,
"audioBlocks": 11,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 3.4000000953674316,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 362.4402080022264,
"totalMs": 335.980167001253,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"correspondingWordFraction": 1,
"medianLeadingSilenceWordShiftErrorSeconds": 0.020000000000000018,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1023.8469590258319,
"inferenceMs": 1007.9804169363342,
"firstTextMs": 147.93712500249967,
"realTimeFactor": 0.08903017035007234,
"audioBlocks": 36,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11.5,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1103.8622499909252,
"totalMs": 1023.8469590258319,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 0,
"maximumConsecutiveRepeatedWords": 0,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 199.1477089759428,
"inferenceMs": 197.2094159864355,
"firstTextMs": null,
"realTimeFactor": 0.0995738544879714,
"audioBlocks": 7,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 2,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 202.09891599370167,
"totalMs": 199.1477089759428,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0.025,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 78,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 3313.7776250077877,
"inferenceMs": 3267.593871918507,
"firstTextMs": 164.5396669919137,
"realTimeFactor": 0.09296775788628045,
"audioBlocks": 112,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 35.64437484741211,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 3549.8319160251413,
"totalMs": 3313.7776250077877,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0.045454545454545456,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 997.863333002897,
"inferenceMs": 984.5336659927852,
"firstTextMs": 118.06249999790452,
"realTimeFactor": 0.09064892196610619,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11.008000373840332,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1052.4210000003222,
"totalMs": 997.863333002897,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 998.331041977508,
"inferenceMs": 984.6343310200609,
"firstTextMs": 119.72466699080542,
"realTimeFactor": 0.09075736745250072,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1077.6276249962393,
"totalMs": 998.331041977508,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1023.5480839910451,
"inferenceMs": 1009.7902911074925,
"firstTextMs": 117.18166701029986,
"realTimeFactor": 0.09304982581736775,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1100.2071670081932,
"totalMs": 1023.5480839910451,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1042.8899170074146,
"inferenceMs": 1029.014624946285,
"firstTextMs": 140.3374579967931,
"realTimeFactor": 0.09480817427340132,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1120.9884580166545,
"totalMs": 1042.8899170074146,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1074.2311250069179,
"inferenceMs": 1060.242626030231,
"firstTextMs": 118.03645800682716,
"realTimeFactor": 0.09765737500062889,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1152.152833994478,
"totalMs": 1074.2311250069179,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1018.0061249993742,
"inferenceMs": 1003.2498350774404,
"firstTextMs": 121.3847920007538,
"realTimeFactor": 0.09254601136357947,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1094.9249170080293,
"totalMs": 1018.0061249993742,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 45.26295801042579,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1003.1881250033621,
"inferenceMs": 988.2437080086675,
"firstTextMs": 161.2908749957569,
"realTimeFactor": 0.0911989204548511,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1081.0973749903496,
"totalMs": 1048.4510830137879,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 46.75412498181686,
"provider": "CPU",
"device": "cpu",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "cpu",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=CPU",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 1033.7797499960288,
"inferenceMs": 1020.0524199754,
"firstTextMs": 159.16333298082463,
"realTimeFactor": 0.09397997727236626,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 1111.806125001749,
"totalMs": 1080.5338749778457,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 18125.487957993755,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 898.2600410236046,
"inferenceMs": 886.3002918369602,
"firstTextMs": 155.75520801940002,
"realTimeFactor": 0.0816600037294186,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 974.060875014402,
"totalMs": 19023.74799901736,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 9,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 290.74145801132545,
"inferenceMs": 286.7385850404389,
"firstTextMs": 53.22491700644605,
"realTimeFactor": 0.08551219353274278,
"audioBlocks": 11,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 3.4000000953674316,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 315.568042016821,
"totalMs": 290.74145801132545,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"correspondingWordFraction": 1,
"medianLeadingSilenceWordShiftErrorSeconds": 0.020000000000000018,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 866.1377920070663,
"inferenceMs": 852.4712940561585,
"firstTextMs": 127.33937500161119,
"realTimeFactor": 0.07531632973974489,
"audioBlocks": 36,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11.5,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 942.4533749988768,
"totalMs": 866.1377920070663,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 0,
"maximumConsecutiveRepeatedWords": 0,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 163.40762499021366,
"inferenceMs": 161.29195896792226,
"firstTextMs": null,
"realTimeFactor": 0.08170381249510683,
"audioBlocks": 7,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 2,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 166.64220800157636,
"totalMs": 163.40762499021366,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0.025,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 78,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 2587.1888749825303,
"inferenceMs": 2541.1905748187564,
"firstTextMs": 146.5136659971904,
"realTimeFactor": 0.07258337044716116,
"audioBlocks": 112,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 35.64437484741211,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 2825.7239579979796,
"totalMs": 2587.1888749825303,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0.045454545454545456,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 810.2887909917627,
"inferenceMs": 797.3716650158167,
"firstTextMs": 93.66512499400415,
"realTimeFactor": 0.07360908348399006,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11.008000373840332,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 864.7282090096269,
"totalMs": 810.2887909917627,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 840.7730839971919,
"inferenceMs": 827.9981248488184,
"firstTextMs": 104.3352090055123,
"realTimeFactor": 0.07643391672701744,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 916.926332982257,
"totalMs": 840.7730839971919,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 842.8447080077603,
"inferenceMs": 830.3128329280298,
"firstTextMs": 102.11775000789203,
"realTimeFactor": 0.07662224618252367,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 918.9952919841744,
"totalMs": 842.8447080077603,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 828.61416702508,
"inferenceMs": 816.4698349719401,
"firstTextMs": 100.32654201495461,
"realTimeFactor": 0.07532856063864363,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 905.8215410041157,
"totalMs": 828.61416702508,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 835.62837500358,
"inferenceMs": 823.3563739340752,
"firstTextMs": 101.7240000073798,
"realTimeFactor": 0.07596621590941637,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 912.0962919841986,
"totalMs": 835.62837500358,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 0,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 851.0567079938482,
"inferenceMs": 838.5762089747004,
"firstTextMs": 103.81729097571224,
"realTimeFactor": 0.07736879163580439,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 926.8837080162484,
"totalMs": 851.0567079938482,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 101.30887498962693,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 887.851707986556,
"inferenceMs": 875.4843358765356,
"firstTextMs": 149.77625000756234,
"realTimeFactor": 0.08071379163514146,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 964.6469579893164,
"totalMs": 989.1605829761829,
"fallback": false,
"grade": "fast"
}
},
{
"precision": "q8",
"device": "metal",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"finiteOrderedTimes": true,
"wordReconstruction": true,
"completeNativeFinal": true,
"wordCount": 22,
"maximumConsecutiveRepeatedWords": 1,
"passed": true,
"provisionalStreamObserved": true
},
"runtime": {
"engine": "nemo-speech.cpp",
"version": "0.3.0",
"loadMs": 107.6443339989055,
"provider": "MTL0",
"device": "metal",
"precision": "q8",
"cpuThreads": 8,
"acceleration": "partial",
"nativeBackendLog": "[asr] model=nemotron-3.5-asr-streaming-0.6b.q8_0 head=rnnt backend=MTL0",
"accelerationDetails": "Pinned CPU-only or Metal release and strict native backend index. Audio feature extraction and text postprocessing run on CPU.",
"durationMs": 879.0844160248525,
"inferenceMs": 865.5332499183714,
"firstTextMs": 156.39650000957772,
"realTimeFactor": 0.07991676509316842,
"audioBlocks": 35,
"inputBlockSamples": 5120,
"nativeFinalAudioProcessed": 11,
"timestampSource": "NeMo-Speech.cpp RNNT native word offsets",
"artifactRevision": "ea30d66debe3740a08b573244286791d423d6b3e",
"runtimeRevision": "20999cc921d2b14aa58708f61756a8b2e787ba20",
"runtimeCodeSha256": "a38cb39e1ab82c4bbe1a9f3eb5bf7439a4fea38a0413c620b7033351d2cb2853",
"requestWallMs": 959.0753330267034,
"totalMs": 986.728750023758,
"fallback": false,
"grade": "fast"
}
}
]