RTMPose Hands
Estimate 21 hand landmarks in a single-hand image crop locally.
Desktop app
Run RTMPose Hands on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
RTMPose Hands Desktop
54 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | coreml | Passed | Very fast | macos · aarch64 | 6 ms / 992 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 6 ms / 992 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 6 ms / 992 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 6 ms / 972 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 6 ms / 972 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 7 ms / 972 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 7 ms / 878 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 878 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 992 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 972 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 878 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 878 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 972 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 992 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 8 ms / 878 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 21 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 21 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 21 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 21 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 19 ms / 21 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 19 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 20 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 20 ms / 21 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 20 ms / 20 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 54 ms / 992 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 58 ms / 972 ms |
FP32 | coreml | Passed | Very fast | macos · aarch64 | 59 ms / 878 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 20 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 64 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 65 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 65 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 65 ms / 19 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 71 ms / 20 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-04T09:19:26.803948+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "ONNX Runtime 1.23.2 / NumPy 2.3.4 / Pillow 12.0.0", "interpreter": "App-owned CPython 3.13.18 model-private managed environment" }
- Runtime
- onnxruntime 1.23.2
- Artifact revision
- 45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d
- Fixture
{ "file": "model-samples/desktop/rtmpose-hand/crop.png", "size": 90744, "sha1": "dfb792979ff4a541a9ef1f907e7cf5f1647ef1a2", "sha256": "9cb86449c03103c62343484cd2e774e5ca92f10ae5ad6517186a99420e48b5c1", "url": "https://assets.localai.tools/samples/v1/files/9cb86449c03103c62343484cd2e774e5ca92f10ae5ad6517186a99420e48b5c1/crop.png" }- Rerun when
- Checkpoint/runtime revision; Preprocessing and SimCC decoding; Fixtures/references/quality gates; Relevant OS/backend behavior
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 70.74291698518209,
"durationMs": 79.56370801548474,
"visualizationMs": 0.000667001586407423,
"imagesPerSecond": 14.13569078879602,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.141624991083518,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 99.70533300656825,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 63.666542002465576,
"durationMs": 66.80716699338518,
"visualizationMs": 0.000500003807246685,
"imagesPerSecond": 15.70683703791033,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.141624991083518,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 86.9487919844687,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 62.66220798715949,
"durationMs": 65.33366598887369,
"visualizationMs": 0.00029199873097240925,
"imagesPerSecond": 15.958582247930305,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.141624991083518,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.47529097995721,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 62.645958008943126,
"durationMs": 65.2909170021303,
"visualizationMs": 0.0003340246621519327,
"imagesPerSecond": 15.962721806524906,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.141624991083518,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.43254199321382,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 62.85099999513477,
"durationMs": 65.56679200730287,
"visualizationMs": 0.0002910092007368803,
"imagesPerSecond": 15.91064581434518,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.141624991083518,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.70841699838638,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 63.07879200903699,
"durationMs": 65.74741602526046,
"visualizationMs": 0.0002910092007368803,
"imagesPerSecond": 15.853188815929368,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.141624991083518,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.88904101634398,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.60041698301211,
"durationMs": 73.22262501111254,
"visualizationMs": 0.0005420006345957518,
"imagesPerSecond": 15.479776241428421,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 18.687167001189664,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 91.9097920123022,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 62.94899998465553,
"durationMs": 65.77816599747166,
"visualizationMs": 0.0005420006345957518,
"imagesPerSecond": 15.885875871638316,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 18.687167001189664,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 84.46533299866132,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 62.551833980251104,
"durationMs": 65.1191669749096,
"visualizationMs": 0.0005839974619448185,
"imagesPerSecond": 15.986741496911513,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 18.687167001189664,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 83.80633397609927,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.41579197417013,
"durationMs": 67.09283299278468,
"visualizationMs": 0.00029199873097240925,
"imagesPerSecond": 15.524143526807627,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 18.687167001189664,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.77999999397434,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.45070801419206,
"durationMs": 67.47700000414625,
"visualizationMs": 0.00045899651013314724,
"imagesPerSecond": 15.51573335361653,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 18.687167001189664,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 86.16416700533591,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.63429200812243,
"durationMs": 67.3522500146646,
"visualizationMs": 0.00037497375160455704,
"imagesPerSecond": 15.471663244556504,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 18.687167001189664,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 86.03941701585427,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.63729200186208,
"durationMs": 73.57662499998696,
"visualizationMs": 0.00104197533801198,
"imagesPerSecond": 15.470945162294111,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.235791987739503,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 92.81241698772646,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.03141599730588,
"durationMs": 66.92675000522286,
"visualizationMs": 0.0005410111043602228,
"imagesPerSecond": 15.617333841907774,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.235791987739503,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 86.16254199296236,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 63.287291006417945,
"durationMs": 66.1129170039203,
"visualizationMs": 0.00033300602808594704,
"imagesPerSecond": 15.80096073157232,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.235791987739503,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.3487089916598,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 63.6909999884665,
"durationMs": 66.39845899189822,
"visualizationMs": 0.0005830079317092896,
"imagesPerSecond": 15.700805454162836,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.235791987739503,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.63425097963773,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 64.00962499901652,
"durationMs": 66.73387499176897,
"visualizationMs": 0.00033300602808594704,
"imagesPerSecond": 15.62265050006721,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.235791987739503,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.96966697950847,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 63.507124985335395,
"durationMs": 66.31362502230331,
"visualizationMs": 0.000500003807246685,
"imagesPerSecond": 15.746264694408898,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.235791987739503,
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 85.54941701004282,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 19.69662500778213,
"durationMs": 29.761125013465062,
"visualizationMs": 0.0007089984137564898,
"imagesPerSecond": 50.770119226258316,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.294625002657995,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 49.055750016123056,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.356374988798052,
"durationMs": 21.17037499556318,
"visualizationMs": 0.0005420006345957518,
"imagesPerSecond": 54.476986911100276,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.294625002657995,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.464999998221174,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.494749994715676,
"durationMs": 21.349042013753206,
"visualizationMs": 0.00037500285543501377,
"imagesPerSecond": 54.06939808787468,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.294625002657995,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.6436670164112,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.196583987446502,
"durationMs": 20.92737497878261,
"visualizationMs": 0.00037500285543501377,
"imagesPerSecond": 54.955369683116466,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.294625002657995,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.221999981440604,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.342333001783118,
"durationMs": 21.152458008145913,
"visualizationMs": 0.0004580069798976183,
"imagesPerSecond": 54.51869180996696,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.294625002657995,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.44708301080391,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.20808299817145,
"durationMs": 21.140959026524797,
"visualizationMs": 0.00037500285543501377,
"imagesPerSecond": 54.920663537200774,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.294625002657995,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.43558402918279,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 20.060042006662115,
"durationMs": 29.31500002159737,
"visualizationMs": 0.0011659867595881224,
"imagesPerSecond": 49.85034426487697,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.979875010903925,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 49.294875032501295,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.291167012648657,
"durationMs": 21.222625015070662,
"visualizationMs": 0.000500003807246685,
"imagesPerSecond": 54.671197267428745,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.979875010903925,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.20250002597459,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.075750005664304,
"durationMs": 20.795499993255362,
"visualizationMs": 0.00045899651013314724,
"imagesPerSecond": 55.32273901147312,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.979875010903925,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.77537500415929,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.45274999504909,
"durationMs": 21.187333011766896,
"visualizationMs": 0.00041601015254855156,
"imagesPerSecond": 54.19246455234597,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.979875010903925,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.16720802267082,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.076542008202523,
"durationMs": 20.822958002099767,
"visualizationMs": 0.00037500285543501377,
"imagesPerSecond": 55.3203151103919,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.979875010903925,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 40.80283301300369,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.64137500524521,
"durationMs": 21.553207974648103,
"visualizationMs": 0.00037497375160455704,
"imagesPerSecond": 53.64411153783588,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 19.979875010903925,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.53308298555203,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 19.777792011154816,
"durationMs": 29.541166994022205,
"visualizationMs": 0.0008330098353326321,
"imagesPerSecond": 50.56176136527237,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.63108401489444,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 50.172251008916646,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.40075000654906,
"durationMs": 21.35366600123234,
"visualizationMs": 0.0007500057108700275,
"imagesPerSecond": 54.34561089325638,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.63108401489444,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.98475001612678,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.181374995037913,
"durationMs": 20.97141699050553,
"visualizationMs": 0.000333995558321476,
"imagesPerSecond": 55.00134067268957,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.63108401489444,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.60250100539997,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.00000001094304,
"durationMs": 20.86929199867882,
"visualizationMs": 0.0006250047590583563,
"imagesPerSecond": 55.55555552178074,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.63108401489444,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.50037601357326,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.54633298353292,
"durationMs": 21.317750011803582,
"visualizationMs": 0.000333995558321476,
"imagesPerSecond": 53.91901465847123,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.63108401489444,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.94883402669802,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 18.056417000479996,
"durationMs": 20.881582982838154,
"visualizationMs": 0.0003329769242554903,
"imagesPerSecond": 55.38197306660656,
"device": "cpu",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 178
},
"gpuPlanOperations": 0,
"coremlComputeUnits": null,
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 20.63108401489444,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 41.512666997732595,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 53.92070801462978,
"durationMs": 62.679208000190556,
"visualizationMs": 0.0010830117389559746,
"imagesPerSecond": 18.54575054408929,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 991.8002499907743,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1054.4794579909649,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 8.051417011301965,
"durationMs": 11.007417022483423,
"visualizationMs": 0.0003329769242554903,
"imagesPerSecond": 124.20173971814853,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 991.8002499907743,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1002.8076670132577,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.638750015757978,
"durationMs": 10.407833993667737,
"visualizationMs": 0.000166997779160738,
"imagesPerSecond": 130.9114708475994,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 991.8002499907743,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1002.208083984442,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 5.67899999441579,
"durationMs": 8.410749986069277,
"visualizationMs": 0.00020800507627427578,
"imagesPerSecond": 176.08733949345108,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 991.8002499907743,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1000.2109999768436,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 5.953124986262992,
"durationMs": 8.737291005672887,
"visualizationMs": 0.00033300602808594704,
"imagesPerSecond": 167.97900301228833,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 991.8002499907743,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1000.5375409964472,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 5.988124990835786,
"durationMs": 8.85083302273415,
"visualizationMs": 0.00020797597244381905,
"imagesPerSecond": 166.9971821781272,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 991.8002499907743,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1000.6510830135085,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 58.980500005418435,
"durationMs": 68.0146669910755,
"visualizationMs": 0.0013750104699283838,
"imagesPerSecond": 16.954756231434658,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 878.0294999887701,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 946.0441669798456,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 8.097667014226317,
"durationMs": 11.20420900406316,
"visualizationMs": 0.0006249756552278996,
"imagesPerSecond": 123.49235875507829,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 878.0294999887701,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 889.2337089928333,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.543582993093878,
"durationMs": 10.65837501664646,
"visualizationMs": 0.00033300602808594704,
"imagesPerSecond": 132.56300101894502,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 878.0294999887701,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 888.6878750054166,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.107458979589865,
"durationMs": 10.10095898527652,
"visualizationMs": 0.00037500285543501377,
"imagesPerSecond": 140.69725943852086,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 878.0294999887701,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 888.1304589740466,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.889458007412031,
"durationMs": 11.037666990887374,
"visualizationMs": 0.0002500019036233425,
"imagesPerSecond": 126.75141930668931,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 878.0294999887701,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 889.0671669796575,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.908125000540167,
"durationMs": 10.750583984190598,
"visualizationMs": 0.0004580069798976183,
"imagesPerSecond": 126.45222476019217,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 878.0294999887701,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 888.7800839729607,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 57.679332996485755,
"durationMs": 66.34933297755197,
"visualizationMs": 0.00291600008495152,
"imagesPerSecond": 17.337232385487663,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 972.3671250103507,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 1038.7164579879027,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.717041997238994,
"durationMs": 10.532499989494681,
"visualizationMs": 0.00041601015254855156,
"imagesPerSecond": 129.58333003212636,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 972.3671250103507,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 982.8996249998454,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 7.911833003163338,
"durationMs": 10.660875006578863,
"visualizationMs": 0.000500003807246685,
"imagesPerSecond": 126.39296097379412,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 972.3671250103507,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 983.0280000169296,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.05112026865698027,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 6.3502080156467855,
"durationMs": 9.177957981592044,
"visualizationMs": 0.0003329769242554903,
"imagesPerSecond": 157.47515633126034,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 972.3671250103507,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 981.5450829919428,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.045789999715063055,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 6.256791006308049,
"durationMs": 9.03062499128282,
"visualizationMs": 0.000166997779160738,
"imagesPerSecond": 159.82633893185942,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 972.3671250103507,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 981.3977500016335,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "pass",
"quality": {
"meanErrorFraction": 0.062184430396507034,
"pck02": 1,
"passed": true
},
"runtime": {
"inferenceMs": 6.54704199405387,
"durationMs": 9.267208020901307,
"visualizationMs": 0.00041601015254855156,
"imagesPerSecond": 152.74073404572877,
"device": "coreml",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CoreMLExecutionProvider": 7,
"CPUExecutionProvider": 6
},
"gpuPlanOperations": 197,
"coremlComputeUnits": "CPUAndGPU",
"engine": "onnxruntime",
"version": "1.23.2",
"loadMs": 972.3671250103507,
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45c9e1aa21b8fe33859973c49bce4647645d312e7a226e398a42f9137d44a56d",
"fallback": false,
"totalMs": 981.634333031252,
"grade": "fast",
"loadTimingScope": "Local ONNX session creation, excludes interpreter imports and downloads"
}
}
]