BEN2 Desktop
Remove still-image backgrounds with the exact original BEN2 Base checkpoint and strict native PyTorch CPU/Apple Silicon MPS execution.
Desktop app
Run BEN2 Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
BEN2 Base Desktop
38 configurations testedQuality criteria
{ "version": 1, "scope": "Compatibility and portrait matte fidelity on the existing annotated portrait and its mirrored form; not broad segmentation certification", "fixture": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minimumIoU": 0.7, "maximumAlphaMAE": 0.16, "minimumBoundaryF1": 0.6, "boundaryTolerancePixels": 12, "minimumForegroundRecall": 0.85, "maximumWarmInferenceMs": 10000, "initializationTimeoutMs": 180000, "preprocessing": "Check original BEN2.py ImageNet-normalized Lanczos1024 first; retain published onnx_run.py unnormalized bilinear alternative as a separately identified diagnostic because the two official sources conflict.", "postprocessing": "Output is already sigmoid probability. Finite min-max normalize with constant-mask guard; resize to original width,height. Do not repeat the official onnx_run.py width/height interpolation inversion.", "nativePlan": "ONNX runtime1.23.2 CPU compatibility first; original reviewed Torch2.10 CPU/MPS if needed, exact retained app-managed runtime. No Transformers5.22.1 built-in BEN2 architecture. GPU claims require measured placement.", "repetitions": "Compatibility one cold process then recommend only after repeated timing and suite; failures terminate affected case." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 554 ms / 385 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 556 ms / 404 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 557 ms / 404 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 560 ms / 404 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 560 ms / 404 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 561 ms / 404 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 562 ms / 386 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 562 ms / 386 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 562 ms / 385 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 562 ms / 385 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 564 ms / 385 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 564 ms / 386 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 566 ms / 386 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 566 ms / 385 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 582 ms / 386 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 778 ms / 404 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 786 ms / 385 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 805 ms / 386 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1038 ms / 393 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3063 ms / 235 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3068 ms / 227 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3071 ms / 227 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3082 ms / 232 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3085 ms / 227 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3088 ms / 232 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3092 ms / 235 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3097 ms / 235 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3105 ms / 232 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3107 ms / 235 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3154 ms / 232 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3155 ms / 227 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3157 ms / 235 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3160 ms / 227 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3241 ms / 235 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3251 ms / 232 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3256 ms / 232 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3270 ms / 227 ms |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3622 ms / 543 ms |
Test setup & sample details
- Quality gate
- { "version": 1, "scope": "Compatibility and portrait matte fidelity on the existing annotated portrait and its mirrored form; not broad segmentation certification", "fixture": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minimumIoU": 0.7, "maximumAlphaMAE": 0.16, "minimumBoundaryF1": 0.6, "boundaryTolerancePixels": 12, "minimumForegroundRecall": 0.85, "maximumWarmInferenceMs": 10000, "initializationTimeoutMs": 180000, "preprocessing": "Check original BEN2.py ImageNet-normalized Lanczos1024 first; retain published onnx_run.py unnormalized bilinear alternative as a separately identified diagnostic because the two official sources conflict.", "postprocessing": "Output is already sigmoid probability. Finite min-max normalize with constant-mask guard; resize to original width,height. Do not repeat the official onnx_run.py width/height interpolation inversion.", "nativePlan": "ONNX runtime1.23.2 CPU compatibility first; original reviewed Torch2.10 CPU/MPS if needed, exact retained app-managed runtime. No Transformers5.22.1 built-in BEN2 architecture. GPU claims require measured placement.", "repetitions": "Compatibility one cold process then recommend only after repeated timing and suite; failures terminate affected case." }
- Tested
- 2026-11-16T11:41:19Z
- Environment
- Apple M3 Max /macOS27.2 /PyTorch2.10.0 /app-owned isolated CPython3.13.18 seed; helper qualification only
- Runtime
- pytorch 2.10.0
- Artifact revision
- e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f
- Fixture
{ "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "size": 78124, "sha1": "38212739a4a4f0be25d84863cf991d7fb6c6d818", "sha256": "2b5d6423b8948eb53319661633039912afa6455a9055f0c984ff88eeae1b5bfe", "url": "https://assets.localai.tools/samples/v1/files/2b5d6423b8948eb53319661633039912afa6455a9055f0c984ff88eeae1b5bfe/modnet-portrait-pexels-5965592.jpg", "width": 1024, "height": 683 }- Rerun when
- model artifact revision change; Transformers.js or ONNX Runtime version change; benchmark fixture, reference matte, or quality-gate change; target browser/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3240.509582999948,
"durationMs": 3315.038624998124,
"imagesPerSecond": 0.3085934401324114,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 1.71050000062678,
"driverAllocatedMemoryBytes": null,
"loadMs": 234.8862500002724,
"totalMs": 3475.3958330002206,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3092.02754099897,
"durationMs": 3156.151459003013,
"imagesPerSecond": 0.32341238450836074,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 234.8862500002724,
"totalMs": 3326.9137909992423,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3096.558499997627,
"durationMs": 3160.61954199904,
"imagesPerSecond": 0.32293915971578324,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 234.8862500002724,
"totalMs": 3331.4447499978996,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3063.0117500004417,
"durationMs": 3127.6987079982064,
"imagesPerSecond": 0.32647605742937674,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 234.8862500002724,
"totalMs": 3297.898000000714,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3107.217542001308,
"durationMs": 3171.158582998032,
"imagesPerSecond": 0.3218313447586667,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 234.8862500002724,
"totalMs": 3342.1037920015806,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3157.4549159995513,
"durationMs": 3222.3382080010197,
"imagesPerSecond": 0.3167107770669249,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 234.8862500002724,
"totalMs": 3392.3411659998237,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3269.7246670031745,
"durationMs": 3343.761166997865,
"imagesPerSecond": 0.30583614886342636,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 1.71549999868148,
"driverAllocatedMemoryBytes": null,
"loadMs": 227.45949999807635,
"totalMs": 3497.184167001251,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3068.4579169974313,
"durationMs": 3132.350249998126,
"imagesPerSecond": 0.3258965992202777,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 227.45949999807635,
"totalMs": 3295.9174169955077,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3159.77083299731,
"durationMs": 3223.782916997152,
"imagesPerSecond": 0.31647864761490163,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 227.45949999807635,
"totalMs": 3387.2303329953866,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3070.989375002682,
"durationMs": 3135.2552919997834,
"imagesPerSecond": 0.3256279582533973,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 227.45949999807635,
"totalMs": 3298.4488750007586,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3084.87900000182,
"durationMs": 3149.5229590000235,
"imagesPerSecond": 0.3241618228784371,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 227.45949999807635,
"totalMs": 3312.338499999896,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3154.689499999222,
"durationMs": 3219.109291003406,
"imagesPerSecond": 0.31698840725854216,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 227.45949999807635,
"totalMs": 3382.1489999972982,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3255.7030000025406,
"durationMs": 3328.2595409982605,
"imagesPerSecond": 0.3071533244891256,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 1.7040000020642765,
"driverAllocatedMemoryBytes": null,
"loadMs": 232.423249999556,
"totalMs": 3488.1262500020966,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3088.3350410003914,
"durationMs": 3152.286583001114,
"imagesPerSecond": 0.32379906542655235,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 232.423249999556,
"totalMs": 3320.7582909999473,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3251.1717909983417,
"durationMs": 3315.2768750005635,
"imagesPerSecond": 0.3075814088842499,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 232.423249999556,
"totalMs": 3483.5950409978977,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3081.6968330000236,
"durationMs": 3145.789000001969,
"imagesPerSecond": 0.3244965530975033,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 232.423249999556,
"totalMs": 3314.1200829995796,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3153.8753750028263,
"durationMs": 3217.819707999297,
"imagesPerSecond": 0.3170702329983802,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 232.423249999556,
"totalMs": 3386.2986250023823,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"id": "native-cpu",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156265475626562,
"passed": true
},
"runtime": {
"inferenceMs": 3104.92449999947,
"durationMs": 3168.933417000517,
"imagesPerSecond": 0.3220690229344291,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"loadMs": 232.423249999556,
"totalMs": 3337.347749999026,
"grade": "acceptable",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 778.2441660019686,
"durationMs": 849.7565420002502,
"imagesPerSecond": 1.2849437794532346,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 1.7061660000763368,
"driverAllocatedMemoryBytes": 5975261184,
"loadMs": 403.5935409992817,
"totalMs": 1181.8377070012502,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 561.1634160013637,
"durationMs": 626.410125001712,
"imagesPerSecond": 1.7820121046479087,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 403.5935409992817,
"totalMs": 964.7569570006453,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 560.3067079973698,
"durationMs": 625.4732919987873,
"imagesPerSecond": 1.7847367981264544,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 403.5935409992817,
"totalMs": 963.9002489966515,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 556.5138749989273,
"durationMs": 621.6292919998523,
"imagesPerSecond": 1.79690039175021,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 403.5935409992817,
"totalMs": 960.107415998209,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 556.448958999681,
"durationMs": 621.6681669975515,
"imagesPerSecond": 1.7971100202931158,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 403.5935409992817,
"totalMs": 960.0424999989627,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 560.2808339972398,
"durationMs": 625.7339170006162,
"imagesPerSecond": 1.7848192180083147,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 403.5935409992817,
"totalMs": 963.8743749965215,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 786.3682919996791,
"durationMs": 858.5929590008163,
"imagesPerSecond": 1.2716687717113702,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 1.7049589987436775,
"driverAllocatedMemoryBytes": 5975277568,
"loadMs": 385.10658299856004,
"totalMs": 1171.474874998239,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 562.4899579997873,
"durationMs": 627.5695840013213,
"imagesPerSecond": 1.7778095160240677,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 385.10658299856004,
"totalMs": 947.5965409983473,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 553.9846669998951,
"durationMs": 619.1606249994948,
"imagesPerSecond": 1.805104111302397,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 385.10658299856004,
"totalMs": 939.0912499984552,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 562.3725420009578,
"durationMs": 627.5810000006459,
"imagesPerSecond": 1.778180699295765,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 385.10658299856004,
"totalMs": 947.4791249995178,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 563.7285830016481,
"durationMs": 629.1161669978464,
"imagesPerSecond": 1.7739033111916493,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 385.10658299856004,
"totalMs": 948.8351660002081,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 566.1182910007483,
"durationMs": 631.8545000031008,
"imagesPerSecond": 1.7664152808634093,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 385.10658299856004,
"totalMs": 951.2248739993083,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 805.2730829986103,
"durationMs": 877.372999999352,
"imagesPerSecond": 1.2418147596294682,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 1.7039999984262977,
"driverAllocatedMemoryBytes": 5975261184,
"loadMs": 386.1663749994477,
"totalMs": 1191.439457998058,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 564.3538750009611,
"durationMs": 630.5239579996851,
"imagesPerSecond": 1.7719378643378625,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 386.1663749994477,
"totalMs": 950.5202500004089,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 561.548292000225,
"durationMs": 628.8554169987037,
"imagesPerSecond": 1.7807907427480862,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 386.1663749994477,
"totalMs": 947.7146669996728,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 582.2772920000716,
"durationMs": 649.4478749991686,
"imagesPerSecond": 1.7173948112678195,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 386.1663749994477,
"totalMs": 968.4436669995193,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 561.8795000009413,
"durationMs": 629.6864590003679,
"imagesPerSecond": 1.77974102987976,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 386.1663749994477,
"totalMs": 948.0458750003891,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"id": "native-mps",
"iou": 0.9893696017508892,
"boundaryF1": 0.9782789317507418,
"foregroundRecall": 0.9923892833941892,
"alphaMAE": 0.004156276689848706,
"passed": true
},
"runtime": {
"inferenceMs": 565.7362080019084,
"durationMs": 634.1490000013437,
"imagesPerSecond": 1.7676082701721414,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6512132096,
"loadMs": 386.1663749994477,
"totalMs": 951.9025830013561,
"grade": "good",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"platform": "desktop",
"device": "cpu",
"id": "dog",
"reused": false,
"probeAccuracy": 1,
"foregroundRatio": 0.3673632087150285,
"probes": [
{
"point": [
200,
150
],
"foreground": true,
"passed": true
},
{
"point": [
350,
200
],
"foreground": true,
"passed": true
},
{
"point": [
500,
400
],
"foreground": true,
"passed": true
},
{
"point": [
0,
0
],
"foreground": false,
"passed": true
},
{
"point": [
690,
570
],
"foreground": false,
"passed": true
},
{
"point": [
680,
10
],
"foreground": false,
"passed": true
}
],
"passed": true,
"runtime": {
"inferenceMs": 3622.0360410006833,
"durationMs": 3700.0232499995036,
"imagesPerSecond": 0.2760878104690873,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 2.146250000805594,
"driverAllocatedMemoryBytes": null
}
},
"runtime": {
"inferenceMs": 3622.0360410006833,
"durationMs": 3700.0232499995036,
"imagesPerSecond": 0.2760878104690873,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 2.146250000805594,
"driverAllocatedMemoryBytes": null,
"loadMs": 542.8527499971096,
"totalMs": 4164.888790997793,
"grade": "acceptable",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false,
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"platform": "desktop",
"device": "mps",
"id": "dog",
"reused": false,
"probeAccuracy": 1,
"foregroundRatio": 0.3673632087150285,
"probes": [
{
"point": [
200,
150
],
"foreground": true,
"passed": true
},
{
"point": [
350,
200
],
"foreground": true,
"passed": true
},
{
"point": [
500,
400
],
"foreground": true,
"passed": true
},
{
"point": [
0,
0
],
"foreground": false,
"passed": true
},
{
"point": [
690,
570
],
"foreground": false,
"passed": true
},
{
"point": [
680,
10
],
"foreground": false,
"passed": true
}
],
"passed": true,
"runtime": {
"inferenceMs": 1037.7365409985941,
"durationMs": 1105.9999579993018,
"imagesPerSecond": 0.963635721102891,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 2.239292000012938,
"driverAllocatedMemoryBytes": 5975261184
}
},
"runtime": {
"inferenceMs": 1037.7365409985941,
"durationMs": 1105.9999579993018,
"imagesPerSecond": 0.963635721102891,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 2.239292000012938,
"driverAllocatedMemoryBytes": 5975261184,
"loadMs": 393.3495419987594,
"totalMs": 1431.0860829973535,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
"actualDevice": "mps",
"actualPrecision": "fp32",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false,
"timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
}
}
]Release validation still required
- Complete dependency backup and cold model/runtime-source recovery remain pending.