A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

BiRefNet Desktop

Separates a foreground subject from an image locally with native ONNX Runtime and returns a transparent PNG plus an alpha mask.

Desktop inferencePrivate · Runs on your computer
About this model

Separates a foreground subject from an image locally with native ONNX Runtime and returns a transparent PNG plus an alpha mask.

License
MIT
Model released
Unknown
Source repository created
Jul 12, 2024
Model weights · FP32
926.3 MB

Best for

  • Still-image background removal experiments
  • Comparing native CPU and CoreML image segmentation

Keep in mind

  • This small compatibility suite is not a broad accuracy benchmark.
  • Fine hair, transparency, motion blur, occlusion, multiple subjects and low contrast can produce halos or remove foreground details.
  • The model resizes images to 1024×1024; output is resized back and may lose small details.
  • Images are limited to 20 MB encoded and 16 megapixels; animated and video input are not supported by this adapter.
  • Review masks before use; do not use segmentation for safety-critical decisions.
  • The app downloads its own pinned CPython and isolated packages on request; installed Python, user packages and Python/pip configuration are not used. Automatic model-package provisioning is verified on Apple Silicon Mac; other platform stacks remain unverified.
  • Windows GPU variants and other Mac hardware/OS releases require device validation.
  • This 1024×1024 native adapter can use substantial memory: the measured FP32 CPU helper peaked around 13.7 GB RSS on this host. Lower-memory machines have not been validated.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · cpu (verified platform only)

Sources & technical details
Original model
https://huggingface.co/ZhengPeng7/BiRefNet
Release verification
Unknown
Release evidence
Exact original checkpoint public release date has not been verified. Repository creation, training, paper, artifact conversion and update dates are not release evidence.
Source updated
Feb 4, 2026
Native model files
https://huggingface.co/onnx-community/BiRefNet-ONNX
Files updated
Mar 7, 2025
Artifact revision
534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67

Desktop app

Sample result

BiRefNet — Native Background Removal Desktop

Run BiRefNet Desktop on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested40.0 GiBRAM estimate
macOS Apple SiliconCOREML / FP16Tested40.0 GiBRAM estimate
Windows Intel / AMDCUDA / FP32UnverifiedNot establishedRAM estimate
Windows Intel / AMDDIRECTML / FP32UnverifiedNot establishedRAM estimate
macOS Apple SiliconCPU / FP16Tested40.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified40.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified40.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

BiRefNet — Native Background Removal Desktop

36 configurations tested
Passed35
Failed1
TestedNov 2, 2026
Runtimeonnxruntime 1.23.2

Quality criteria

{ "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }

PrecisionDeviceResultPlatformInference / loadTask metric
FP32cpuPassedFastmacos · aarch645590 ms / 0 ms0.125 MP/s
FP32cpuPassedFastmacos · aarch645881 ms / 0 ms0.119 MP/s
FP32cpuPassedFastmacos · aarch645895 ms / 0 ms0.119 MP/s
FP32cpuPassedFastmacos · aarch646098 ms / 2148 ms0.115 MP/s
FP32cpuPassedFastmacos · aarch646133 ms / 2240 ms0.114 MP/s
FP32cpuPassedFastmacos · aarch646544 ms / 0 ms0.107 MP/s
FP32cpuPassedFastmacos · aarch646900 ms / 2209 ms0.101 MP/s
FP16coremlPassedFastmacos · aarch6415466 ms / 0 ms0.045 MP/s
FP16coremlPassedFastmacos · aarch6416186 ms / 0 ms0.043 MP/s
FP16coremlPassedFastmacos · aarch6416378 ms / 0 ms0.043 MP/s
FP16coremlPassedFastmacos · aarch6416494 ms / 12508 ms0.042 MP/s
FP16coremlPassedFastmacos · aarch6417766 ms / 0 ms0.039 MP/s
FP16coremlPassedFastmacos · aarch6417935 ms / 13930 ms0.039 MP/s
FP16coremlPassedFastmacos · aarch6420439 ms / 12816 ms0.034 MP/s
FP32cpuPassedModeratemacos · aarch645947 ms / 1672 ms0.118 MP/s
FP32cpuPassedModeratemacos · aarch645957 ms / 1672 ms0.117 MP/s
FP32cpuPassedModeratemacos · aarch646098 ms / 1672 ms0.115 MP/s
FP32cpuPassedModeratemacos · aarch646204 ms / 1672 ms0.113 MP/s
FP32cpuPassedModeratemacos · aarch647861 ms / 4088 ms0.089 MP/s
FP32cpuPassedModeratemacos · aarch649184 ms / 1750 ms0.076 MP/s
FP32cpuPassedModeratemacos · aarch649263 ms / 1750 ms0.076 MP/s
FP32cpuPassedModeratemacos · aarch649317 ms / 1750 ms0.075 MP/s
FP32cpuPassedModeratemacos · aarch649537 ms / 1750 ms0.073 MP/s
FP16coremlPassedSlowmacos · aarch6416116 ms / 12746 ms0.043 MP/s
FP16coremlPassedSlowmacos · aarch6416409 ms / 12746 ms0.043 MP/s
FP16cpuPassedSlowmacos · aarch6416537 ms / 1637 ms0.042 MP/s
FP16coremlPassedSlowmacos · aarch6416547 ms / 12746 ms0.042 MP/s
FP16cpuPassedSlowmacos · aarch6416570 ms / 1637 ms0.042 MP/s
FP16coremlPassedSlowmacos · aarch6416728 ms / 12746 ms0.042 MP/s
FP16cpuPassedSlowmacos · aarch6416769 ms / 1637 ms0.042 MP/s
FP16cpuPassedSlowmacos · aarch6417361 ms / 1637 ms0.040 MP/s
FP32cpuPassedSlowmacos · aarch6429658 ms / 1804 ms0.024 MP/s
FP32cpuPassedSlowmacos · aarch6430226 ms / 1804 ms0.023 MP/s
FP32cpuPassedSlowmacos · aarch6431270 ms / 1804 ms0.022 MP/s
FP32cpuPassedSlowmacos · aarch6432328 ms / 1804 ms0.022 MP/s
FP32coremlFailed—macos · aarch64— / ——
Test setup & sample details
Quality gate
{ "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }
Tested
2026-11-02T11:09:33.230Z
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "runtimeProvisioning": "App-owned CPython3.13.18; model-owned pinned packages" }
Runtime
onnxruntime 1.23.2
Artifact revision
534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67
Fixture
{
  "url": "https://assets.localai.tools/samples/v1/files/2b5d6423b8948eb53319661633039912afa6455a9055f0c984ff88eeae1b5bfe/modnet-portrait-pexels-5965592.jpg",
  "file": "model-samples/modnet-portrait-pexels-5965592.jpg",
  "size": 78124,
  "sha1": "38212739a4a4f0be25d84863cf991d7fb6c6d818"
}
Rerun when
ONNX artifact revision or runtime build/version change; Preprocessing, alpha postprocessing, fixture/reference or quality gate change; Host OS/hardware/provider compatibility change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 7051.082334000001,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 6900.128250010312,
      "loadMs": 2208.8568750000004,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 9259.939209,
      "grade": "good",
      "megapixelsPerSecond": 0.10135927545969234
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9929692026563266,
      "meanAbsoluteAlphaError": 0.0036524273455142975,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 6689.009666999999,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 6544.446625004639,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 6689.009666999999,
      "grade": "good",
      "megapixelsPerSecond": 0.10686801193057392
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 5691.34225,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 5590.116417006357,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 5691.34225,
      "grade": "good",
      "megapixelsPerSecond": 0.12511224236266288
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 6285.246459,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 6133.474415997625,
      "loadMs": 2240.2006660000006,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 8525.447125,
      "grade": "good",
      "megapixelsPerSecond": 0.11402868139073212
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 5992.744625,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 5894.694749993505,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 5992.744625,
      "grade": "good",
      "megapixelsPerSecond": 0.11864770436175183
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 6248.213625,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 6097.706499989727,
      "loadMs": 2148.0670000000027,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 8396.280625000003,
      "grade": "good",
      "megapixelsPerSecond": 0.11469755062844995
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 5987.626833,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 5881.22758299869,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 5987.626833,
      "grade": "good",
      "megapixelsPerSecond": 0.11891939057447554
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 20590.324458000003,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 20438.721708007502,
      "loadMs": 12815.646041,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 33405.970499,
      "grade": "good",
      "megapixelsPerSecond": 0.0342189697570955
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9929636707020173,
      "meanAbsoluteAlphaError": 0.003651771228760481,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 17908.491667,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 17765.677250004956,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 17908.491667,
      "grade": "good",
      "megapixelsPerSecond": 0.03936759573856408
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 16482.777416,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 16377.515208005208,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 16482.777416,
      "grade": "good",
      "megapixelsPerSecond": 0.04270440241497332
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 16646.121375,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 16494.358291995013,
      "loadMs": 12507.695334000004,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 29153.816709000002,
      "grade": "good",
      "megapixelsPerSecond": 0.04240189206629679
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 16287.758333,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 16185.825957989437,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 16287.758333,
      "grade": "good",
      "megapixelsPerSecond": 0.04321015200677944
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 18102.993208,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 17934.571125006187,
      "loadMs": 13930.44862499999,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 32033.44183299999,
      "grade": "good",
      "megapixelsPerSecond": 0.0389968622681385
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "minimumIoU": 0.7,
      "maximumAlphaMae": 0.16,
      "scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
    },
    "runtime": {
      "acceleration": "partial",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": "CPUAndGPU",
      "cpuThreads": 4,
      "device": "coreml",
      "durationMs": 15566.008791,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "family": {
        "catalogId": "birefnet",
        "defaultModelId": "birefnet-native",
        "displayName": "BiRefNet",
        "id": "birefnet",
        "variantId": "birefnet-default",
        "variantName": "General"
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "inferenceMs": 15465.815042000031,
      "loadMs": 0,
      "modelId": "birefnet-native",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "precision": "fp16",
      "provider": "CoreMLExecutionProvider",
      "requestedDevice": "coreml",
      "requestedPrecision": "fp16",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 15566.008791,
      "grade": "good",
      "megapixelsPerSecond": 0.04522180034486918
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "acceleration": "cpu",
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
      "coremlComputeUnits": null,
      "cpuThreads": 8,
      "device": "cpu",
      "durationMs": 8103.189917,
      "engine": "onnxruntime",
      "fallback": false,
      "fallbackReason": null,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "inferenceMs": 7861.286750000545,
      "loadMs": 4088.3054999999995,
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "precision": "fp32",
      "provider": "CPUExecutionProvider",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "reused": false,
      "selectionReason": "Explicit device selection; actual placement is reported after inference",
      "version": "1.23.2",
      "totalMs": 12191.495416999998,
      "grade": "moderate",
      "megapixelsPerSecond": 0.08896660588038613
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 9650.103458989179,
      "inferenceMs": 9537.218083016342,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1750.281584012555,
      "totalMs": 11400.385043001734,
      "grade": "moderate",
      "megapixelsPerSecond": 0.07333291468352403,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9929692026563266,
      "meanAbsoluteAlphaError": 0.0036524273455142975,
      "passed": true
    },
    "runtime": {
      "durationMs": 9385.465125000337,
      "inferenceMs": 9316.74304101034,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1750.281584012555,
      "totalMs": 11135.746709012892,
      "grade": "moderate",
      "megapixelsPerSecond": 0.07506829338551291,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 9331.89820899861,
      "inferenceMs": 9262.828875012929,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1750.281584012555,
      "totalMs": 11082.179793011164,
      "grade": "moderate",
      "megapixelsPerSecond": 0.0755052273379091,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 9252.401915990049,
      "inferenceMs": 9184.013542020693,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1750.281584012555,
      "totalMs": 11002.683500002604,
      "grade": "moderate",
      "megapixelsPerSecond": 0.0761531978148758,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "passed": true
    },
    "runtime": {
      "durationMs": 16854.750583996065,
      "inferenceMs": 16728.48433299805,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CoreMLExecutionProvider",
      "acceleration": "partial",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "coremlComputeUnits": "CPUAndGPU",
      "loadMs": 12746.039084013319,
      "totalMs": 29600.789668009384,
      "grade": "slow",
      "megapixelsPerSecond": 0.041808449951464086,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9929636707020173,
      "meanAbsoluteAlphaError": 0.003651771228760481,
      "passed": true
    },
    "runtime": {
      "durationMs": 16478.438707999885,
      "inferenceMs": 16409.00995800621,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CoreMLExecutionProvider",
      "acceleration": "partial",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "coremlComputeUnits": "CPUAndGPU",
      "loadMs": 12746.039084013319,
      "totalMs": 29224.477792013204,
      "grade": "slow",
      "megapixelsPerSecond": 0.04262243741638757,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "passed": true
    },
    "runtime": {
      "durationMs": 16615.748457988957,
      "inferenceMs": 16546.533375018043,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CoreMLExecutionProvider",
      "acceleration": "partial",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "coremlComputeUnits": "CPUAndGPU",
      "loadMs": 12746.039084013319,
      "totalMs": 29361.787542002276,
      "grade": "slow",
      "megapixelsPerSecond": 0.042268189000600094,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.0035958345979452133,
      "passed": true
    },
    "runtime": {
      "durationMs": 16192.21620899043,
      "inferenceMs": 16115.530500013847,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CoreMLExecutionProvider",
      "acceleration": "partial",
      "placement": {
        "CPUExecutionProvider": 6098,
        "CoreMLExecutionProvider": 139
      },
      "gpuPlanOperations": 45,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
      ],
      "coremlComputeUnits": "CPUAndGPU",
      "loadMs": 12746.039084013319,
      "totalMs": 28938.25529300375,
      "grade": "slow",
      "megapixelsPerSecond": 0.04339863338655833,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9933948697367981,
      "meanAbsoluteAlphaError": 0.003596467897295952,
      "passed": true
    },
    "runtime": {
      "durationMs": 17484.155625017593,
      "inferenceMs": 17361.20512499474,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 6459
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1637.409499991918,
      "totalMs": 19121.56512500951,
      "grade": "slow",
      "megapixelsPerSecond": 0.040284761049974166,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9929636707020173,
      "meanAbsoluteAlphaError": 0.003651389852166176,
      "passed": true
    },
    "runtime": {
      "durationMs": 16837.733416992705,
      "inferenceMs": 16769.226250005886,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 6459
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1637.409499991918,
      "totalMs": 18475.142916984623,
      "grade": "slow",
      "megapixelsPerSecond": 0.04170687362511759,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9933948697367981,
      "meanAbsoluteAlphaError": 0.003596467897295952,
      "passed": true
    },
    "runtime": {
      "durationMs": 16607.06737500732,
      "inferenceMs": 16536.870791984256,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 6459
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1637.409499991918,
      "totalMs": 18244.476874999236,
      "grade": "slow",
      "megapixelsPerSecond": 0.042292886532016016,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp16",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9933948697367981,
      "meanAbsoluteAlphaError": 0.003596467897295952,
      "passed": true
    },
    "runtime": {
      "durationMs": 16638.124666002113,
      "inferenceMs": 16569.83391600079,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 6459
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1637.409499991918,
      "totalMs": 18275.53416599403,
      "grade": "slow",
      "megapixelsPerSecond": 0.042208751369838815,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 6321.10987501801,
      "inferenceMs": 6204.315959010273,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1671.9599580101203,
      "totalMs": 7993.06983302813,
      "grade": "moderate",
      "megapixelsPerSecond": 0.1127266897141661,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9929692026563266,
      "meanAbsoluteAlphaError": 0.0036524273455142975,
      "passed": true
    },
    "runtime": {
      "durationMs": 6027.188584004762,
      "inferenceMs": 5956.907374988077,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1671.9599580101203,
      "totalMs": 7699.148542014882,
      "grade": "moderate",
      "megapixelsPerSecond": 0.11740857394167555,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 6015.886708017206,
      "inferenceMs": 5946.919000009075,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1671.9599580101203,
      "totalMs": 7687.846666027326,
      "grade": "moderate",
      "megapixelsPerSecond": 0.11760577199705137,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 6168.159708002349,
      "inferenceMs": 6098.144832998514,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1671.9599580101203,
      "totalMs": 7840.11966601247,
      "grade": "moderate",
      "megapixelsPerSecond": 0.11468930619939088,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 32431.147041002987,
      "inferenceMs": 32327.591999986907,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1803.6798750108574,
      "totalMs": 34234.826916013844,
      "grade": "slow",
      "megapixelsPerSecond": 0.02163452198976909,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9929692026563266,
      "meanAbsoluteAlphaError": 0.0036524273455142975,
      "passed": true
    },
    "runtime": {
      "durationMs": 31338.489582994953,
      "inferenceMs": 31269.53170800698,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1803.6798750108574,
      "totalMs": 33142.16945800581,
      "grade": "slow",
      "megapixelsPerSecond": 0.0223665645693348,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 29727.222332992824,
      "inferenceMs": 29658.449915994424,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1803.6798750108574,
      "totalMs": 31530.90220800368,
      "grade": "slow",
      "megapixelsPerSecond": 0.023581542595145097,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "intersectionOverUnion": 0.9934004436863872,
      "meanAbsoluteAlphaError": 0.003595565212890506,
      "passed": true
    },
    "runtime": {
      "durationMs": 30295.55620800238,
      "inferenceMs": 30226.36433300795,
      "engine": "onnxruntime",
      "version": "1.23.2",
      "provider": "CPUExecutionProvider",
      "acceleration": "cpu",
      "placement": {
        "CPUExecutionProvider": 4781
      },
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "coremlComputeUnits": null,
      "loadMs": 1803.6798750108574,
      "totalMs": 32099.23608301324,
      "grade": "slow",
      "megapixelsPerSecond": 0.023138475811867534,
      "artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
    }
  },
  {
    "precision": "fp32",
    "device": "coreml",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": "Not embedded",
    "failure": "Initialization exceeded the 180-second candidate setup budget; probe terminated during CoreML subgraph compilation. No inference pass."
  }
]

BiRefNet Dynamic Desktop

73 configurations tested
Passed72
Failed1
TestedNov 13, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch64668 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64676 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64693 ms / 4166 ms
FP16mpsAcceleratedPassedFastmacos · aarch64711 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64776 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64786 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64807 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64808 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64825 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64826 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64830 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64853 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64871 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64882 ms / 4166 ms
FP16mpsAcceleratedPassedFastmacos · aarch64891 ms / 4166 ms
FP16mpsAcceleratedPassedFastmacos · aarch64901 ms / 4144 ms
FP16mpsAcceleratedPassedFastmacos · aarch64904 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch64914 ms / 4166 ms
FP16mpsAcceleratedPassedFastmacos · aarch64916 ms / 4166 ms
FP16mpsAcceleratedPassedFastmacos · aarch64944 ms / 4166 ms
FP16mpsAcceleratedPassedFastmacos · aarch64946 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch641091 ms / 4210 ms
FP16mpsAcceleratedPassedFastmacos · aarch641144 ms / 4401 ms
FP16mpsAcceleratedPassedFastmacos · aarch641150 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch641181 ms / 4191 ms
FP32mpsAcceleratedPassedFastmacos · aarch641191 ms / 4191 ms
FP16mpsAcceleratedPassedFastmacos · aarch641236 ms / 4144 ms
FP32mpsAcceleratedPassedFastmacos · aarch641241 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641248 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641253 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641256 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641292 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641339 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641347 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641354 ms / 4191 ms
FP32mpsAcceleratedPassedFastmacos · aarch641355 ms / 4191 ms
FP32mpsAcceleratedPassedFastmacos · aarch641385 ms / 4191 ms
FP32mpsAcceleratedPassedFastmacos · aarch641385 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641390 ms / 4191 ms
FP32mpsAcceleratedPassedFastmacos · aarch641405 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641427 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641466 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641489 ms / 4191 ms
FP32mpsAcceleratedPassedFastmacos · aarch641567 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641747 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641792 ms / 4210 ms
FP32mpsAcceleratedPassedFastmacos · aarch641849 ms / 4171 ms
FP32mpsAcceleratedPassedFastmacos · aarch641997 ms / 4191 ms
FP32cpuPassedFastmacos · aarch647197 ms / 4047 ms
FP32cpuPassedFastmacos · aarch647202 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647225 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647233 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647236 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647251 ms / 4047 ms
FP32cpuPassedFastmacos · aarch647258 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647276 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647283 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647308 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647309 ms / 4047 ms
FP32cpuPassedFastmacos · aarch647326 ms / 4047 ms
FP32cpuPassedFastmacos · aarch647347 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647352 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647410 ms / 4047 ms
FP32cpuPassedFastmacos · aarch647427 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647446 ms / 4047 ms
FP32cpuPassedFastmacos · aarch647474 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647498 ms / 3941 ms
FP32cpuPassedFastmacos · aarch647523 ms / 4306 ms
FP32cpuPassedFastmacos · aarch647570 ms / 4047 ms
FP32cpuPassedFastmacos · aarch648771 ms / 3941 ms
FP32cpuPassedFastmacos · aarch648777 ms / 4306 ms
FP32cpuPassedFastmacos · aarch648847 ms / 4047 ms
BF16mpsFailed—Not recorded— / 4147 ms
Test setup & sample details
Quality gate
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
Tested
2026-11-13T05:48:11.367645+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
Runtime
pytorch 2.10.0
Artifact revision
280306042f57b7a33854319da62fd86aaa89ec4c
Fixture
{
  "file": "research/birefnet-family-expansion/quality-gates.json",
  "size": 4905,
  "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb",
  "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897",
  "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json"
}
Rerun when
artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1143.5400830232538,
      "durationMs": 1143.5400830232538,
      "imagesPerSecond": 0.8744774362051505,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 1117.8373750299215,
      "loadMs": 4401.398166955914,
      "totalMs": 5544.938249979168,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 903.8532080012374,
      "durationMs": 903.8532080012374,
      "imagesPerSecond": 1.106374343917393,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 883.0992910079658,
      "loadMs": 4401.398166955914,
      "totalMs": 5305.251374957152,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 830.1981660188176,
      "durationMs": 830.1981660188176,
      "imagesPerSecond": 1.2045316900607723,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 807.6069169910625,
      "loadMs": 4401.398166955914,
      "totalMs": 5231.596332974732,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 808.3960830117576,
      "durationMs": 808.3960830117576,
      "imagesPerSecond": 1.2370173742980093,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 789.2180409980938,
      "loadMs": 4401.398166955914,
      "totalMs": 5209.794249967672,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929067344232334,
      "alphaMAE": 0.003487886621522691,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 807.4275410035625,
      "durationMs": 807.4275410035625,
      "imagesPerSecond": 1.2385012266947033,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 742.101666983217,
      "loadMs": 4401.398166955914,
      "totalMs": 5208.825707959477,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 676.1409160098992,
      "durationMs": 676.1409160098992,
      "imagesPerSecond": 1.4789816387703407,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 654.9899170058779,
      "loadMs": 4401.398166955914,
      "totalMs": 5077.539082965814,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 710.8488749945536,
      "durationMs": 710.8488749945536,
      "imagesPerSecond": 1.4067687734719447,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 690.0197920040227,
      "loadMs": 4401.398166955914,
      "totalMs": 5112.247041950468,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 824.643041996751,
      "durationMs": 824.643041996751,
      "imagesPerSecond": 1.2126458953423631,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 803.8812089944258,
      "loadMs": 4401.398166955914,
      "totalMs": 5226.041208952665,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1236.260708014015,
      "durationMs": 1236.260708014015,
      "imagesPerSecond": 0.8088908702812735,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 1209.9606249830686,
      "loadMs": 4143.892832973506,
      "totalMs": 5380.153540987521,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 825.9067079634406,
      "durationMs": 825.9067079634406,
      "imagesPerSecond": 1.2107905049782763,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 805.9035419719294,
      "loadMs": 4143.892832973506,
      "totalMs": 4969.799540936947,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 775.5312919616699,
      "durationMs": 775.5312919616699,
      "imagesPerSecond": 1.2894386214520719,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 754.5791249722242,
      "loadMs": 4143.892832973506,
      "totalMs": 4919.424124935176,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 871.4313340024091,
      "durationMs": 871.4313340024091,
      "imagesPerSecond": 1.147537345721878,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 852.1713329828344,
      "loadMs": 4143.892832973506,
      "totalMs": 5015.324166975915,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929067344232334,
      "alphaMAE": 0.003487886621522691,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 852.8617499978282,
      "durationMs": 852.8617499978282,
      "imagesPerSecond": 1.1725229792548986,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 789.9205420399085,
      "loadMs": 4143.892832973506,
      "totalMs": 4996.7545829713345,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 667.7241249708459,
      "durationMs": 667.7241249708459,
      "imagesPerSecond": 1.4976244868247974,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 646.5857500443235,
      "loadMs": 4143.892832973506,
      "totalMs": 4811.616957944352,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 786.072124959901,
      "durationMs": 786.072124959901,
      "imagesPerSecond": 1.2721478961628514,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 765.2488750172779,
      "loadMs": 4143.892832973506,
      "totalMs": 4929.964957933407,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 900.8344589965418,
      "durationMs": 900.8344589965418,
      "imagesPerSecond": 1.1100818691082497,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 879.962417006027,
      "loadMs": 4143.892832973506,
      "totalMs": 5044.727291970048,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1150.2603749977425,
      "durationMs": 1150.2603749977425,
      "imagesPerSecond": 0.8693683810519532,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 1123.7767499987967,
      "loadMs": 4165.9869169816375,
      "totalMs": 5316.24729197938,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 913.6763340211473,
      "durationMs": 913.6763340211473,
      "imagesPerSecond": 1.0944794811516423,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 893.4599999920465,
      "loadMs": 4165.9869169816375,
      "totalMs": 5079.663251002785,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 890.8400000073016,
      "durationMs": 890.8400000073016,
      "imagesPerSecond": 1.1225360333974717,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 869.2670000018552,
      "loadMs": 4165.9869169816375,
      "totalMs": 5056.826916988939,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 882.3005419690162,
      "durationMs": 882.3005419690162,
      "imagesPerSecond": 1.1334006412013709,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 859.8595830262639,
      "loadMs": 4165.9869169816375,
      "totalMs": 5048.287458950654,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929067344232334,
      "alphaMAE": 0.003487886621522691,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 946.0953749949113,
      "durationMs": 946.0953749949113,
      "imagesPerSecond": 1.0569758889323169,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 882.9766659764573,
      "loadMs": 4165.9869169816375,
      "totalMs": 5112.082291976549,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 692.7097499719821,
      "durationMs": 692.7097499719821,
      "imagesPerSecond": 1.443606070277554,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 671.8080830178224,
      "loadMs": 4165.9869169816375,
      "totalMs": 4858.69666695362,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 915.8691250486299,
      "durationMs": 915.8691250486299,
      "imagesPerSecond": 1.0918590578614635,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 894.9905000044964,
      "loadMs": 4165.9869169816375,
      "totalMs": 5081.856042030267,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 944.4287910009734,
      "durationMs": 944.4287910009734,
      "imagesPerSecond": 1.058841078891854,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 923.4444159665145,
      "loadMs": 4165.9869169816375,
      "totalMs": 5110.415707982611,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1567.4222920206375,
      "durationMs": 1567.4222920206375,
      "imagesPerSecond": 0.637990160718496,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1541.755624988582,
      "loadMs": 4209.6389579819515,
      "totalMs": 5777.061250002589,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1292.1642910223454,
      "durationMs": 1292.1642910223454,
      "imagesPerSecond": 0.773895399329455,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1272.2291669924743,
      "loadMs": 4209.6389579819515,
      "totalMs": 5501.803249004297,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1256.3299589673989,
      "durationMs": 1256.3299589673989,
      "imagesPerSecond": 0.7959692379077856,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1235.3186249965802,
      "loadMs": 4209.6389579819515,
      "totalMs": 5465.96891694935,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1241.1330419708975,
      "durationMs": 1241.1330419708975,
      "imagesPerSecond": 0.8057153956774993,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1221.4763750089332,
      "loadMs": 4209.6389579819515,
      "totalMs": 5450.771999952849,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929122670158527,
      "alphaMAE": 0.0034855428490942475,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1792.1967090223916,
      "durationMs": 1792.1967090223916,
      "imagesPerSecond": 0.5579744650605237,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1727.284458000213,
      "loadMs": 4209.6389579819515,
      "totalMs": 6001.835667004343,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1091.329083952587,
      "durationMs": 1091.329083952587,
      "imagesPerSecond": 0.916313891661523,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1070.3183750156313,
      "loadMs": 4209.6389579819515,
      "totalMs": 5300.968041934539,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1346.8766249716282,
      "durationMs": 1346.8766249716282,
      "imagesPerSecond": 0.7424585009937825,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1325.9162500035018,
      "loadMs": 4209.6389579819515,
      "totalMs": 5556.51558295358,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1384.7353750024922,
      "durationMs": 1384.7353750024922,
      "imagesPerSecond": 0.7221596400671141,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1360.5582079617307,
      "loadMs": 4209.6389579819515,
      "totalMs": 5594.374332984444,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1747.4615829996765,
      "durationMs": 1747.4615829996765,
      "imagesPerSecond": 0.5722586463293855,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1720.7183329737745,
      "loadMs": 4170.872125017922,
      "totalMs": 5918.333708017599,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1339.0550839831121,
      "durationMs": 1339.0550839831121,
      "imagesPerSecond": 0.7467952677685452,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1317.0482080313377,
      "loadMs": 4170.872125017922,
      "totalMs": 5509.9272090010345,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1248.1082089943811,
      "durationMs": 1248.1082089943811,
      "imagesPerSecond": 0.8012125814040711,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1226.833250024356,
      "loadMs": 4170.872125017922,
      "totalMs": 5418.9803340123035,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1427.2507499554195,
      "durationMs": 1427.2507499554195,
      "imagesPerSecond": 0.7006477313332891,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1407.1452500065789,
      "loadMs": 4170.872125017922,
      "totalMs": 5598.122874973342,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929122670158527,
      "alphaMAE": 0.0034855428490942475,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1466.118166979868,
      "durationMs": 1466.118166979868,
      "imagesPerSecond": 0.6820732615706899,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1401.630541018676,
      "loadMs": 4170.872125017922,
      "totalMs": 5636.99029199779,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1252.8856670251116,
      "durationMs": 1252.8856670251116,
      "imagesPerSecond": 0.7981574267462324,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1232.337708992418,
      "loadMs": 4170.872125017922,
      "totalMs": 5423.757792043034,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1848.5712090041488,
      "durationMs": 1848.5712090041488,
      "imagesPerSecond": 0.5409583331868043,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1827.3764159530401,
      "loadMs": 4170.872125017922,
      "totalMs": 6019.443334022071,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1405.164625030011,
      "durationMs": 1405.164625030011,
      "imagesPerSecond": 0.7116603863968198,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1384.2130419798195,
      "loadMs": 4170.872125017922,
      "totalMs": 5576.036750047933,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1180.9216249966994,
      "durationMs": 1180.9216249966994,
      "imagesPerSecond": 0.8467962469590604,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1154.964542016387,
      "loadMs": 4191.387333965395,
      "totalMs": 5372.308958962094,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1390.3744159615599,
      "durationMs": 1390.3744159615599,
      "imagesPerSecond": 0.7192307255656862,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1370.0469579780474,
      "loadMs": 4191.387333965395,
      "totalMs": 5581.7617499269545,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1997.4607499898411,
      "durationMs": 1997.4607499898411,
      "imagesPerSecond": 0.5006356195009518,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1975.315416988451,
      "loadMs": 4191.387333965395,
      "totalMs": 6188.848083955236,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1353.8495000102557,
      "durationMs": 1353.8495000102557,
      "imagesPerSecond": 0.738634538028359,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1334.8340000375174,
      "loadMs": 4191.387333965395,
      "totalMs": 5545.23683397565,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929122670158527,
      "alphaMAE": 0.0034855428490942475,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1488.8332089758478,
      "durationMs": 1488.8332089758478,
      "imagesPerSecond": 0.6716669093429808,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1425.4039999796078,
      "loadMs": 4191.387333965395,
      "totalMs": 5680.2205429412425,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1190.591708989814,
      "durationMs": 1190.591708989814,
      "imagesPerSecond": 0.8399184980453744,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1169.5612909970805,
      "loadMs": 4191.387333965395,
      "totalMs": 5381.979042955209,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1355.1840839791112,
      "durationMs": 1355.1840839791112,
      "imagesPerSecond": 0.7379071314531569,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1334.1992089990526,
      "loadMs": 4191.387333965395,
      "totalMs": 5546.571417944506,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1384.6217920072377,
      "durationMs": 1384.6217920072377,
      "imagesPerSecond": 0.7222188801104561,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1362.953917006962,
      "loadMs": 4191.387333965395,
      "totalMs": 5576.009125972632,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7522.509792004712,
      "durationMs": 7522.509792004712,
      "imagesPerSecond": 0.13293435670404158,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7497.23370897118,
      "loadMs": 4306.0543749597855,
      "totalMs": 11828.564166964497,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7232.7415000181645,
      "durationMs": 7232.7415000181645,
      "imagesPerSecond": 0.13826016041047348,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7214.177874964662,
      "loadMs": 4306.0543749597855,
      "totalMs": 11538.79587497795,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7201.836625055876,
      "durationMs": 7201.836625055876,
      "imagesPerSecond": 0.13885346919991282,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7181.530624977313,
      "loadMs": 4306.0543749597855,
      "totalMs": 11507.891000015661,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 8776.635333022568,
      "durationMs": 8776.635333022568,
      "imagesPerSecond": 0.11393887999851669,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 8758.623459027149,
      "loadMs": 4306.0543749597855,
      "totalMs": 13082.689707982354,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929122670158527,
      "alphaMAE": 0.0034855428490942475,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7352.407249971293,
      "durationMs": 7352.407249971293,
      "imagesPerSecond": 0.13600987622168298,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7291.032749984879,
      "loadMs": 4306.0543749597855,
      "totalMs": 11658.461624931078,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7347.254167019855,
      "durationMs": 7347.254167019855,
      "imagesPerSecond": 0.13610526834484254,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7327.675292035565,
      "loadMs": 4306.0543749597855,
      "totalMs": 11653.30854197964,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7224.999083031435,
      "durationMs": 7224.999083031435,
      "imagesPerSecond": 0.13840832206450943,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7205.208584025968,
      "loadMs": 4306.0543749597855,
      "totalMs": 11531.05345799122,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7283.142416970804,
      "durationMs": 7283.142416970804,
      "imagesPerSecond": 0.13730337026910958,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7263.276707963087,
      "loadMs": 4306.0543749597855,
      "totalMs": 11589.19679193059,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7498.0128750321455,
      "durationMs": 7498.0128750321455,
      "imagesPerSecond": 0.1333686693617091,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7472.654958954081,
      "loadMs": 3940.6678329687566,
      "totalMs": 11438.680708000902,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7308.164583984762,
      "durationMs": 7308.164583984762,
      "imagesPerSecond": 0.13683326210132393,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7289.843834005296,
      "loadMs": 3940.6678329687566,
      "totalMs": 11248.832416953519,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7258.489500032738,
      "durationMs": 7258.489500032738,
      "imagesPerSecond": 0.1377697109013507,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7238.934375054669,
      "loadMs": 3940.6678329687566,
      "totalMs": 11199.157333001494,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 8771.157291950658,
      "durationMs": 8771.157291950658,
      "imagesPerSecond": 0.11401004071808242,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 8753.34820797434,
      "loadMs": 3940.6678329687566,
      "totalMs": 12711.825124919415,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929122670158527,
      "alphaMAE": 0.0034855428490942475,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7275.62383300392,
      "durationMs": 7275.62383300392,
      "imagesPerSecond": 0.1374452587094687,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7212.508333032019,
      "loadMs": 3940.6678329687566,
      "totalMs": 11216.291665972676,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7473.5780420014635,
      "durationMs": 7473.5780420014635,
      "imagesPerSecond": 0.13380471768408733,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7454.076582973357,
      "loadMs": 3940.6678329687566,
      "totalMs": 11414.24587497022,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7427.145167021081,
      "durationMs": 7427.145167021081,
      "imagesPerSecond": 0.13464123529459507,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7407.451208971906,
      "loadMs": 3940.6678329687566,
      "totalMs": 11367.812999989837,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7235.661750019062,
      "durationMs": 7235.661750019062,
      "imagesPerSecond": 0.1382043598151013,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7216.187332989648,
      "loadMs": 3940.6678329687566,
      "totalMs": 11176.329582987819,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7569.658791995607,
      "durationMs": 7569.658791995607,
      "imagesPerSecond": 0.13210635082487882,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7544.580666988622,
      "loadMs": 4046.5578750008717,
      "totalMs": 11616.216666996479,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7197.010458970908,
      "durationMs": 7197.010458970908,
      "imagesPerSecond": 0.13894658145918393,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7178.56379202567,
      "loadMs": 4046.5578750008717,
      "totalMs": 11243.56833397178,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7251.346083998214,
      "durationMs": 7251.346083998214,
      "imagesPerSecond": 0.13790543002860298,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7231.689708016347,
      "loadMs": 4046.5578750008717,
      "totalMs": 11297.903958999086,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 8847.449249995407,
      "durationMs": 8847.449249995407,
      "imagesPerSecond": 0.1130269269417419,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 8829.456334002316,
      "loadMs": 4046.5578750008717,
      "totalMs": 12894.007124996278,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929122670158527,
      "alphaMAE": 0.0034855428490942475,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7309.233625011984,
      "durationMs": 7309.233625011984,
      "imagesPerSecond": 0.136813249008491,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7247.184749983717,
      "loadMs": 4046.5578750008717,
      "totalMs": 11355.791500012856,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7446.180958009791,
      "durationMs": 7446.180958009791,
      "imagesPerSecond": 0.1342970316782738,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7426.434165972751,
      "loadMs": 4046.5578750008717,
      "totalMs": 11492.738833010662,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7410.129958996549,
      "durationMs": 7410.129958996549,
      "imagesPerSecond": 0.13495039972759346,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7390.614999982063,
      "loadMs": 4046.5578750008717,
      "totalMs": 11456.687833997421,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7325.882334029302,
      "durationMs": 7325.882334029302,
      "imagesPerSecond": 0.1365023289215172,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7306.301292032003,
      "loadMs": 4046.5578750008717,
      "totalMs": 11372.440209030174,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
      "individualFixturePassedBeforeConfigurationGate": false
    },
    "runtime": {
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
      "requestedDevice": "mps",
      "requestedPrecision": "bf16",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 4147.066084027756
    },
    "failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
  }
]

BiRefNet Dynamic Matting Desktop

72 configurations tested
Passed72
Failed0
TestedNov 13, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch64554 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64557 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64558 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64558 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64560 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64561 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64561 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64562 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64563 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64563 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64565 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64566 ms / 4209 ms
FP16mpsAcceleratedPassedFastmacos · aarch64567 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64567 ms / 4209 ms
FP16mpsAcceleratedPassedFastmacos · aarch64567 ms / 4209 ms
FP16mpsAcceleratedPassedFastmacos · aarch64569 ms / 4209 ms
FP16mpsAcceleratedPassedFastmacos · aarch64579 ms / 4209 ms
FP16mpsAcceleratedPassedFastmacos · aarch64580 ms / 4209 ms
FP16mpsAcceleratedPassedFastmacos · aarch64600 ms / 4448 ms
FP16mpsAcceleratedPassedFastmacos · aarch64607 ms / 5517 ms
FP16mpsAcceleratedPassedFastmacos · aarch64613 ms / 4209 ms
FP32mpsAcceleratedPassedFastmacos · aarch64647 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64648 ms / 4364 ms
FP32mpsAcceleratedPassedFastmacos · aarch64648 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64649 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64649 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64650 ms / 4364 ms
FP32mpsAcceleratedPassedFastmacos · aarch64651 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64652 ms / 4364 ms
FP32mpsAcceleratedPassedFastmacos · aarch64656 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64658 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64658 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64658 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64659 ms / 4364 ms
FP32mpsAcceleratedPassedFastmacos · aarch64659 ms / 4364 ms
FP32mpsAcceleratedPassedFastmacos · aarch64660 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64661 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64669 ms / 4364 ms
FP32mpsAcceleratedPassedFastmacos · aarch64674 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64696 ms / 4270 ms
FP32mpsAcceleratedPassedFastmacos · aarch64698 ms / 4279 ms
FP32mpsAcceleratedPassedFastmacos · aarch64700 ms / 4364 ms
FP16mpsAcceleratedPassedFastmacos · aarch64833 ms / 4448 ms
FP32mpsAcceleratedPassedFastmacos · aarch64893 ms / 4270 ms
FP16mpsAcceleratedPassedFastmacos · aarch64920 ms / 4209 ms
FP32mpsAcceleratedPassedFastmacos · aarch64960 ms / 4279 ms
FP16mpsAcceleratedPassedFastmacos · aarch64965 ms / 5517 ms
FP32mpsAcceleratedPassedFastmacos · aarch64991 ms / 4364 ms
FP32cpuPassedFastmacos · aarch647369 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647412 ms / 5187 ms
FP32cpuPassedFastmacos · aarch647415 ms / 5187 ms
FP32cpuPassedFastmacos · aarch647452 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647464 ms / 5950 ms
FP32cpuPassedFastmacos · aarch647489 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647501 ms / 5950 ms
FP32cpuPassedFastmacos · aarch647512 ms / 5950 ms
FP32cpuPassedFastmacos · aarch647533 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647559 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647560 ms / 5950 ms
FP32cpuPassedFastmacos · aarch647615 ms / 5187 ms
FP32cpuPassedFastmacos · aarch647623 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647623 ms / 5950 ms
FP32cpuPassedFastmacos · aarch647648 ms / 5187 ms
FP32cpuPassedFastmacos · aarch647654 ms / 5595 ms
FP32cpuPassedFastmacos · aarch647700 ms / 5187 ms
FP32cpuPassedFastmacos · aarch647735 ms / 5187 ms
FP32cpuPassedFastmacos · aarch647923 ms / 5950 ms
FP32cpuPassedFastmacos · aarch647949 ms / 5187 ms
FP32cpuPassedFastmacos · aarch648008 ms / 5950 ms
FP32cpuPassedFastmacos · aarch648976 ms / 5187 ms
FP32cpuPassedFastmacos · aarch649031 ms / 5950 ms
FP32cpuPassedFastmacos · aarch649258 ms / 5595 ms
Test setup & sample details
Quality gate
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
Tested
2026-11-13T06:24:39.323952+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
Runtime
pytorch 2.10.0
Artifact revision
074df545be87034e74a96bf71566ecbbc4c15f0a
Fixture
{
  "file": "research/birefnet-family-expansion/quality-gates.json",
  "size": 4905,
  "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb",
  "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897",
  "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json"
}
Rerun when
artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7922.983833996113,
      "durationMs": 7922.983833996113,
      "imagesPerSecond": 0.1262150751474688,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7886.864083004184,
      "loadMs": 5950.033708999399,
      "totalMs": 13873.017542995512,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7464.253875019494,
      "durationMs": 7464.253875019494,
      "imagesPerSecond": 0.13397186332939248,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7445.170874998439,
      "loadMs": 5950.033708999399,
      "totalMs": 13414.287584018894,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7512.170707981568,
      "durationMs": 7512.170707981568,
      "imagesPerSecond": 0.1331173157363843,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7492.029167013243,
      "loadMs": 5950.033708999399,
      "totalMs": 13462.204416980967,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 9030.664959049318,
      "durationMs": 9030.664959049318,
      "imagesPerSecond": 0.11073381689328807,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 9013.67695798399,
      "loadMs": 5950.033708999399,
      "totalMs": 14980.698668048717,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929432618183642,
      "alphaMAE": 0.0033068442192030517,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 8008.280917012598,
      "durationMs": 8008.280917012598,
      "imagesPerSecond": 0.12487074446597199,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7938.378916005604,
      "loadMs": 5950.033708999399,
      "totalMs": 13958.314626011997,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7559.745083039161,
      "durationMs": 7559.745083039161,
      "imagesPerSecond": 0.1322795926338274,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7539.428125019185,
      "loadMs": 5950.033708999399,
      "totalMs": 13509.77879203856,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7500.951832975261,
      "durationMs": 7500.951832975261,
      "imagesPerSecond": 0.13331641400546748,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7481.22366698226,
      "loadMs": 5950.033708999399,
      "totalMs": 13450.98554197466,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7622.811374953017,
      "durationMs": 7622.811374953017,
      "imagesPerSecond": 0.13118519543665916,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7602.605084015522,
      "loadMs": 5950.033708999399,
      "totalMs": 13572.845083952416,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7622.638790984638,
      "durationMs": 7622.638790984638,
      "imagesPerSecond": 0.1311881655972875,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7594.79945799103,
      "loadMs": 5595.172542030923,
      "totalMs": 13217.811333015561,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7489.268167002592,
      "durationMs": 7489.268167002592,
      "imagesPerSecond": 0.13352439486757317,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7469.017583003733,
      "loadMs": 5595.172542030923,
      "totalMs": 13084.440709033515,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7653.792458993848,
      "durationMs": 7653.792458993848,
      "imagesPerSecond": 0.13065418292403735,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7633.932083030231,
      "loadMs": 5595.172542030923,
      "totalMs": 13248.965001024771,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 9257.982791983522,
      "durationMs": 9257.982791983522,
      "imagesPerSecond": 0.1080148907671225,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 9241.355874983128,
      "loadMs": 5595.172542030923,
      "totalMs": 14853.155334014446,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929432618183642,
      "alphaMAE": 0.0033068442192030517,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7368.65045898594,
      "durationMs": 7368.65045898594,
      "imagesPerSecond": 0.13571006055532428,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7306.277083000168,
      "loadMs": 5595.172542030923,
      "totalMs": 12963.823001016863,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7532.889417023398,
      "durationMs": 7532.889417023398,
      "imagesPerSecond": 0.13275118545350256,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7513.287917012349,
      "loadMs": 5595.172542030923,
      "totalMs": 13128.061959054321,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7558.935459004715,
      "durationMs": 7558.935459004715,
      "imagesPerSecond": 0.13229376086400266,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7538.604583009146,
      "loadMs": 5595.172542030923,
      "totalMs": 13154.108001035638,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7452.133040991612,
      "durationMs": 7452.133040991612,
      "imagesPerSecond": 0.13418976747990746,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7432.4371659895405,
      "loadMs": 5595.172542030923,
      "totalMs": 13047.305583022535,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7648.387749970425,
      "durationMs": 7648.387749970425,
      "imagesPerSecond": 0.1307465092893423,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7619.456125015859,
      "loadMs": 5186.762958997861,
      "totalMs": 12835.150708968285,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7414.816999982577,
      "durationMs": 7414.816999982577,
      "imagesPerSecond": 0.13486509511999417,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7396.255041996483,
      "loadMs": 5186.762958997861,
      "totalMs": 12601.579958980437,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7615.208583010826,
      "durationMs": 7615.208583010826,
      "imagesPerSecond": 0.13131616673389002,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7595.399167039432,
      "loadMs": 5186.762958997861,
      "totalMs": 12801.971542008687,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 8976.156791963149,
      "durationMs": 8976.156791963149,
      "imagesPerSecond": 0.11140625360904519,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 8959.301833005156,
      "loadMs": 5186.762958997861,
      "totalMs": 14162.91975096101,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929432618183642,
      "alphaMAE": 0.0033068442192030517,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 7411.64549998939,
      "durationMs": 7411.64549998939,
      "imagesPerSecond": 0.134922804929274,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7349.137375014834,
      "loadMs": 5186.762958997861,
      "totalMs": 12598.408458987251,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7699.552250036504,
      "durationMs": 7699.552250036504,
      "imagesPerSecond": 0.1298776821723963,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7679.787874978501,
      "loadMs": 5186.762958997861,
      "totalMs": 12886.315209034365,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7948.959166998975,
      "durationMs": 7948.959166998975,
      "imagesPerSecond": 0.12580263390351984,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7929.287249979097,
      "loadMs": 5186.762958997861,
      "totalMs": 13135.722125996836,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 7734.99345901655,
      "durationMs": 7734.99345901655,
      "imagesPerSecond": 0.12928259154948826,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "modelForwardMs": 7714.436583977658,
      "loadMs": 5186.762958997861,
      "totalMs": 12921.75641801441,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "cpu",
      "actualDevice": "cpu",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 965.0358749786392,
      "durationMs": 965.0358749786392,
      "imagesPerSecond": 1.0362309069827427,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 937.7247090451419,
      "loadMs": 5516.823041951284,
      "totalMs": 6481.858916929923,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 562.7383749815635,
      "durationMs": 562.7383749815635,
      "imagesPerSecond": 1.7770247142515596,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 542.5572500098497,
      "loadMs": 5516.823041951284,
      "totalMs": 6079.561416932847,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 558.0232500215061,
      "durationMs": 558.0232500215061,
      "imagesPerSecond": 1.7920400269369783,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 535.8218750334345,
      "loadMs": 5516.823041951284,
      "totalMs": 6074.84629197279,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 561.3754999940284,
      "durationMs": 561.3754999940284,
      "imagesPerSecond": 1.7813388721286154,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 543.2138749747537,
      "loadMs": 5516.823041951284,
      "totalMs": 6078.198541945312,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929269733688564,
      "alphaMAE": 0.0033119579045014754,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 607.4858749634586,
      "durationMs": 607.4858749634586,
      "imagesPerSecond": 1.6461288092668027,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 542.8994169924408,
      "loadMs": 5516.823041951284,
      "totalMs": 6124.308916914742,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 566.6018330375664,
      "durationMs": 566.6018330375664,
      "imagesPerSecond": 1.7649078094911472,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 544.4768340094015,
      "loadMs": 5516.823041951284,
      "totalMs": 6083.42487498885,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 562.4210000387393,
      "durationMs": 562.4210000387393,
      "imagesPerSecond": 1.7780274917386094,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 540.6945840222761,
      "loadMs": 5516.823041951284,
      "totalMs": 6079.244041990023,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 563.1189169944264,
      "durationMs": 563.1189169944264,
      "imagesPerSecond": 1.7758238443442271,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 540.7094999682158,
      "loadMs": 5516.823041951284,
      "totalMs": 6079.94195894571,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 919.8917499743402,
      "durationMs": 919.8917499743402,
      "imagesPerSecond": 1.0870844314321706,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 893.7138339970261,
      "loadMs": 4208.786458009854,
      "totalMs": 5128.678207984194,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 568.9926670165733,
      "durationMs": 568.9926670165733,
      "imagesPerSecond": 1.757491893952427,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 548.2417920138687,
      "loadMs": 4208.786458009854,
      "totalMs": 4777.779125026427,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 580.1893340540119,
      "durationMs": 580.1893340540119,
      "imagesPerSecond": 1.7235752905221566,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 558.1722499919124,
      "loadMs": 4208.786458009854,
      "totalMs": 4788.975792063866,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 567.2779169981368,
      "durationMs": 567.2779169981368,
      "imagesPerSecond": 1.76280438570868,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 548.8926249672659,
      "loadMs": 4208.786458009854,
      "totalMs": 4776.064375007991,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929269733688564,
      "alphaMAE": 0.0033119579045014754,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 612.8324170131236,
      "durationMs": 612.8324170131236,
      "imagesPerSecond": 1.6317674656864396,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 547.1630420070142,
      "loadMs": 4208.786458009854,
      "totalMs": 4821.618875022978,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 578.8941659848206,
      "durationMs": 578.8941659848206,
      "imagesPerSecond": 1.7274314697899744,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 556.7755829542875,
      "loadMs": 4208.786458009854,
      "totalMs": 4787.6806239946745,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 566.8613750021905,
      "durationMs": 566.8613750021905,
      "imagesPerSecond": 1.76409973248951,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 545.0942090246826,
      "loadMs": 4208.786458009854,
      "totalMs": 4775.647833012044,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 566.0032499581575,
      "durationMs": 566.0032499581575,
      "imagesPerSecond": 1.7667743075219553,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 544.4957919535227,
      "loadMs": 4208.786458009854,
      "totalMs": 4774.7897079680115,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 832.5296660186723,
      "durationMs": 832.5296660186723,
      "imagesPerSecond": 1.2011583980931337,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 806.30870902678,
      "loadMs": 4447.61379098054,
      "totalMs": 5280.1434569992125,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 556.605292018503,
      "durationMs": 556.605292018503,
      "imagesPerSecond": 1.7966052682926297,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 536.7405830183998,
      "loadMs": 4447.61379098054,
      "totalMs": 5004.219082999043,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 558.1362080411054,
      "durationMs": 558.1362080411054,
      "imagesPerSecond": 1.791677346126149,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 537.1575829922222,
      "loadMs": 4447.61379098054,
      "totalMs": 5005.749999021646,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 554.3438330059871,
      "durationMs": 554.3438330059871,
      "imagesPerSecond": 1.8039345627377072,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 535.5232079746202,
      "loadMs": 4447.61379098054,
      "totalMs": 5001.957623986527,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929269733688564,
      "alphaMAE": 0.0033119579045014754,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 600.4571249941364,
      "durationMs": 600.4571249941364,
      "imagesPerSecond": 1.6653978417022952,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 536.0532919876277,
      "loadMs": 4447.61379098054,
      "totalMs": 5048.070915974677,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 564.9661250063218,
      "durationMs": 564.9661250063218,
      "imagesPerSecond": 1.7700176271432384,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 543.0552500183694,
      "loadMs": 4447.61379098054,
      "totalMs": 5012.579915986862,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 561.1772499978542,
      "durationMs": 561.1772499978542,
      "imagesPerSecond": 1.7819681749461933,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 537.5133749912493,
      "loadMs": 4447.61379098054,
      "totalMs": 5008.791040978394,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 559.8217499791645,
      "durationMs": 559.8217499791645,
      "imagesPerSecond": 1.786282865996575,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 537.4562080251053,
      "loadMs": 4447.61379098054,
      "totalMs": 5007.435540959705,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 960.1375840138644,
      "durationMs": 960.1375840138644,
      "imagesPerSecond": 1.0415173998496032,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 934.2488329857588,
      "loadMs": 4278.678665985353,
      "totalMs": 5238.816249999218,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 656.3794169924222,
      "durationMs": 656.3794169924222,
      "imagesPerSecond": 1.5235090773901352,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 634.9291669903323,
      "loadMs": 4278.678665985353,
      "totalMs": 4935.0580829777755,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 673.9035000209697,
      "durationMs": 673.9035000209697,
      "imagesPerSecond": 1.48389198152092,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 652.1925420383923,
      "loadMs": 4278.678665985353,
      "totalMs": 4952.582166006323,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 659.9140830221586,
      "durationMs": 659.9140830221586,
      "imagesPerSecond": 1.5153487790719296,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 641.3908749818802,
      "loadMs": 4278.678665985353,
      "totalMs": 4938.592749007512,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929432618183642,
      "alphaMAE": 0.003306849826314125,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 698.3517920016311,
      "durationMs": 698.3517920016311,
      "imagesPerSecond": 1.431943057142845,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 634.7039170213975,
      "loadMs": 4278.678665985353,
      "totalMs": 4977.030457986984,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 661.0064579872414,
      "durationMs": 661.0064579872414,
      "imagesPerSecond": 1.5128445235542642,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 639.3264170037583,
      "loadMs": 4278.678665985353,
      "totalMs": 4939.685123972595,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 658.0733330338262,
      "durationMs": 658.0733330338262,
      "imagesPerSecond": 1.5195874833429819,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 637.1711249812506,
      "loadMs": 4278.678665985353,
      "totalMs": 4936.7519990191795,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 657.9811249976046,
      "durationMs": 657.9811249976046,
      "imagesPerSecond": 1.5198004350104124,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 637.1504580019973,
      "loadMs": 4278.678665985353,
      "totalMs": 4936.659790982958,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 991.2441250053234,
      "durationMs": 991.2441250053234,
      "imagesPerSecond": 1.0088332175432864,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 960.4621669859625,
      "loadMs": 4363.87029197067,
      "totalMs": 5355.114416975994,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 669.3484589923173,
      "durationMs": 669.3484589923173,
      "imagesPerSecond": 1.4939901430496576,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 645.6215410144068,
      "loadMs": 4363.87029197067,
      "totalMs": 5033.2187509629875,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 659.1559160151519,
      "durationMs": 659.1559160151519,
      "imagesPerSecond": 1.5170917467378282,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 636.983959004283,
      "loadMs": 4363.87029197067,
      "totalMs": 5023.026207985822,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 651.5605000313371,
      "durationMs": 651.5605000313371,
      "imagesPerSecond": 1.5347768932461445,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 633.0803329474293,
      "loadMs": 4363.87029197067,
      "totalMs": 5015.430792002007,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929432618183642,
      "alphaMAE": 0.003306849826314125,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 699.8622919782065,
      "durationMs": 699.8622919782065,
      "imagesPerSecond": 1.4288525206486475,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 632.5987909804098,
      "loadMs": 4363.87029197067,
      "totalMs": 5063.732583948877,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 659.1244589653797,
      "durationMs": 659.1244589653797,
      "imagesPerSecond": 1.5171641507124296,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 637.725375010632,
      "loadMs": 4363.87029197067,
      "totalMs": 5022.99475093605,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 650.3064999706112,
      "durationMs": 650.3064999706112,
      "imagesPerSecond": 1.537736436657472,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 629.1400830377825,
      "loadMs": 4363.87029197067,
      "totalMs": 5014.176791941281,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 648.4216669923626,
      "durationMs": 648.4216669923626,
      "imagesPerSecond": 1.5422063310104943,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 627.6729590026662,
      "loadMs": 4363.87029197067,
      "totalMs": 5012.291958963033,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 892.5220419769175,
      "durationMs": 892.5220419769175,
      "imagesPerSecond": 1.1204205083664052,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 867.367375001777,
      "loadMs": 4270.260083023459,
      "totalMs": 5162.782125000376,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 647.2920840024017,
      "durationMs": 647.2920840024017,
      "imagesPerSecond": 1.5448976199688695,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 627.536624961067,
      "loadMs": 4270.260083023459,
      "totalMs": 4917.55216702586,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 648.4730420052074,
      "durationMs": 648.4730420052074,
      "imagesPerSecond": 1.5420841503415492,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 627.3347079986706,
      "loadMs": 4270.260083023459,
      "totalMs": 4918.733125028666,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 648.6068340018392,
      "durationMs": 648.6068340018392,
      "imagesPerSecond": 1.5417660554547354,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 630.6864999933168,
      "loadMs": 4270.260083023459,
      "totalMs": 4918.866917025298,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9929432618183642,
      "alphaMAE": 0.003306849826314125,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 696.3374170009047,
      "durationMs": 696.3374170009047,
      "imagesPerSecond": 1.4360854028309393,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 630.853875016328,
      "loadMs": 4270.260083023459,
      "totalMs": 4966.597500024363,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 658.1561249913648,
      "durationMs": 658.1561249913648,
      "imagesPerSecond": 1.519396328664601,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 637.0202910038643,
      "loadMs": 4270.260083023459,
      "totalMs": 4928.4162080148235,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 648.9065829664469,
      "durationMs": 648.9065829664469,
      "imagesPerSecond": 1.5410538685376647,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 627.5874169659801,
      "loadMs": 4270.260083023459,
      "totalMs": 4919.166665989906,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 650.7865419844165,
      "durationMs": 650.7865419844165,
      "imagesPerSecond": 1.5366021506080032,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 629.0584170492366,
      "loadMs": 4270.260083023459,
      "totalMs": 4921.046625007875,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 8
    }
  }
]

BiRefNet High Resolution Desktop

49 configurations tested
Passed48
Failed1
TestedNov 13, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch643122 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643260 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643274 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643332 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643347 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643367 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643376 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643389 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643409 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643454 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643461 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643479 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643524 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643524 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643535 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643581 ms / 4195 ms
FP16mpsAcceleratedPassedFastmacos · aarch643602 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643668 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643677 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643701 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643723 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643732 ms / 4142 ms
FP16mpsAcceleratedPassedFastmacos · aarch643740 ms / 4525 ms
FP16mpsAcceleratedPassedFastmacos · aarch643862 ms / 4195 ms
FP32mpsAcceleratedPassedFastmacos · aarch644064 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644195 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644236 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644248 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644304 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644320 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644322 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644334 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644363 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644427 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644509 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644513 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644531 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644564 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644578 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644593 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644604 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644665 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644713 ms / 4201 ms
FP32mpsAcceleratedPassedFastmacos · aarch644724 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644727 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644744 ms / 4215 ms
FP32mpsAcceleratedPassedFastmacos · aarch644899 ms / 4166 ms
FP32mpsAcceleratedPassedFastmacos · aarch644913 ms / 4166 ms
BF16mpsFailed—Not recorded— / 4157 ms
Test setup & sample details
Quality gate
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
Tested
2026-11-13T05:48:11.367645+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
Runtime
pytorch 2.10.0
Artifact revision
a7a562f6fd16021180f2f4348f4de003a2d3d1e1
Fixture
{
  "file": "research/birefnet-family-expansion/quality-gates.json",
  "size": 4905,
  "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb",
  "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897",
  "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json"
}
Rerun when
artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3739.857624983415,
      "durationMs": 3739.857624983415,
      "imagesPerSecond": 0.2673898581913087,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 8578646016,
      "modelForwardMs": 3657.532750046812,
      "loadMs": 4524.718665983528,
      "totalMs": 8264.576290966943,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3409.2698749736883,
      "durationMs": 3409.2698749736883,
      "imagesPerSecond": 0.29331793512172977,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3344.999958004337,
      "loadMs": 4524.718665983528,
      "totalMs": 7933.988540957216,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3701.2234160210937,
      "durationMs": 3701.2234160210937,
      "imagesPerSecond": 0.2701809341396161,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3633.4508329746313,
      "loadMs": 4524.718665983528,
      "totalMs": 8225.942082004622,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3535.2487500058487,
      "durationMs": 3535.2487500058487,
      "imagesPerSecond": 0.28286552678884214,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3473.9153750124387,
      "loadMs": 4524.718665983528,
      "totalMs": 8059.967415989377,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9941480014504477,
      "alphaMAE": 0.0033021510672350905,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3388.839041988831,
      "durationMs": 3388.839041988831,
      "imagesPerSecond": 0.2950863076143986,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3275.5771669908427,
      "loadMs": 4524.718665983528,
      "totalMs": 7913.557707972359,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3273.806457989849,
      "durationMs": 3273.806457989849,
      "imagesPerSecond": 0.3054548315033902,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3207.961250038352,
      "loadMs": 4524.718665983528,
      "totalMs": 7798.525123973377,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3454.3197919847444,
      "durationMs": 3454.3197919847444,
      "imagesPerSecond": 0.28949259484323286,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3390.0882080197334,
      "loadMs": 4524.718665983528,
      "totalMs": 7979.038457968272,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3601.936375023797,
      "durationMs": 3601.936375023797,
      "imagesPerSecond": 0.27762844644733436,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3537.514541996643,
      "loadMs": 4524.718665983528,
      "totalMs": 8126.655041007325,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3668.0300420266576,
      "durationMs": 3668.0300420266576,
      "imagesPerSecond": 0.2726259023351621,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 8578646016,
      "modelForwardMs": 3590.090291982051,
      "loadMs": 4142.384874983691,
      "totalMs": 7810.414917010348,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3732.3500830098055,
      "durationMs": 3732.3500830098055,
      "imagesPerSecond": 0.2679277071441245,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3668.2622500229627,
      "loadMs": 4142.384874983691,
      "totalMs": 7874.734957993496,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3479.031207971275,
      "durationMs": 3479.031207971275,
      "imagesPerSecond": 0.28743634081486996,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3413.68604201125,
      "loadMs": 4142.384874983691,
      "totalMs": 7621.4160829549655,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3331.5929169766605,
      "durationMs": 3331.5929169766605,
      "imagesPerSecond": 0.30015671929915005,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3271.0403330274858,
      "loadMs": 4142.384874983691,
      "totalMs": 7473.977791960351,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9941480014504477,
      "alphaMAE": 0.0033021510672350905,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3723.2201250153594,
      "durationMs": 3723.2201250153594,
      "imagesPerSecond": 0.26858471065980144,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3609.126625000499,
      "loadMs": 4142.384874983691,
      "totalMs": 7865.60499999905,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3122.4767090170644,
      "durationMs": 3122.4767090170644,
      "imagesPerSecond": 0.320258593799021,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3056.4701670082286,
      "loadMs": 4142.384874983691,
      "totalMs": 7264.861584000755,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3461.0752500011586,
      "durationMs": 3461.0752500011586,
      "imagesPerSecond": 0.2889275522107372,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3396.0675410344265,
      "loadMs": 4142.384874983691,
      "totalMs": 7603.460124984849,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3677.0337499910966,
      "durationMs": 3677.0337499910966,
      "imagesPerSecond": 0.2719583414219196,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3608.330042043235,
      "loadMs": 4142.384874983691,
      "totalMs": 7819.418624974787,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3862.2665000148118,
      "durationMs": 3862.2665000148118,
      "imagesPerSecond": 0.25891532860204364,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 8578646016,
      "modelForwardMs": 3781.513583031483,
      "loadMs": 4195.355833042413,
      "totalMs": 8057.622333057225,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3259.9871670245193,
      "durationMs": 3259.9871670245193,
      "imagesPerSecond": 0.30674967377639334,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3195.483833027538,
      "loadMs": 4195.355833042413,
      "totalMs": 7455.343000066932,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3366.6777500184253,
      "durationMs": 3366.6777500184253,
      "imagesPerSecond": 0.2970287251265813,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3302.3446669685654,
      "loadMs": 4195.355833042413,
      "totalMs": 7562.033583060838,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3580.815416004043,
      "durationMs": 3580.815416004043,
      "imagesPerSecond": 0.27926600056808704,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3519.8823750251904,
      "loadMs": 4195.355833042413,
      "totalMs": 7776.171249046456,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9941480014504477,
      "alphaMAE": 0.0033021510672350905,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3523.686542001087,
      "durationMs": 3523.686542001087,
      "imagesPerSecond": 0.2837936882524471,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3409.782250004355,
      "loadMs": 4195.355833042413,
      "totalMs": 7719.0423750435,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3347.116915974766,
      "durationMs": 3347.116915974766,
      "imagesPerSecond": 0.2987645860911836,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3271.6736670117825,
      "loadMs": 4195.355833042413,
      "totalMs": 7542.472749017179,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3523.802625015378,
      "durationMs": 3523.802625015378,
      "imagesPerSecond": 0.28378433936708813,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3459.1839580098167,
      "loadMs": 4195.355833042413,
      "totalMs": 7719.158458057791,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3375.552083947696,
      "durationMs": 3375.552083947696,
      "imagesPerSecond": 0.2962478359482173,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3310.490292031318,
      "loadMs": 4195.355833042413,
      "totalMs": 7570.907916990109,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4898.645874985959,
      "durationMs": 4898.645874985959,
      "imagesPerSecond": 0.2041380466194377,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 17379360768,
      "modelForwardMs": 4818.696625006851,
      "loadMs": 4165.711250039749,
      "totalMs": 9064.357125025708,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4593.414375034627,
      "durationMs": 4593.414375034627,
      "imagesPerSecond": 0.21770298047461953,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4528.820374980569,
      "loadMs": 4165.711250039749,
      "totalMs": 8759.125625074375,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4727.039291989058,
      "durationMs": 4727.039291989058,
      "imagesPerSecond": 0.21154890793793613,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4661.602000007406,
      "loadMs": 4165.711250039749,
      "totalMs": 8892.750542028807,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4603.559125040192,
      "durationMs": 4603.559125040192,
      "imagesPerSecond": 0.2172232337716026,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4541.126666008495,
      "loadMs": 4165.711250039749,
      "totalMs": 8769.270375079941,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9941365497695904,
      "alphaMAE": 0.003308946885855364,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4913.105374958832,
      "durationMs": 4913.105374958832,
      "imagesPerSecond": 0.20353725875630732,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4798.062707995996,
      "loadMs": 4165.711250039749,
      "totalMs": 9078.81662499858,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4334.068749973085,
      "durationMs": 4334.068749973085,
      "imagesPerSecond": 0.23073007321496922,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4259.226916998159,
      "loadMs": 4165.711250039749,
      "totalMs": 8499.780000012834,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4723.907083040103,
      "durationMs": 4723.907083040103,
      "imagesPerSecond": 0.21168917644257368,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4655.472209036816,
      "loadMs": 4165.711250039749,
      "totalMs": 8889.618333079852,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4322.050541988574,
      "durationMs": 4322.050541988574,
      "imagesPerSecond": 0.2313716580324626,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4255.3037499892525,
      "loadMs": 4165.711250039749,
      "totalMs": 8487.761792028323,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4363.254625000991,
      "durationMs": 4363.254625000991,
      "imagesPerSecond": 0.22918671632641033,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 17379360768,
      "modelForwardMs": 4283.4859160357155,
      "loadMs": 4201.3299579848535,
      "totalMs": 8564.584582985844,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4665.071499999613,
      "durationMs": 4665.071499999613,
      "imagesPerSecond": 0.21435898678082063,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4600.064166996162,
      "loadMs": 4201.3299579848535,
      "totalMs": 8866.401457984466,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4427.453499985859,
      "durationMs": 4427.453499985859,
      "imagesPerSecond": 0.2258634675673486,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4359.433000034187,
      "loadMs": 4201.3299579848535,
      "totalMs": 8628.783457970712,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4512.918958964292,
      "durationMs": 4512.918958964292,
      "imagesPerSecond": 0.22158607524153248,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4450.182333006524,
      "loadMs": 4201.3299579848535,
      "totalMs": 8714.248916949145,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9941365497695904,
      "alphaMAE": 0.003308946885855364,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4712.704625038896,
      "durationMs": 4712.704625038896,
      "imagesPerSecond": 0.21219237774566588,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4597.028792020865,
      "loadMs": 4201.3299579848535,
      "totalMs": 8914.03458302375,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4235.92429200653,
      "durationMs": 4235.92429200653,
      "imagesPerSecond": 0.2360759850895037,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4170.035750023089,
      "loadMs": 4201.3299579848535,
      "totalMs": 8437.254249991383,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4577.827291970607,
      "durationMs": 4577.827291970607,
      "imagesPerSecond": 0.21844423920360095,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4509.791249991395,
      "loadMs": 4201.3299579848535,
      "totalMs": 8779.15724995546,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4304.152500000782,
      "durationMs": 4304.152500000782,
      "imagesPerSecond": 0.23233377534829872,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4237.620499974582,
      "loadMs": 4201.3299579848535,
      "totalMs": 8505.482457985636,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4743.866375007201,
      "durationMs": 4743.866375007201,
      "imagesPerSecond": 0.21079851769612334,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 17379360768,
      "modelForwardMs": 4665.926542016678,
      "loadMs": 4215.486540982965,
      "totalMs": 8959.352915990166,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4509.308332984801,
      "durationMs": 4509.308332984801,
      "imagesPerSecond": 0.22176350033222944,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4445.074124960229,
      "loadMs": 4215.486540982965,
      "totalMs": 8724.794873967767,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4247.642000031192,
      "durationMs": 4247.642000031192,
      "imagesPerSecond": 0.23542473682872914,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4181.081416958477,
      "loadMs": 4215.486540982965,
      "totalMs": 8463.128541014157,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4320.022416999564,
      "durationMs": 4320.022416999564,
      "imagesPerSecond": 0.231480280302467,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4258.242334006354,
      "loadMs": 4215.486540982965,
      "totalMs": 8535.508957982529,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9941365497695904,
      "alphaMAE": 0.003308946885855364,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4563.905375020113,
      "durationMs": 4563.905375020113,
      "imagesPerSecond": 0.21911059012602624,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4442.612416984048,
      "loadMs": 4215.486540982965,
      "totalMs": 8779.391916003078,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4063.6477500083856,
      "durationMs": 4063.6477500083856,
      "imagesPerSecond": 0.24608432165360208,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 3986.0222910065204,
      "loadMs": 4215.486540982965,
      "totalMs": 8279.134290991351,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4531.345958006568,
      "durationMs": 4531.345958006568,
      "imagesPerSecond": 0.22068498173993328,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4463.268374965992,
      "loadMs": 4215.486540982965,
      "totalMs": 8746.832498989534,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4194.603374984581,
      "durationMs": 4194.603374984581,
      "imagesPerSecond": 0.23840156281848124,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4121.855375007726,
      "loadMs": 4215.486540982965,
      "totalMs": 8410.089915967546,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
      "individualFixturePassedBeforeConfigurationGate": false
    },
    "runtime": {
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
      "requestedDevice": "mps",
      "requestedPrecision": "bf16",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 4157.062665966805
    },
    "failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
  }
]

BiRefNet High Resolution Matting Desktop

49 configurations tested
Passed48
Failed1
TestedNov 13, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch642878 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643031 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643035 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643085 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643107 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643139 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643159 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643186 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643186 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643197 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643202 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643222 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643223 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643260 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643269 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643271 ms / 4211 ms
FP16mpsAcceleratedPassedFastmacos · aarch643274 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643353 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643356 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643362 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643381 ms / 4237 ms
FP16mpsAcceleratedPassedFastmacos · aarch643428 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643446 ms / 4523 ms
FP16mpsAcceleratedPassedFastmacos · aarch643451 ms / 4237 ms
FP32mpsAcceleratedPassedFastmacos · aarch643834 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch643838 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch643886 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch643899 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch643941 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch643973 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch643984 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch643991 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch643996 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch644003 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch644087 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch644104 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch644115 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch644136 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch644139 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch644157 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch644191 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch644203 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch644260 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch644285 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch644334 ms / 4194 ms
FP32mpsAcceleratedPassedFastmacos · aarch644367 ms / 4245 ms
FP32mpsAcceleratedPassedFastmacos · aarch644418 ms / 4189 ms
FP32mpsAcceleratedPassedFastmacos · aarch644433 ms / 4245 ms
BF16mpsFailed—Not recorded— / 4265 ms
Test setup & sample details
Quality gate
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
Tested
2026-11-13T05:48:11.367645+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
Runtime
pytorch 2.10.0
Artifact revision
5d6b6f8adcb5b417c871b1d84ceaae9871355b7f
Fixture
{
  "file": "research/birefnet-family-expansion/quality-gates.json",
  "size": 4905,
  "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb",
  "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897",
  "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json"
}
Rerun when
artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3445.671457971912,
      "durationMs": 3445.671457971912,
      "imagesPerSecond": 0.2902191959382541,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 8578646016,
      "modelForwardMs": 3366.02362501435,
      "loadMs": 4522.958375047892,
      "totalMs": 7968.629833019804,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3158.6959160049446,
      "durationMs": 3158.6959160049446,
      "imagesPerSecond": 0.31658634657836265,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3094.7231670143083,
      "loadMs": 4522.958375047892,
      "totalMs": 7681.654291052837,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3428.3137079910375,
      "durationMs": 3428.3137079910375,
      "imagesPerSecond": 0.2916885924613916,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3363.5450419969857,
      "loadMs": 4522.958375047892,
      "totalMs": 7951.27208303893,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3222.789334016852,
      "durationMs": 3222.789334016852,
      "imagesPerSecond": 0.31029021644229227,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3161.730332998559,
      "loadMs": 4522.958375047892,
      "totalMs": 7745.747709064744,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9942291930348869,
      "alphaMAE": 0.0032210049557890477,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3356.1892089783214,
      "durationMs": 3356.1892089783214,
      "imagesPerSecond": 0.29795697969734436,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3242.435624997597,
      "loadMs": 4522.958375047892,
      "totalMs": 7879.147584026214,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3185.9824169659987,
      "durationMs": 3185.9824169659987,
      "imagesPerSecond": 0.3138749274555937,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3121.2177500128746,
      "loadMs": 4522.958375047892,
      "totalMs": 7708.940792013891,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3201.910499949008,
      "durationMs": 3201.910499949008,
      "imagesPerSecond": 0.31231353906235837,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3136.768124997616,
      "loadMs": 4522.958375047892,
      "totalMs": 7724.868874996901,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3274.288666958455,
      "durationMs": 3274.288666958455,
      "imagesPerSecond": 0.3054098467527354,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3209.445584041532,
      "loadMs": 4522.958375047892,
      "totalMs": 7797.247042006347,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3361.5013750386424,
      "durationMs": 3361.5013750386424,
      "imagesPerSecond": 0.29748611957313403,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 8578646016,
      "modelForwardMs": 3282.2089580004103,
      "loadMs": 4237.277082982473,
      "totalMs": 7598.7784580211155,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3380.629916966427,
      "durationMs": 3380.629916966427,
      "imagesPerSecond": 0.29580286057970506,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3316.1099160206504,
      "loadMs": 4237.277082982473,
      "totalMs": 7617.9069999489,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3450.6303750094958,
      "durationMs": 3450.6303750094958,
      "imagesPerSecond": 0.2898021205755044,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3384.5502919866703,
      "loadMs": 4237.277082982473,
      "totalMs": 7687.907457991969,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3353.3877920126542,
      "durationMs": 3353.3877920126542,
      "imagesPerSecond": 0.29820589267423037,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3292.675083037466,
      "loadMs": 4237.277082982473,
      "totalMs": 7590.664874995127,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9942291930348869,
      "alphaMAE": 0.0032210049557890477,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3260.230457992293,
      "durationMs": 3260.230457992293,
      "imagesPerSecond": 0.3067267829329518,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3145.999833010137,
      "loadMs": 4237.277082982473,
      "totalMs": 7497.507540974766,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 2878.096624976024,
      "durationMs": 2878.096624976024,
      "imagesPerSecond": 0.34745185110257737,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 2812.1722909854725,
      "loadMs": 4237.277082982473,
      "totalMs": 7115.373707958497,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3269.001708016731,
      "durationMs": 3269.001708016731,
      "imagesPerSecond": 0.3059037863295243,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3204.5732919941656,
      "loadMs": 4237.277082982473,
      "totalMs": 7506.278790999204,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3085.294749995228,
      "durationMs": 3085.294749995228,
      "imagesPerSecond": 0.3241181413871549,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3020.1751249842346,
      "loadMs": 4237.277082982473,
      "totalMs": 7322.571832977701,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3196.9815000193194,
      "durationMs": 3196.9815000193194,
      "imagesPerSecond": 0.3127950537073665,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 8578646016,
      "modelForwardMs": 3113.456082995981,
      "loadMs": 4211.2095830379985,
      "totalMs": 7408.191083057318,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3221.5377090033144,
      "durationMs": 3221.5377090033144,
      "imagesPerSecond": 0.31041076974057275,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3155.057583004236,
      "loadMs": 4211.2095830379985,
      "totalMs": 7432.747292041313,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3270.7075829966925,
      "durationMs": 3270.7075829966925,
      "imagesPerSecond": 0.30574423870805917,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3202.9288330231793,
      "loadMs": 4211.2095830379985,
      "totalMs": 7481.917166034691,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3185.5726669891737,
      "durationMs": 3185.5726669891737,
      "imagesPerSecond": 0.31391530017902386,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3124.2352499975823,
      "loadMs": 4211.2095830379985,
      "totalMs": 7396.782250027172,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9942291930348869,
      "alphaMAE": 0.0032210049557890477,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3139.0768340206705,
      "durationMs": 3139.0768340206705,
      "imagesPerSecond": 0.31856499629515445,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3025.117125012912,
      "loadMs": 4211.2095830379985,
      "totalMs": 7350.286417058669,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3031.0132919694297,
      "durationMs": 3031.0132919694297,
      "imagesPerSecond": 0.329922670629478,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 2949.160666030366,
      "loadMs": 4211.2095830379985,
      "totalMs": 7242.222875007428,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3106.5301669877954,
      "durationMs": 3106.5301669877954,
      "imagesPerSecond": 0.3219025556637798,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 3042.4571670009755,
      "loadMs": 4211.2095830379985,
      "totalMs": 7317.739750025794,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3034.746332967188,
      "durationMs": 3034.746332967188,
      "imagesPerSecond": 0.32951683280304406,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 11128782848,
      "modelForwardMs": 2969.6445419685915,
      "loadMs": 4211.2095830379985,
      "totalMs": 7245.955916005187,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4366.546334000304,
      "durationMs": 4366.546334000304,
      "imagesPerSecond": 0.22901394454776677,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 17379360768,
      "modelForwardMs": 4291.005041974131,
      "loadMs": 4244.90649998188,
      "totalMs": 8611.452833982185,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4433.044916018844,
      "durationMs": 4433.044916018844,
      "imagesPerSecond": 0.22557858513602963,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4367.620624951087,
      "loadMs": 4244.90649998188,
      "totalMs": 8677.951416000724,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3837.7941249636933,
      "durationMs": 3837.7941249636933,
      "imagesPerSecond": 0.2605663481256854,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 3771.6443330282345,
      "loadMs": 4244.90649998188,
      "totalMs": 8082.7006249455735,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4104.099124961067,
      "durationMs": 4104.099124961067,
      "imagesPerSecond": 0.24365883219486964,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4042.425249994267,
      "loadMs": 4244.90649998188,
      "totalMs": 8349.005624942947,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.994267743230584,
      "alphaMAE": 0.003219345250911489,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4190.7087080180645,
      "durationMs": 4190.7087080180645,
      "imagesPerSecond": 0.2386231231215628,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4075.8705000043847,
      "loadMs": 4244.90649998188,
      "totalMs": 8435.615207999945,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4115.441625006497,
      "durationMs": 4115.441625006497,
      "imagesPerSecond": 0.24298728815001022,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4032.81074995175,
      "loadMs": 4244.90649998188,
      "totalMs": 8360.348124988377,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4284.669791988563,
      "durationMs": 4284.669791988563,
      "imagesPerSecond": 0.23339021407665791,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4216.193583037239,
      "loadMs": 4244.90649998188,
      "totalMs": 8529.576291970443,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3983.6874580360018,
      "durationMs": 3983.6874580360018,
      "imagesPerSecond": 0.2510237086955135,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 3918.059500050731,
      "loadMs": 4244.90649998188,
      "totalMs": 8228.593958017882,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4334.021707996726,
      "durationMs": 4334.021707996726,
      "imagesPerSecond": 0.23073257758605473,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 17379360768,
      "modelForwardMs": 4254.356874967925,
      "loadMs": 4193.5805000248365,
      "totalMs": 8527.602208021563,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3996.2219999870285,
      "durationMs": 3996.2219999870285,
      "imagesPerSecond": 0.25023634823171637,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 3931.7675420315936,
      "loadMs": 4193.5805000248365,
      "totalMs": 8189.802500011865,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4135.608417040203,
      "durationMs": 4135.608417040203,
      "imagesPerSecond": 0.2418023901585165,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4067.882666015066,
      "loadMs": 4193.5805000248365,
      "totalMs": 8329.18891706504,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3898.8012080080807,
      "durationMs": 3898.8012080080807,
      "imagesPerSecond": 0.2564890966859286,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 3836.618000001181,
      "loadMs": 4193.5805000248365,
      "totalMs": 8092.381708032917,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.994267743230584,
      "alphaMAE": 0.003219345250911489,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4202.602125005797,
      "durationMs": 4202.602125005797,
      "imagesPerSecond": 0.2379478166752749,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4087.7610839670524,
      "loadMs": 4193.5805000248365,
      "totalMs": 8396.182625030633,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3973.4087089891545,
      "durationMs": 3973.4087089891545,
      "imagesPerSecond": 0.25167307801426814,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 3907.9014169983566,
      "loadMs": 4193.5805000248365,
      "totalMs": 8166.989209013991,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4156.658750027418,
      "durationMs": 4156.658750027418,
      "imagesPerSecond": 0.2405778439217325,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4088.512207963504,
      "loadMs": 4193.5805000248365,
      "totalMs": 8350.239250052255,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4003.093582985457,
      "durationMs": 4003.093582985457,
      "imagesPerSecond": 0.2498068004830935,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 3936.2184169585817,
      "loadMs": 4193.5805000248365,
      "totalMs": 8196.674083010294,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4417.629250034224,
      "durationMs": 4417.629250034224,
      "imagesPerSecond": 0.22636575941547218,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 17379360768,
      "modelForwardMs": 4340.760540973861,
      "loadMs": 4188.805292011239,
      "totalMs": 8606.434542045463,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3990.923083969392,
      "durationMs": 3990.923083969392,
      "imagesPerSecond": 0.2505685975299216,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 3925.9643749683164,
      "loadMs": 4188.805292011239,
      "totalMs": 8179.7283759806305,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 4260.160582954995,
      "durationMs": 4260.160582954995,
      "imagesPerSecond": 0.23473293565529524,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 4194.770292029716,
      "loadMs": 4188.805292011239,
      "totalMs": 8448.965874966234,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3885.6149169732817,
      "durationMs": 3885.6149169732817,
      "imagesPerSecond": 0.25735952258978734,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 21405892608,
      "modelForwardMs": 3823.747332964558,
      "loadMs": 4188.805292011239,
      "totalMs": 8074.42020898452,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.994267743230584,
      "alphaMAE": 0.003219345250911489,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 3940.5082919984125,
      "durationMs": 3940.5082919984125,
      "imagesPerSecond": 0.25377436764454925,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 3820.9580829716288,
      "loadMs": 4188.805292011239,
      "totalMs": 8129.313584009651,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4139.336207997985,
      "durationMs": 4139.336207997985,
      "imagesPerSecond": 0.24158462848893736,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4070.721458992921,
      "loadMs": 4188.805292011239,
      "totalMs": 8328.141500009224,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3834.236833965406,
      "durationMs": 3834.236833965406,
      "imagesPerSecond": 0.26080809384061704,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 3766.0067910328507,
      "loadMs": 4188.805292011239,
      "totalMs": 8023.0421259766445,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 4087.1054580202326,
      "durationMs": 4087.1054580202326,
      "imagesPerSecond": 0.24467193476441235,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 25432424448,
      "modelForwardMs": 4021.845250041224,
      "loadMs": 4188.805292011239,
      "totalMs": 8275.910750031471,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
      "individualFixturePassedBeforeConfigurationGate": false
    },
    "runtime": {
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
      "requestedDevice": "mps",
      "requestedPrecision": "bf16",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 4265.32608398702
    },
    "failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
  }
]

BiRefNet Lite · Background removal Desktop

31 configurations tested
Passed30
Failed1
TestedNov 1, 2026
Runtimeonnxruntime 1.23.2

Quality criteria

{ "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }

PrecisionDeviceResultPlatformInference / loadTask metric
FP32cpuPassedModeratemacos · aarch643651 ms / 0 ms0.192 MP/s
FP32cpuPassedModeratemacos · aarch643657 ms / 0 ms0.191 MP/s
FP32cpuPassedModeratemacos · aarch643681 ms / 0 ms0.190 MP/s
FP32cpuPassedModeratemacos · aarch643690 ms / 0 ms0.190 MP/s
FP32cpuPassedModeratemacos · aarch643828 ms / 0 ms0.183 MP/s
FP32cpuPassedModeratemacos · aarch643846 ms / 0 ms0.182 MP/s
FP32cpuPassedModeratemacos · aarch644021 ms / 817 ms0.174 MP/s
FP32cpuPassedModeratemacos · aarch644048 ms / 829 ms0.173 MP/s
FP32cpuPassedModeratemacos · aarch644066 ms / 0 ms0.172 MP/s
FP32cpuPassedModeratemacos · aarch644117 ms / 756 ms0.170 MP/s
FP16coremlPassedModeratemacos · aarch648644 ms / 0 ms0.081 MP/s
FP16coremlPassedModeratemacos · aarch648644 ms / 0 ms0.081 MP/s
FP16coremlPassedModeratemacos · aarch648794 ms / 0 ms0.080 MP/s
FP16coremlPassedModeratemacos · aarch648879 ms / 0 ms0.079 MP/s
FP16coremlPassedModeratemacos · aarch648927 ms / 0 ms0.078 MP/s
FP16coremlPassedModeratemacos · aarch649018 ms / 0 ms0.078 MP/s
FP16coremlPassedModeratemacos · aarch649063 ms / 0 ms0.077 MP/s
FP16coremlPassedModeratemacos · aarch649255 ms / 6709 ms0.076 MP/s
FP16coremlPassedModeratemacos · aarch649318 ms / 6702 ms0.075 MP/s
FP16coremlPassedModeratemacos · aarch649772 ms / 6446 ms0.072 MP/s
FP32cpuPassedSlowmacos · aarch6410029 ms / 0 ms0.070 MP/s
FP32cpuPassedSlowmacos · aarch6410091 ms / 0 ms0.069 MP/s
FP32cpuPassedSlowmacos · aarch6410103 ms / 0 ms0.069 MP/s
FP32cpuPassedSlowmacos · aarch6410210 ms / 0 ms0.068 MP/s
FP32cpuPassedSlowmacos · aarch6410388 ms / 0 ms0.067 MP/s
FP32cpuPassedSlowmacos · aarch6410488 ms / 0 ms0.067 MP/s
FP32cpuPassedSlowmacos · aarch6410497 ms / 756 ms0.067 MP/s
FP32cpuPassedSlowmacos · aarch6410507 ms / 801 ms0.067 MP/s
FP32cpuPassedSlowmacos · aarch6410533 ms / 0 ms0.066 MP/s
FP32cpuPassedSlowmacos · aarch6410571 ms / 761 ms0.066 MP/s
FP32coremlFailed—macos · aarch64— / ——
Test setup & sample details
Quality gate
{ "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }
Tested
2026-11-01T23:22:07.116243+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2" }
Runtime
onnxruntime 1.23.2
Artifact revision
de15b22ba131738a16dff04aab8bdf8dc32e3ac1
Fixture
{
  "file": "model-samples/desktop/restoration-variants/birefnet-lite-portrait.png",
  "size": 577501,
  "sha1": "ca577ea142b1eb0f339735fd7c402f66ee6b0724",
  "sha256": "13862bac57ea6c661399643ec87753fd7f0b3fb15bf54f9273686c1053d3348b",
  "url": "https://assets.localai.tools/samples/v1/files/13862bac57ea6c661399643ec87753fd7f0b3fb15bf54f9273686c1053d3348b/birefnet-lite-portrait.png"
}
Rerun when
ONNX artifact revision or runtime build/version change; Preprocessing, alpha postprocessing, fixture/reference or quality gate change; Host OS/hardware/provider compatibility change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 800.5859999975655,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10596.61779099406,
      "inferenceMs": 10506.63958399673,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 11397.203790991625,
      "megapixelsPerSecond": 0.06656666904852093,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9939310775684148,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0033688924740999937,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10557.101042002614,
      "inferenceMs": 10488.128833996598,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10557.101042002614,
      "megapixelsPerSecond": 0.06668415415845824,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10163.088624998636,
      "inferenceMs": 10091.295374993933,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10163.088624998636,
      "megapixelsPerSecond": 0.06930646403761821,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10280.303082996397,
      "inferenceMs": 10210.224667003786,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10280.303082996397,
      "megapixelsPerSecond": 0.0684991783050782,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 761.448167002527,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10659.20954199828,
      "inferenceMs": 10571.063041003072,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 11420.657709000807,
      "megapixelsPerSecond": 0.06616099036465833,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10455.434415998752,
      "inferenceMs": 10388.011499999266,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10455.434415998752,
      "megapixelsPerSecond": 0.06732684113798386,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10171.742416998313,
      "inferenceMs": 10103.323040995747,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10171.742416998313,
      "megapixelsPerSecond": 0.06922395702504139,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 755.9057920007035,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10589.58229199925,
      "inferenceMs": 10497.437375001027,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 11345.488083999953,
      "megapixelsPerSecond": 0.06662502237599027,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10603.735374999815,
      "inferenceMs": 10533.20966699539,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10603.735374999815,
      "megapixelsPerSecond": 0.0663987542364665,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 10101.211249995686,
      "inferenceMs": 10029.33583399863,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 10101.211249995686,
      "megapixelsPerSecond": 0.06973462765391884,
      "fallback": false,
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 829.3018749973271,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 4148.999208002351,
      "inferenceMs": 4047.8482079997775,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 4978.301082999678,
      "megapixelsPerSecond": 0.1727811825102011,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9939310775684148,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0033688924740999937,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 3896.2853330012877,
      "inferenceMs": 3828.124542000296,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 3896.2853330012877,
      "megapixelsPerSecond": 0.18269834022551137,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 3758.3014169940725,
      "inferenceMs": 3690.1569170004223,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 3758.3014169940725,
      "megapixelsPerSecond": 0.1895290676604905,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 3724.6950000044308,
      "inferenceMs": 3656.947791998391,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 3724.6950000044308,
      "megapixelsPerSecond": 0.1912502009272075,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 755.9178329975111,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 4214.968667001813,
      "inferenceMs": 4116.548917001637,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 4970.886499999324,
      "megapixelsPerSecond": 0.1698976531315981,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 3914.108541997848,
      "inferenceMs": 3845.9412080046604,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 3914.108541997848,
      "megapixelsPerSecond": 0.18185197385345794,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 3748.7109169960604,
      "inferenceMs": 3681.035374997009,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 3748.7109169960604,
      "megapixelsPerSecond": 0.18999871741264326,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 816.588417001185,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 4121.43791699782,
      "inferenceMs": 4020.677207998233,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 4938.026333999005,
      "megapixelsPerSecond": 0.17394880608886407,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 4133.243708005466,
      "inferenceMs": 4066.1570000011125,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 4133.243708005466,
      "megapixelsPerSecond": 0.17200319613822307,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9941213544310151,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034127291291952133,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "cpu",
      "placementVerified": false,
      "gpuPlanOperations": 0,
      "gpuPlanSamples": [],
      "durationMs": 3718.5582499951124,
      "inferenceMs": 3651.4125839967164,
      "provider": "CPUExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 3785
      },
      "coremlComputeUnits": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 3718.5582499951124,
      "megapixelsPerSecond": 0.19154011876534327,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 6445.599917002255,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 9875.475415996334,
      "inferenceMs": 9771.890208001423,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 16321.07533299859,
      "megapixelsPerSecond": 0.07157182337428675,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.9939421998850915,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.003368903649970889,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 9132.533042000432,
      "inferenceMs": 9062.554457996157,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 9132.533042000432,
      "megapixelsPerSecond": 0.07717382590544392,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 8946.505167004943,
      "inferenceMs": 8878.772916003072,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 8946.505167004943,
      "megapixelsPerSecond": 0.07877124537552009,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 8863.966249999066,
      "inferenceMs": 8794.275000000198,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 8863.966249999066,
      "megapixelsPerSecond": 0.07952810208914143,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 6709.003791998839,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 9358.475207998708,
      "inferenceMs": 9254.921250001644,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 16067.478999997547,
      "megapixelsPerSecond": 0.07556974080140075,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 9086.968625000736,
      "inferenceMs": 9018.349750003836,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 9086.968625000736,
      "megapixelsPerSecond": 0.07755210425274342,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 8712.19837499666,
      "inferenceMs": 8644.10633299849,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 8712.19837499666,
      "megapixelsPerSecond": 0.08090969419592889,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 6701.549208999495,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 9421.282999996038,
      "inferenceMs": 9318.32916699932,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 16122.832208995533,
      "megapixelsPerSecond": 0.07505551558286684,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 8996.00216599356,
      "inferenceMs": 8926.818624997395,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 8996.00216599356,
      "megapixelsPerSecond": 0.07834728466886534,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp16",
    "device": "coreml",
    "status": "pass",
    "quality": {
      "passed": true,
      "intersectionOverUnion": 0.994126899136604,
      "minimumIoU": 0.7,
      "meanAbsoluteAlphaError": 0.0034119493793696165,
      "maximumMeanAbsoluteAlphaError": 0.16,
      "validRgbaAndMask": true
    },
    "runtime": {
      "engine": "onnxruntime",
      "version": "1.23.2",
      "providers": [
        "CoreMLExecutionProvider",
        "CPUExecutionProvider"
      ],
      "loadMs": 0,
      "acceleration": "partial",
      "placementVerified": false,
      "gpuPlanOperations": 23,
      "gpuPlanSamples": [
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
        "ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257"
      ],
      "durationMs": 8712.29024999775,
      "inferenceMs": 8644.211207996705,
      "provider": "CoreMLExecutionProvider",
      "placement": {
        "CPUExecutionProvider": 4538,
        "CoreMLExecutionProvider": 79
      },
      "coremlComputeUnits": "CPUAndGPU",
      "device": "coreml",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
      "totalMs": 8712.29024999775,
      "megapixelsPerSecond": 0.08090871256743437,
      "fallback": false,
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "coreml",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": "Not embedded",
    "failure": "[ONNXRuntimeError] : 1 : FAIL : Error compiling model: Failed to parse the model specification. Error: Unable to parse ML Program: in operation /squeeze_module/squeeze_module.0/dec_att/aspp_deforms.2/atrous_conv/Conv: Required param 'pad' is missing"
  }
]

BiRefNet Lite · 2K Desktop

49 configurations tested
Passed48
Failed1
TestedNov 13, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch64877 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch64908 ms / 2309 ms
FP16mpsAcceleratedPassedFastmacos · aarch64950 ms / 2395 ms
FP16mpsAcceleratedPassedFastmacos · aarch641035 ms / 2395 ms
FP16mpsAcceleratedPassedFastmacos · aarch641038 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641041 ms / 2309 ms
FP16mpsAcceleratedPassedFastmacos · aarch641048 ms / 2395 ms
FP16mpsAcceleratedPassedFastmacos · aarch641058 ms / 2309 ms
FP16mpsAcceleratedPassedFastmacos · aarch641090 ms / 2309 ms
FP16mpsAcceleratedPassedFastmacos · aarch641091 ms / 2309 ms
FP16mpsAcceleratedPassedFastmacos · aarch641106 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641118 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641137 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641150 ms / 2395 ms
FP16mpsAcceleratedPassedFastmacos · aarch641151 ms / 2395 ms
FP16mpsAcceleratedPassedFastmacos · aarch641156 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641156 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641169 ms / 2395 ms
FP16mpsAcceleratedPassedFastmacos · aarch641169 ms / 2309 ms
FP16mpsAcceleratedPassedFastmacos · aarch641187 ms / 2321 ms
FP16mpsAcceleratedPassedFastmacos · aarch641224 ms / 2309 ms
FP32mpsAcceleratedPassedFastmacos · aarch641232 ms / 2284 ms
FP32mpsAcceleratedPassedFastmacos · aarch641282 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641314 ms / 2249 ms
FP32mpsAcceleratedPassedFastmacos · aarch641322 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641390 ms / 2284 ms
FP32mpsAcceleratedPassedFastmacos · aarch641417 ms / 2284 ms
FP32mpsAcceleratedPassedFastmacos · aarch641420 ms / 2249 ms
FP32mpsAcceleratedPassedFastmacos · aarch641430 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641434 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641443 ms / 2249 ms
FP32mpsAcceleratedPassedFastmacos · aarch641443 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641453 ms / 2249 ms
FP16mpsAcceleratedPassedFastmacos · aarch641469 ms / 2309 ms
FP32mpsAcceleratedPassedFastmacos · aarch641472 ms / 2284 ms
FP16mpsAcceleratedPassedFastmacos · aarch641475 ms / 2395 ms
FP32mpsAcceleratedPassedFastmacos · aarch641476 ms / 2249 ms
FP16mpsAcceleratedPassedFastmacos · aarch641498 ms / 2395 ms
FP32mpsAcceleratedPassedFastmacos · aarch641500 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641511 ms / 2284 ms
FP32mpsAcceleratedPassedFastmacos · aarch641537 ms / 2249 ms
FP32mpsAcceleratedPassedFastmacos · aarch641557 ms / 2284 ms
FP32mpsAcceleratedPassedFastmacos · aarch641695 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641695 ms / 2284 ms
FP32mpsAcceleratedPassedFastmacos · aarch641734 ms / 2268 ms
FP32mpsAcceleratedPassedFastmacos · aarch641736 ms / 2249 ms
FP32mpsAcceleratedPassedFastmacos · aarch641785 ms / 2249 ms
FP32mpsAcceleratedPassedFastmacos · aarch641991 ms / 2284 ms
BF16mpsFailed—Not recorded— / 2231 ms
Test setup & sample details
Quality gate
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
Tested
2026-11-13T05:48:11.367645+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
Runtime
pytorch 2.10.0
Artifact revision
3f789d2ba403e2ee59ce08ee9250d4c1c590b418
Fixture
{
  "file": "research/birefnet-family-expansion/quality-gates.json",
  "size": 4905,
  "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb",
  "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897",
  "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json"
}
Rerun when
artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1475.3095000050962,
      "durationMs": 1475.3095000050962,
      "imagesPerSecond": 0.6778238735645271,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6775095296,
      "modelForwardMs": 1374.3811669992283,
      "loadMs": 2395.289166015573,
      "totalMs": 3870.598666020669,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 0.9996596985901799,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1497.8151670075022,
      "durationMs": 1497.8151670075022,
      "imagesPerSecond": 0.6676391199842826,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1434.542250004597,
      "loadMs": 2395.289166015573,
      "totalMs": 3893.104333023075,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1048.1954170390964,
      "durationMs": 1048.1954170390964,
      "imagesPerSecond": 0.9540205802700064,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 983.0330419936217,
      "loadMs": 2395.289166015573,
      "totalMs": 3443.484583054669,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1150.3253750270233,
      "durationMs": 1150.3253750270233,
      "imagesPerSecond": 0.8693192567159602,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1088.2758750231005,
      "loadMs": 2395.289166015573,
      "totalMs": 3545.614541042596,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9933979585572614,
      "alphaMAE": 0.0034247898006200986,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1168.663208023645,
      "durationMs": 1168.663208023645,
      "imagesPerSecond": 0.85567851638893,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1054.9885830259882,
      "loadMs": 2395.289166015573,
      "totalMs": 3563.952374039218,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 949.7734589967877,
      "durationMs": 949.7734589967877,
      "imagesPerSecond": 1.0528826537817395,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 884.8739169770852,
      "loadMs": 2395.289166015573,
      "totalMs": 3345.0626250123605,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1034.7766249906272,
      "durationMs": 1034.7766249906272,
      "imagesPerSecond": 0.9663921428540753,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 970.0599170173518,
      "loadMs": 2395.289166015573,
      "totalMs": 3430.0657910062,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1150.5272919894196,
      "durationMs": 1150.5272919894196,
      "imagesPerSecond": 0.8691666916226409,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1085.076667019166,
      "loadMs": 2395.289166015573,
      "totalMs": 3545.8164580049925,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1037.8201249986887,
      "durationMs": 1037.8201249986887,
      "imagesPerSecond": 0.9635581117693816,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6775095296,
      "modelForwardMs": 928.0472079990432,
      "loadMs": 2321.237459022086,
      "totalMs": 3359.057584020775,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 0.9996596985901799,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1187.1621669852175,
      "durationMs": 1187.1621669852175,
      "imagesPerSecond": 0.8423449026677515,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1123.189750011079,
      "loadMs": 2321.237459022086,
      "totalMs": 3508.3996260073036,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1137.0677500381134,
      "durationMs": 1137.0677500381134,
      "imagesPerSecond": 0.8794550720187789,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1072.5710830301978,
      "loadMs": 2321.237459022086,
      "totalMs": 3458.3052090601996,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1106.1700000427663,
      "durationMs": 1106.1700000427663,
      "imagesPerSecond": 0.9040201776954161,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1045.5998749821447,
      "loadMs": 2321.237459022086,
      "totalMs": 3427.4074590648524,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9933979585572614,
      "alphaMAE": 0.0034247898006200986,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1155.5273749982007,
      "durationMs": 1155.5273749982007,
      "imagesPerSecond": 0.8654057200519002,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1041.9526670011692,
      "loadMs": 2321.237459022086,
      "totalMs": 3476.764834020287,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 876.7335420125164,
      "durationMs": 876.7335420125164,
      "imagesPerSecond": 1.1405974016969045,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 811.4788340171799,
      "loadMs": 2321.237459022086,
      "totalMs": 3197.9710010346025,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1155.750000034459,
      "durationMs": 1155.750000034459,
      "imagesPerSecond": 0.8652390222541075,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1091.6143750073388,
      "loadMs": 2321.237459022086,
      "totalMs": 3476.987459056545,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1117.580333026126,
      "durationMs": 1117.580333026126,
      "imagesPerSecond": 0.8947902628997165,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1052.3519160342403,
      "loadMs": 2321.237459022086,
      "totalMs": 3438.817792048212,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1041.462832945399,
      "durationMs": 1041.462832945399,
      "imagesPerSecond": 0.9601878899238906,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6775095296,
      "modelForwardMs": 939.480957982596,
      "loadMs": 2308.862542035058,
      "totalMs": 3350.325374980457,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 0.9996596985901799,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1169.1893329843879,
      "durationMs": 1169.1893329843879,
      "imagesPerSecond": 0.8552934685501044,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1106.1228750040755,
      "loadMs": 2308.862542035058,
      "totalMs": 3478.051875019446,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1089.9382089846767,
      "durationMs": 1089.9382089846767,
      "imagesPerSecond": 0.9174832038703754,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1025.0069169560447,
      "loadMs": 2308.862542035058,
      "totalMs": 3398.800751019735,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1090.8230420318432,
      "durationMs": 1090.8230420318432,
      "imagesPerSecond": 0.9167389773297511,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1029.9959169933572,
      "loadMs": 2308.862542035058,
      "totalMs": 3399.6855840669014,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9933979585572614,
      "alphaMAE": 0.0034247898006200986,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1224.255541979801,
      "durationMs": 1224.255541979801,
      "imagesPerSecond": 0.816822930924089,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1110.829040990211,
      "loadMs": 2308.862542035058,
      "totalMs": 3533.118084014859,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 907.6083750114776,
      "durationMs": 907.6083750114776,
      "imagesPerSecond": 1.1017967964292463,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 841.0210000001825,
      "loadMs": 2308.862542035058,
      "totalMs": 3216.4709170465358,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1469.2361250054091,
      "durationMs": 1469.2361250054091,
      "imagesPerSecond": 0.6806257911718026,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 1400.1822500140406,
      "loadMs": 2308.862542035058,
      "totalMs": 3778.0986670404673,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1058.047832979355,
      "durationMs": 1058.047832979355,
      "imagesPerSecond": 0.945136853769741,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 7781728256,
      "modelForwardMs": 993.789249972906,
      "loadMs": 2308.862542035058,
      "totalMs": 3366.910375014413,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1784.8527919850312,
      "durationMs": 1784.8527919850312,
      "imagesPerSecond": 0.5602702948335846,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 12202524672,
      "modelForwardMs": 1681.3543749740347,
      "loadMs": 2249.4864159962162,
      "totalMs": 4034.3392079812475,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 0.9996434937611408,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1452.9392090043984,
      "durationMs": 1452.9392090043984,
      "imagesPerSecond": 0.6882600413029205,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1388.0548330489546,
      "loadMs": 2249.4864159962162,
      "totalMs": 3702.4256250006147,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1443.3019169955514,
      "durationMs": 1443.3019169955514,
      "imagesPerSecond": 0.6928557277064035,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1377.8368750354275,
      "loadMs": 2249.4864159962162,
      "totalMs": 3692.7883329917677,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1735.800124995876,
      "durationMs": 1735.800124995876,
      "imagesPerSecond": 0.5761031962147,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1673.7642079824582,
      "loadMs": 2249.4864159962162,
      "totalMs": 3985.2865409920923,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9934258623672476,
      "alphaMAE": 0.0034182126593316656,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1536.5738750551827,
      "durationMs": 1536.5738750551827,
      "imagesPerSecond": 0.6507985175552247,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1422.3834160366096,
      "loadMs": 2249.4864159962162,
      "totalMs": 3786.060291051399,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1314.3941250164062,
      "durationMs": 1314.3941250164062,
      "imagesPerSecond": 0.7608068089832021,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1237.7633749856614,
      "loadMs": 2249.4864159962162,
      "totalMs": 3563.8805410126224,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1420.3191249980591,
      "durationMs": 1420.3191249980591,
      "imagesPerSecond": 0.704067122944195,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1352.9512920067646,
      "loadMs": 2249.4864159962162,
      "totalMs": 3669.8055409942754,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1476.3166250195354,
      "durationMs": 1476.3166250195354,
      "imagesPerSecond": 0.6773614704682794,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1410.8843749854714,
      "loadMs": 2249.4864159962162,
      "totalMs": 3725.8030410157517,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1990.8007089979947,
      "durationMs": 1990.8007089979947,
      "imagesPerSecond": 0.5023104500014558,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 12202524672,
      "modelForwardMs": 1883.8970420183614,
      "loadMs": 2284.042707993649,
      "totalMs": 4274.843416991644,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 0.9996434937611408,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1511.1444999929518,
      "durationMs": 1511.1444999929518,
      "imagesPerSecond": 0.661750084128066,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1446.2688749772497,
      "loadMs": 2284.042707993649,
      "totalMs": 3795.1872079866007,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1390.4652089695446,
      "durationMs": 1390.4652089695446,
      "imagesPerSecond": 0.7191837620598122,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1324.6304159983993,
      "loadMs": 2284.042707993649,
      "totalMs": 3674.5079169631936,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1556.679792003706,
      "durationMs": 1556.679792003706,
      "imagesPerSecond": 0.6423928704777708,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1494.622124999296,
      "loadMs": 2284.042707993649,
      "totalMs": 3840.722499997355,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9934258623672476,
      "alphaMAE": 0.0034182126593316656,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1471.6833750135265,
      "durationMs": 1471.6833750135265,
      "imagesPerSecond": 0.6794939842211704,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1356.475209002383,
      "loadMs": 2284.042707993649,
      "totalMs": 3755.7260830071755,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1232.4258330045268,
      "durationMs": 1232.4258330045268,
      "imagesPerSecond": 0.8114078536978597,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1167.9494170239195,
      "loadMs": 2284.042707993649,
      "totalMs": 3516.4685409981757,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1695.4029580228962,
      "durationMs": 1695.4029580228962,
      "imagesPerSecond": 0.5898302791485959,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1630.165999988094,
      "loadMs": 2284.042707993649,
      "totalMs": 3979.445666016545,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1416.9141669990495,
      "durationMs": 1416.9141669990495,
      "imagesPerSecond": 0.7057590525175904,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1350.1059169648215,
      "loadMs": 2284.042707993649,
      "totalMs": 3700.9568749926984,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1694.590583036188,
      "durationMs": 1694.590583036188,
      "imagesPerSecond": 0.5901130396985365,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 12202524672,
      "modelForwardMs": 1594.8450419818982,
      "loadMs": 2267.645000014454,
      "totalMs": 3962.235583050642,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 0.9996434937611408,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1434.4687080010772,
      "durationMs": 1434.4687080010772,
      "imagesPerSecond": 0.6971222128599052,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1370.3180409502238,
      "loadMs": 2267.645000014454,
      "totalMs": 3702.1137080155313,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1429.9537079641595,
      "durationMs": 1429.9537079641595,
      "imagesPerSecond": 0.6993233378328805,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1364.5840419922024,
      "loadMs": 2267.645000014454,
      "totalMs": 3697.5987079786137,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1733.6562919663265,
      "durationMs": 1733.6562919663265,
      "imagesPerSecond": 0.5768156033199592,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1671.7704590409994,
      "loadMs": 2267.645000014454,
      "totalMs": 4001.3012919807807,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9934258623672476,
      "alphaMAE": 0.0034182126593316656,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1499.5460829813965,
      "durationMs": 1499.5460829813965,
      "imagesPerSecond": 0.6668684686313879,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1382.2347500245087,
      "loadMs": 2267.645000014454,
      "totalMs": 3767.1910829958506,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1281.7042500246316,
      "durationMs": 1281.7042500246316,
      "imagesPerSecond": 0.7802111914513681,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1217.1745829982683,
      "loadMs": 2267.645000014454,
      "totalMs": 3549.3492500390857,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1322.0552499988116,
      "durationMs": 1322.0552499988116,
      "imagesPerSecond": 0.7563980400977182,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1256.7933339742012,
      "loadMs": 2267.645000014454,
      "totalMs": 3589.7002500132658,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 1443.3906250051223,
      "durationMs": 1443.3906250051223,
      "imagesPerSecond": 0.6928131461269892,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 14215790592,
      "modelForwardMs": 1376.749666989781,
      "loadMs": 2267.645000014454,
      "totalMs": 3711.0356250195764,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
      "individualFixturePassedBeforeConfigurationGate": false
    },
    "runtime": {
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
      "requestedDevice": "mps",
      "requestedPrecision": "bf16",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 2231.328374997247
    },
    "failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
  }
]

BiRefNet Portrait Desktop

52 configurations tested
Passed48
Failed4
TestedNov 13, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch64611 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64623 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64652 ms / 4155 ms
FP16mpsAcceleratedPassedFastmacos · aarch64653 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64653 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64654 ms / 4155 ms
FP16mpsAcceleratedPassedFastmacos · aarch64655 ms / 4155 ms
FP16mpsAcceleratedPassedFastmacos · aarch64656 ms / 4155 ms
FP16mpsAcceleratedPassedFastmacos · aarch64657 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64662 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64662 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64679 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64679 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64683 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64687 ms / 4155 ms
FP16mpsAcceleratedPassedFastmacos · aarch64696 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64697 ms / 4155 ms
FP16mpsAcceleratedPassedFastmacos · aarch64701 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64704 ms / 4227 ms
FP16mpsAcceleratedPassedFastmacos · aarch64706 ms / 4155 ms
FP32mpsAcceleratedPassedFastmacos · aarch64735 ms / 4680 ms
FP16mpsAcceleratedPassedFastmacos · aarch64738 ms / 4271 ms
FP32mpsAcceleratedPassedFastmacos · aarch64743 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64762 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch64765 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64766 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64769 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch64772 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch64773 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64774 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch64778 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch64782 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch64783 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch64787 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch64792 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64798 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch64800 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64820 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch64826 ms / 4503 ms
FP32mpsAcceleratedPassedFastmacos · aarch64837 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch64845 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch64904 ms / 4595 ms
FP16mpsAcceleratedPassedFastmacos · aarch64916 ms / 4271 ms
FP16mpsAcceleratedPassedFastmacos · aarch64937 ms / 4227 ms
FP32mpsAcceleratedPassedFastmacos · aarch641009 ms / 4680 ms
FP32mpsAcceleratedPassedFastmacos · aarch641012 ms / 4595 ms
FP32mpsAcceleratedPassedFastmacos · aarch641043 ms / 4503 ms
FP16mpsAcceleratedPassedFastmacos · aarch641121 ms / 4155 ms
BF16mpsFailed—Not recorded— / 4269 ms
FP32cpuFailed—Not recorded8324 ms / 5230 ms
FP32cpuFailed—Not recorded7961 ms / 5230 ms
FP32cpuFailed—Not recorded10352 ms / 5230 ms
Test setup & sample details
Quality gate
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
Tested
2026-11-13T05:48:11.367645+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
Runtime
pytorch 2.10.0
Artifact revision
b6561965a70070d9143fd9e558f6ca3c481510db
Fixture
{
  "file": "research/birefnet-family-expansion/quality-gates.json",
  "size": 4905,
  "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb",
  "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897",
  "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json"
}
Rerun when
artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1120.889125042595,
      "durationMs": 1120.889125042595,
      "imagesPerSecond": 0.8921489000635981,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 1094.689958030358,
      "loadMs": 4155.396541988011,
      "totalMs": 5276.285667030606,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 655.8363750227727,
      "durationMs": 655.8363750227727,
      "imagesPerSecond": 1.5247705648612078,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 636.0622079810128,
      "loadMs": 4155.396541988011,
      "totalMs": 4811.232917010784,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 687.277749995701,
      "durationMs": 687.277749995701,
      "imagesPerSecond": 1.45501582148739,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 666.4045840152539,
      "loadMs": 4155.396541988011,
      "totalMs": 4842.6742919837125,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 706.3681249856018,
      "durationMs": 706.3681249856018,
      "imagesPerSecond": 1.4156924196153153,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 689.3360420363024,
      "loadMs": 4155.396541988011,
      "totalMs": 4861.764666973613,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9927361990571564,
      "alphaMAE": 0.0036986298911951283,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 696.7470000381581,
      "durationMs": 696.7470000381581,
      "imagesPerSecond": 1.4352411993811727,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 634.4311659922823,
      "loadMs": 4155.396541988011,
      "totalMs": 4852.14354202617,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 654.8350409721024,
      "durationMs": 654.8350409721024,
      "imagesPerSecond": 1.5271021515823286,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 633.1552500487305,
      "loadMs": 4155.396541988011,
      "totalMs": 4810.231582960114,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 651.968999998644,
      "durationMs": 651.968999998644,
      "imagesPerSecond": 1.5338152580906146,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 630.4231669637375,
      "loadMs": 4155.396541988011,
      "totalMs": 4807.365541986655,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 653.7441249820404,
      "durationMs": 653.7441249820404,
      "imagesPerSecond": 1.5296504577038792,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 632.7912499546073,
      "loadMs": 4155.396541988011,
      "totalMs": 4809.140666970052,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 937.1302080107853,
      "durationMs": 937.1302080107853,
      "imagesPerSecond": 1.0670875737990202,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 911.0048749716952,
      "loadMs": 4227.310749993194,
      "totalMs": 5164.440958003979,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 704.4124999665655,
      "durationMs": 704.4124999665655,
      "imagesPerSecond": 1.4196227353254867,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 684.9117090459913,
      "loadMs": 4227.310749993194,
      "totalMs": 4931.723249959759,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 611.1600419972092,
      "durationMs": 611.1600419972092,
      "imagesPerSecond": 1.6362326253072783,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 589.6069589653052,
      "loadMs": 4227.310749993194,
      "totalMs": 4838.470791990403,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 623.3026249683462,
      "durationMs": 623.3026249683462,
      "imagesPerSecond": 1.6043571131290904,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 605.6082499562763,
      "loadMs": 4227.310749993194,
      "totalMs": 4850.61337496154,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9927361990571564,
      "alphaMAE": 0.0036986298911951283,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 700.6471669883467,
      "durationMs": 700.6471669883467,
      "imagesPerSecond": 1.427251899552221,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 637.3582079540938,
      "loadMs": 4227.310749993194,
      "totalMs": 4927.957916981541,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 661.8846249766648,
      "durationMs": 661.8846249766648,
      "imagesPerSecond": 1.5108373306529908,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 640.0230409926735,
      "loadMs": 4227.310749993194,
      "totalMs": 4889.195374969859,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 678.9492500247434,
      "durationMs": 678.9492500247434,
      "imagesPerSecond": 1.4728641352259486,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 656.9729580078274,
      "loadMs": 4227.310749993194,
      "totalMs": 4906.260000017937,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 653.292250004597,
      "durationMs": 653.292250004597,
      "imagesPerSecond": 1.5307084998987257,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 631.6815000027418,
      "loadMs": 4227.310749993194,
      "totalMs": 4880.602999997791,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 916.1853329860605,
      "durationMs": 916.1853329860605,
      "imagesPerSecond": 1.091482218713072,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 889.9674160056747,
      "loadMs": 4270.781708997674,
      "totalMs": 5186.967041983735,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 683.2597909960896,
      "durationMs": 683.2597909960896,
      "imagesPerSecond": 1.4635721480729182,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 662.8712079836987,
      "loadMs": 4270.781708997674,
      "totalMs": 4954.041499993764,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 656.625708041247,
      "durationMs": 656.625708041247,
      "imagesPerSecond": 1.52293763060703,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 633.8894170476124,
      "loadMs": 4270.781708997674,
      "totalMs": 4927.407417038921,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 652.6740840054117,
      "durationMs": 652.6740840054117,
      "imagesPerSecond": 1.5321582770118207,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 635.3105830494314,
      "loadMs": 4270.781708997674,
      "totalMs": 4923.455793003086,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9927361990571564,
      "alphaMAE": 0.0036986298911951283,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 738.0380830145441,
      "durationMs": 738.0380830145441,
      "imagesPerSecond": 1.354943630978313,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 675.7624169695191,
      "loadMs": 4270.781708997674,
      "totalMs": 5008.819792012218,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 679.4781670323573,
      "durationMs": 679.4781670323573,
      "imagesPerSecond": 1.471717633500326,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 657.8237499925308,
      "loadMs": 4270.781708997674,
      "totalMs": 4950.259876030032,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 662.3080410063267,
      "durationMs": 662.3080410063267,
      "imagesPerSecond": 1.5098714466467538,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 639.2512079910375,
      "loadMs": 4270.781708997674,
      "totalMs": 4933.089750004001,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 695.6062500248663,
      "durationMs": 695.6062500248663,
      "imagesPerSecond": 1.4375949036746756,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 3681796096,
      "modelForwardMs": 671.7277080169879,
      "loadMs": 4270.781708997674,
      "totalMs": 4966.387959022541,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp16",
      "actualPrecision": "fp16",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1043.3020000346005,
      "durationMs": 1043.3020000346005,
      "imagesPerSecond": 0.9584952391223592,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 1017.4104170291685,
      "loadMs": 4502.6455000042915,
      "totalMs": 5545.947500038892,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 765.3659170027822,
      "durationMs": 765.3659170027822,
      "imagesPerSecond": 1.3065645827502466,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 743.3151250006631,
      "loadMs": 4502.6455000042915,
      "totalMs": 5268.011417007074,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 766.2040829891339,
      "durationMs": 766.2040829891339,
      "imagesPerSecond": 1.3051353055947912,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 745.5540830269456,
      "loadMs": 4502.6455000042915,
      "totalMs": 5268.849582993425,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 772.9746249970049,
      "durationMs": 772.9746249970049,
      "imagesPerSecond": 1.2937035287592717,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 754.0331670315936,
      "loadMs": 4502.6455000042915,
      "totalMs": 5275.620125001296,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9927302956420828,
      "alphaMAE": 0.003696504796098524,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 826.2182080070488,
      "durationMs": 826.2182080070488,
      "imagesPerSecond": 1.2103340138341137,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 761.4825409837067,
      "loadMs": 4502.6455000042915,
      "totalMs": 5328.86370801134,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 742.5603750161827,
      "durationMs": 742.5603750161827,
      "imagesPerSecond": 1.3466918430413244,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 717.6350409863517,
      "loadMs": 4502.6455000042915,
      "totalMs": 5245.205875020474,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 799.6798329986632,
      "durationMs": 799.6798329986632,
      "imagesPerSecond": 1.2505004612285524,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 776.7993750167079,
      "loadMs": 4502.6455000042915,
      "totalMs": 5302.325333002955,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 792.4912919988856,
      "durationMs": 792.4912919988856,
      "imagesPerSecond": 1.2618435181511196,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 766.2846670136787,
      "loadMs": 4502.6455000042915,
      "totalMs": 5295.136792003177,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1009.0817910386249,
      "durationMs": 1009.0817910386249,
      "imagesPerSecond": 0.9909999455749992,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 983.4377500228584,
      "loadMs": 4679.871624975931,
      "totalMs": 5688.953416014556,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 771.7518330318853,
      "durationMs": 771.7518330318853,
      "imagesPerSecond": 1.2957533201721394,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 748.4757500351407,
      "loadMs": 4679.871624975931,
      "totalMs": 5451.623458007816,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 819.968499999959,
      "durationMs": 819.968499999959,
      "imagesPerSecond": 1.2195590440365087,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 795.8695419947617,
      "loadMs": 4679.871624975931,
      "totalMs": 5499.84012497589,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 783.4260829840787,
      "durationMs": 783.4260829840787,
      "imagesPerSecond": 1.2764446087766046,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 763.9480829820968,
      "loadMs": 4679.871624975931,
      "totalMs": 5463.29770796001,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9927302956420828,
      "alphaMAE": 0.003696504796098524,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 837.1554999612272,
      "durationMs": 837.1554999612272,
      "imagesPerSecond": 1.1945212090780206,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 770.893957989756,
      "loadMs": 4679.871624975931,
      "totalMs": 5517.027124937158,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 735.2553329546936,
      "durationMs": 735.2553329546936,
      "imagesPerSecond": 1.3600717399510789,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 712.8836250049062,
      "loadMs": 4679.871624975931,
      "totalMs": 5415.1269579306245,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 786.9681669981219,
      "durationMs": 786.9681669981219,
      "imagesPerSecond": 1.270699428433662,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 764.2574170022272,
      "loadMs": 4679.871624975931,
      "totalMs": 5466.839791974053,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 798.1832919758745,
      "durationMs": 798.1832919758745,
      "imagesPerSecond": 1.2528450671080016,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 776.0327500291169,
      "loadMs": 4679.871624975931,
      "totalMs": 5478.054916951805,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 1012.3289999901317,
      "durationMs": 1012.3289999901317,
      "imagesPerSecond": 0.9878211530142356,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 986.0957499477081,
      "loadMs": 4595.023499976378,
      "totalMs": 5607.35249996651,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 761.8123749853112,
      "durationMs": 761.8123749853112,
      "imagesPerSecond": 1.312659170204844,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 742.4576249904931,
      "loadMs": 4595.023499976378,
      "totalMs": 5356.835874961689,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 773.7157919909805,
      "durationMs": 773.7157919909805,
      "imagesPerSecond": 1.2924642489546825,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 751.0321249719709,
      "loadMs": 4595.023499976378,
      "totalMs": 5368.739291967358,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": true,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 781.9577089976519,
      "durationMs": 781.9577089976519,
      "imagesPerSecond": 1.2788415389904453,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 764.2173750209622,
      "loadMs": 4595.023499976378,
      "totalMs": 5376.98120897403,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true,
      "iou": 0.9927302956420828,
      "alphaMAE": 0.003696504796098524,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true
    },
    "runtime": {
      "inferenceMs": 844.946124998387,
      "durationMs": 844.946124998387,
      "imagesPerSecond": 1.1835074100161227,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 774.0900000208057,
      "loadMs": 4595.023499976378,
      "totalMs": 5439.969624974765,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 768.98379198974,
      "durationMs": 768.98379198974,
      "imagesPerSecond": 1.300417525592454,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 747.0207079895772,
      "loadMs": 4595.023499976378,
      "totalMs": 5364.007291966118,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 777.5200409814715,
      "durationMs": 777.5200409814715,
      "imagesPerSecond": 1.2861404816494373,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 753.4645000123419,
      "loadMs": 4595.023499976378,
      "totalMs": 5372.5435409578495,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 904.2491670115851,
      "durationMs": 904.2491670115851,
      "imagesPerSecond": 1.1058898769073326,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 5885919232,
      "modelForwardMs": 882.968207995873,
      "loadMs": 4595.023499976378,
      "totalMs": 5499.272666987963,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "actualDevice": "mps",
      "requestedPrecision": "fp32",
      "actualPrecision": "fp32",
      "fallback": false,
      "cpuThreads": 4
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
      "individualFixturePassedBeforeConfigurationGate": false
    },
    "runtime": {
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "mps",
      "requestedPrecision": "bf16",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 4269.43562499946
    },
    "failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n    with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n                                                                                                                                        ~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n    with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n                                       ~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n    scaled_preds, class_preds = self.forward_ori(x)\\n                                ~~~~~~~~~~~~~~~~^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n    x4 = self.squeeze_module(x4)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n    input = module(input)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n    x = self.dec_att(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n    x1 = self.aspp1(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n    x = self.atrous_conv(x)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n    return self._call_impl(*args, **kwargs)\\n           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n    return forward_call(*args, **kwargs)\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n    x = deform_conv2d(\\n        input=x,\\n    ...<5 lines>...\\n        stride=self.stride,\\n    )\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n    return torch.ops.torchvision.deform_conv2d(\\n           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n        input,\\n        ^^^^^^\\n    ...<12 lines>...\\n        use_mask,\\n        ^^^^^^^^^\\n    )\\n    ^\\n  File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n    return self._op(*args, **kwargs)\\n           ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "fail",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": false,
      "speedPassed": true,
      "individualFixturePassedBeforeConfigurationGate": true
    },
    "runtime": {
      "inferenceMs": 8324.208707956132,
      "durationMs": 8358.356459008064,
      "imagesPerSecond": 0.120131538634323,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 5229.836667014752,
      "totalMs": 13554.045374970883
    },
    "failure": null
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "fail",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "personMean": 1,
      "backgroundMean": 0,
      "passed": false,
      "iou": 0.9927302956420828,
      "alphaMAE": 0.003696504796098524,
      "boundaryF1": 0.9698420296792724,
      "speedPassed": true,
      "individualFixturePassedBeforeConfigurationGate": true
    },
    "runtime": {
      "inferenceMs": 7960.779500019271,
      "durationMs": 8024.108332989272,
      "imagesPerSecond": 0.12561583950385502,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 5229.836667014752,
      "totalMs": 13190.616167034023
    },
    "failure": null
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "fail",
    "quality": {
      "dimensions": true,
      "completeAlphaMultiplication": true,
      "finite": true,
      "foregroundFraction": 0,
      "passed": false,
      "speedPassed": false,
      "individualFixturePassedBeforeConfigurationGate": false
    },
    "runtime": {
      "inferenceMs": 10351.713707961608,
      "durationMs": 10368.304207979236,
      "imagesPerSecond": 0.09660236248911036,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "cpuThreads": 4,
      "fallback": false,
      "loadMs": 5229.836667014752,
      "totalMs": 15581.55037497636
    },
    "failure": null
  }
]

Something not quite right?

Tell us what happened with BiRefNet Desktop. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.