SAM ViT Base — Point-Prompt Segmentation
6 configurations testedQuality criteria
Finite candidate scores, expected output dimensions, selected point inside the best mask, and a non-degenerate foreground ratio.
| Precision | Device | Result | |
|---|---|---|---|
FP16 | GPU · WebGPUAccelerated | Passed | Moderate |
FP32 | GPU · WebGPUAccelerated | Passed | Moderate |
Q8 | GPU · WebGPUAccelerated | Passed | Very slow |
Q8 | CPU · WASM | Passed | Very slow |
FP32 | CPU · WASM | Passed | Very slow |
FP16 | CPU · WASM | Failed | — |
Test setup & sample details
- Quality gate
- Finite candidate scores, expected output dimensions, selected point inside the best mask, and a non-degenerate foreground ratio.
- Tested
- 2026-09-12T18:46:29.238Z
- Environment
- Isolated headless Chrome on macOS; Transformers.js 4.2.0
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- e9ff25bcbb89d0be0758fcdf28e91193bb7eb6e9
- Fixture
{ "file": "slimsam-77-uniform.json", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/slimsam-77-uniform.json", "size": 404, "sha1": "f03c558b1d0dfd0dcb2db0dcaffbd9038aac6cf8" }- Rerun when
- artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "segmentation-pass",
"pointInside": true
},
"runtime": {
"loadMs": 14410.80000000447,
"inferenceMs": 22917.29999999702,
"totalMs": 38542.39999999851,
"megapixelsPerSecond": 0.0305,
"grade": "very-slow"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "segmentation-pass",
"pointInside": true
},
"runtime": {
"loadMs": 19022.80000000447,
"inferenceMs": 17576.39999999851,
"totalMs": 37910.59999999404,
"megapixelsPerSecond": 0.0398,
"grade": "very-slow"
}
},
{
"precision": "fp16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/mask_decoder/upscale_layer_norm/Constant_output_0for node: /mask_decoder/transformer/layers.0/layer_norm1/Mul/SimplifiedLayerNormFusion/\n"
},
{
"precision": "fp16",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "segmentation-pass",
"pointInside": true
},
"runtime": {
"loadMs": 26480.80000000447,
"inferenceMs": 994.6999999955297,
"totalMs": 28721.5,
"megapixelsPerSecond": 0.7031,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "segmentation-pass",
"pointInside": true
},
"runtime": {
"loadMs": 42049.29999999702,
"inferenceMs": 23240.39999999851,
"totalMs": 66679.5,
"megapixelsPerSecond": 0.0301,
"grade": "very-slow"
}
},
{
"precision": "fp32",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "segmentation-pass",
"pointInside": true
},
"runtime": {
"loadMs": 41666.5,
"inferenceMs": 1280.6000000014901,
"totalMs": 44233.10000000149,
"megapixelsPerSecond": 0.5461,
"grade": "slow"
}
}
]