Grounding DINO Tiny — Open-Vocabulary Detection
16 configurations testedQuality criteria
For prompts 'a person' and 'a dog', output must contain a finite 'a person' detection with score >= 0.3 and IoU >= 0.4 against the checked-in subject box, return no 'a dog' false positive above threshold, and contain only valid boxes.
| Precision | Device | Result | |
|---|---|---|---|
Q4 | GPU · WebGPUAccelerated | Passed | Slow |
FP32 | GPU · WebGPUAccelerated | Passed | Very slow |
BNB4 | GPU · WebGPUAccelerated | Passed | Very slow |
INT8 | GPU · WebGPUAccelerated | Passed | Very slow |
Q8 | GPU · WebGPUAccelerated | Passed | Very slow |
UINT8 | GPU · WebGPUAccelerated | Passed | Very slow |
BNB4 | CPU · WASM | Passed | Very slow |
Q4 | CPU · WASM | Passed | Very slow |
INT8 | CPU · WASM | Passed | Very slow |
FP32 | CPU · WASM | Passed | Very slow |
Q8 | CPU · WASM | Passed | Very slow |
UINT8 | CPU · WASM | Passed | Very slow |
FP16 | CPU · WASM | Failed | — |
FP16 | GPU · WebGPU | Failed | — |
Q4F16 | CPU · WASM | Failed | — |
Q4F16 | GPU · WebGPU | Failed | — |
Test setup & sample details
- Quality gate
- For prompts 'a person' and 'a dog', output must contain a finite 'a person' detection with score >= 0.3 and IoU >= 0.4 against the checked-in subject box, return no 'a dog' false positive above threshold, and contain only valid boxes.
- Tested
- 2026-10-23T13:29:12.152Z
- Environment
- Isolated headless Chrome on macOS; Transformers.js 4.2.0
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- ff690b0a8050566c290287545bd059350f3e9096
- Fixture
{ "file": "modnet-portrait-pexels-5965592.jpg", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/modnet-portrait-pexels-5965592.jpg", "size": 78124, "sha1": "38212739a4a4f0be25d84863cf991d7fb6c6d818", "width": 1024, "height": 683, "source": "https://www.pexels.com/photo/woman-wearing-pink-turtleneck-sweater-5965592/", "license": "Pexels License", "licenseUrl": "https://www.pexels.com/license/" }- Rerun when
- artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.7976,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 60710.6,
"inferenceMs": 13371.6,
"totalMs": 74231,
"grade": "very-slow",
"imagesPerSecond": 0.0748
}
},
{
"precision": "fp32",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.7976,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 68605.4,
"inferenceMs": 5013.1,
"totalMs": 73757.1,
"grade": "very-slow",
"imagesPerSecond": 0.1995
}
},
{
"precision": "fp16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": {
"loadMs": null,
"inferenceMs": null,
"totalMs": 36948,
"grade": "failed"
},
"failure": "onnx-session-error"
},
{
"precision": "fp16",
"device": "webgpu",
"status": "fail",
"quality": {
"valid": false,
"bestIoU": 0,
"falsePositiveCount": 0,
"grade": "failed"
},
"runtime": {
"loadMs": 35093,
"inferenceMs": 4141.3,
"totalMs": 39341.5,
"grade": "slow",
"imagesPerSecond": 0.2415
},
"failure": "quality-invalid-output"
},
{
"precision": "int8",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.7914,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 15430.1,
"inferenceMs": 13308.8,
"totalMs": 28870.4,
"grade": "very-slow",
"imagesPerSecond": 0.0751
}
},
{
"precision": "int8",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.7865,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 21755.5,
"inferenceMs": 14438,
"totalMs": 36323.8,
"grade": "very-slow",
"imagesPerSecond": 0.0693
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.8163,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 17387.4,
"inferenceMs": 13376,
"totalMs": 30906.4,
"grade": "very-slow",
"imagesPerSecond": 0.0748
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.8163,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 16102.3,
"inferenceMs": 14540.5,
"totalMs": 31065.7,
"grade": "very-slow",
"imagesPerSecond": 0.0688
}
},
{
"precision": "uint8",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.8163,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 21907.2,
"inferenceMs": 13459.6,
"totalMs": 35490.7,
"grade": "very-slow",
"imagesPerSecond": 0.0743
}
},
{
"precision": "uint8",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.8163,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 23051.7,
"inferenceMs": 14656.1,
"totalMs": 37966.6,
"grade": "very-slow",
"imagesPerSecond": 0.0682
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.783,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 19242,
"inferenceMs": 13201.8,
"totalMs": 32558.7,
"grade": "very-slow",
"imagesPerSecond": 0.0757
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.783,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 23187.2,
"inferenceMs": 2605.2,
"totalMs": 25899.6,
"grade": "slow",
"imagesPerSecond": 0.3838
}
},
{
"precision": "q4f16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": {
"loadMs": null,
"inferenceMs": null,
"totalMs": 20978.7,
"grade": "failed"
},
"failure": "onnx-session-error"
},
{
"precision": "q4f16",
"device": "webgpu",
"status": "fail",
"quality": {
"valid": false,
"bestIoU": 0,
"falsePositiveCount": 0,
"grade": "failed"
},
"runtime": {
"loadMs": 17378.5,
"inferenceMs": 1608.8,
"totalMs": 19184.6,
"grade": "slow",
"imagesPerSecond": 0.6216
},
"failure": "quality-invalid-output"
},
{
"precision": "bnb4",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.7861,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 31170.3,
"inferenceMs": 12612,
"totalMs": 43886.9,
"grade": "very-slow",
"imagesPerSecond": 0.0793
}
},
{
"precision": "bnb4",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"bestIoU": 0.7861,
"falsePositiveCount": 0,
"grade": "grounded-detection-pass"
},
"runtime": {
"loadMs": 28194.8,
"inferenceMs": 13127.6,
"totalMs": 41459.2,
"grade": "very-slow",
"imagesPerSecond": 0.0762
}
}
]