A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

BERT NER

Find and label spans in your text, processed locally in your browser.

Browser inferencePowered by WebAI · Private · Unlimited runs
About this model

Find people, organizations, places, and other named entities in English text. Returns labeled text spans with confidence scores and their positions in the original text.

Created by
dslim
License
MIT
Model released
Unknown
Source repository created
Mar 2, 2022
Model weights · Q8
109.0 MB

Best for

  • Highlight named entities in English news-like text.
  • Prototype local document indexing, search annotation, and information-extraction workflows.
  • Provide candidate spans for human-reviewed downstream processing.

Keep in mind

  • The model recognizes only PER, ORG, LOC, and MISC; dates, quantities, products, events, and other entity types are not represented consistently.
  • It was trained on English Reuters news from a limited historical period and may generalize poorly to other languages, domains, emerging names, informal spelling, or unusual capitalization.
  • Subword tokenization can split, truncate, merge, or omit entity spans; character offsets and labels require application-level review.
  • Confidence scores are not calibrated guarantees and must not be used alone for consequential decisions about people.
  • Inputs longer than 512 tokens are truncated, so entities beyond the retained prefix are omitted.
  • Six short English sanity fixtures only; not full CoNLL-2003 or privacy/multilingual validation. Simple BIO aggregation can return partial-word or false-positive spans; no post-hoc quality claim from successful inference.
  • Browser whole-word first/average/max modes are unavailable in the pinned runtime. Native aggregation capability differs.

Processed on your deviceInference runs in this browser. Input/output sharing requires consent for each run. Basic run logs include device information and approximate connection location. Model and runtime files download from external hosts. Saved downloads may be cleared by your browser.

Sources & technical details
Original model
dslim/bert-base-NER
Release verification
Unknown
Release evidence
Exact original checkpoint public release date has not been verified. Repository creation, training, paper, artifact conversion and update dates are not release evidence.
Source updated
Oct 8, 2024
Browser model files
Xenova/bert-base-NER
Files updated
Sep 14, 2026
Artifact revision
8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa

Input

TEXT → ENTITIES

Sample result

BERT Base NER — English Named Entities
Advanced settings 2
Maximum token count including special tokens; longer text is truncated. Lower values may process less text but truncate relevant context sooner. Higher values retain more context, within the model limit, and can need more memory and time.
Pinned Transformers.js supports simple BIO grouping or none for token-level entities; whole-word first/average/max modes are unavailable. none keeps individual tokens. simple groups compatible tokens; first uses the first subtoken label, average combines subtoken scores, and max uses the strongest subtoken. Available choices can change entity boundaries and labels.

Output

Discover the labels in your text

Enter text or try the sample to highlight entities and inspect their scores.

Benchmark evidence

Saved worker evidence is separate from benchmarks run on your device. It does not guarantee speed or quality on every browser.

BERT Base NER — English Named Entities

46 configurations tested
Passed34
Failed12
TestedOct 23, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.

PrecisionDeviceResult
Q4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedFast
Q4GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q8CPU · WASMPassedFast
Q8CPU · WASMPassedFast
Q8CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
FP32CPU · WASMFailed—
FP32GPU · WebGPUFailed—
FP16CPU · WASMFailed—
FP16GPU · WebGPUFailed—
INT8CPU · WASMFailed—
INT8GPU · WebGPUFailed—
UINT8CPU · WASMFailed—
UINT8GPU · WebGPUFailed—
Q4F16CPU · WASMFailed—
Q4F16GPU · WebGPUFailed—
BNB4CPU · WASMFailed—
BNB4GPU · WebGPUFailed—
Test setup & sample details
Quality gate
Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.
Tested
2026-10-23T10:53:16.920Z
Environment
Isolated headless Google Chrome on macOS; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa
Fixture
{
  "file": "model-samples/browser/bert-ner/quality-gates.json",
  "url": "https://assets.localai.tools/samples/v1/files/858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f/bert-ner-quality-gates.json",
  "size": 4228,
  "sha1": "2e5621be8c41bf169ec2cb42ed93ccd0d7d4c92f",
  "sha256": "858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9919501543045044,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9995951950550079,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9996791481971741,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 51071.199999928474,
      "inferenceMs": 184.89999997615814,
      "totalMs": 52634.700000047684,
      "grade": "slow",
      "textsPerSecond": 5.40832882709002
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9919500946998596,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9995951950550079,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9996791481971741,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 56146.5,
      "inferenceMs": 79.39999997615814,
      "totalMs": 57656.60000002384,
      "grade": "good",
      "textsPerSecond": 12.594458442068959
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 29800.399999976158,
      "grade": "failed"
    },
    "failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/bert/encoder/layer.11/output/LayerNorm/Constant_output_0for node: /bert/embeddings/LayerNorm/Mul/SimplifiedLayerNormFusion/\n"
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9120904207229614,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9852735102176666,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9911523163318634,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 27688,
      "inferenceMs": 68.30000007152557,
      "totalMs": 29063.399999976158,
      "grade": "good",
      "textsPerSecond": 14.641288418049392
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9895126521587372,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9993838667869568,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995821416378021,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 19456.799999952316,
      "inferenceMs": 194.29999995231628,
      "totalMs": 21021.399999976158,
      "grade": "slow",
      "textsPerSecond": 5.146680392410771
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9833778142929077,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9993617832660675,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995712041854858,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 18314.100000023842,
      "inferenceMs": 362.09999990463257,
      "totalMs": 19945.100000023842,
      "grade": "slow",
      "textsPerSecond": 2.7616680482280396
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.979133665561676,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9994161427021027,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995928108692169,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 20562.299999952316,
      "inferenceMs": 197.29999995231628,
      "totalMs": 22139.100000023842,
      "grade": "slow",
      "textsPerSecond": 5.068423721447954
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9817031025886536,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9994866847991943,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995744526386261,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 18230.300000071526,
      "inferenceMs": 285.7999999523163,
      "totalMs": 19954.700000047684,
      "grade": "slow",
      "textsPerSecond": 3.4989503154893034
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9723472595214844,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.999410480260849,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9996160864830017,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": true,
          "score": 0.9106517434120178,
          "pass": true
        }
      ],
      "recall": 1,
      "grade": "ner-span-pass"
    },
    "runtime": {
      "loadMs": 19248.100000023842,
      "inferenceMs": 198.39999997615814,
      "totalMs": 20881.299999952316,
      "grade": "slow",
      "textsPerSecond": 5.0403225812508605
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9673751592636108,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9993798434734344,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.999609112739563,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": true,
          "score": 0.9028891444206237,
          "pass": true
        }
      ],
      "recall": 1,
      "grade": "ner-span-pass"
    },
    "runtime": {
      "loadMs": 16627.100000023842,
      "inferenceMs": 363,
      "totalMs": 18244.899999976158,
      "grade": "slow",
      "textsPerSecond": 2.7548209366391183
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9928421080112457,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9995550215244293,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995963275432587,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": true,
          "score": 0.9127414464950562,
          "pass": true
        }
      ],
      "recall": 1,
      "grade": "ner-span-pass"
    },
    "runtime": {
      "loadMs": 20310.100000023842,
      "inferenceMs": 302.10000002384186,
      "totalMs": 21789.799999952316,
      "grade": "slow",
      "textsPerSecond": 3.31016219768646
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9928420782089233,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9995550215244293,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995963275432587,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": true,
          "score": 0.9127416491508484,
          "pass": true
        }
      ],
      "recall": 1,
      "grade": "ner-span-pass"
    },
    "runtime": {
      "loadMs": 20363,
      "inferenceMs": 91.39999997615814,
      "totalMs": 21691.099999904633,
      "grade": "good",
      "textsPerSecond": 10.940919040053084
    }
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 17129.299999952316,
      "grade": "failed"
    },
    "failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/bert/embeddings/LayerNorm/Constant_output_0for node: /bert/embeddings/LayerNorm/Mul/SimplifiedLayerNormFusion/\n"
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9028969407081604,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.98146653175354,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9889111220836639,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 15915.899999976158,
      "inferenceMs": 68.89999997615814,
      "totalMs": 17249.600000023842,
      "grade": "good",
      "textsPerSecond": 14.513788103716047
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9878316521644592,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9994357824325562,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995394051074982,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 21031.100000023842,
      "inferenceMs": 234.29999995231628,
      "totalMs": 22572.199999928474,
      "grade": "slow",
      "textsPerSecond": 4.268032437915133
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "finite": true,
      "validOffsets": true,
      "nondegenerate": true,
      "expected": [
        {
          "text": "Cape Kennedy",
          "label": "LOC",
          "found": true,
          "score": 0.9878315925598145,
          "pass": true
        },
        {
          "text": "Neil Armstrong",
          "label": "PER",
          "found": true,
          "score": 0.9994357824325562,
          "pass": true
        },
        {
          "text": "Michael Collins",
          "label": "PER",
          "found": true,
          "score": 0.9995394051074982,
          "pass": true
        },
        {
          "text": "Edwin Buzz Aldrin",
          "label": "PER",
          "found": false,
          "score": null,
          "pass": false
        }
      ],
      "recall": 0.75,
      "grade": "failed"
    },
    "runtime": {
      "loadMs": 20800.199999928474,
      "inferenceMs": 417.3000000715256,
      "totalMs": 22650.799999952316,
      "grade": "slow",
      "textsPerSecond": 2.396357536133715
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.5,
      "recall": 1,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2134.5999999940395,
      "inferenceMs": 194.2999999821186,
      "totalMs": 2328.899999976158,
      "charactersPerSecond": 1008.7493567577861,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2134.5999999940395,
      "inferenceMs": 53.79999998211861,
      "totalMs": 2188.399999976158,
      "charactersPerSecond": 762.0817846399086,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2134.5999999940395,
      "inferenceMs": 39.5,
      "totalMs": 2174.0999999940395,
      "charactersPerSecond": 759.493670886076,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2134.5999999940395,
      "inferenceMs": 54.19999998807907,
      "totalMs": 2188.7999999821186,
      "charactersPerSecond": 811.8081182597326,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2134.5999999940395,
      "inferenceMs": 41.5,
      "totalMs": 2176.0999999940395,
      "charactersPerSecond": 674.6987951807229,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2134.5999999940395,
      "inferenceMs": 52.5,
      "totalMs": 2187.0999999940395,
      "charactersPerSecond": 819.047619047619,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.5,
      "recall": 1,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 1950.699999988079,
      "inferenceMs": 357.7999999821186,
      "totalMs": 2308.4999999701977,
      "charactersPerSecond": 547.7920626321836,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1950.699999988079,
      "inferenceMs": 97.90000000596046,
      "totalMs": 2048.5999999940395,
      "charactersPerSecond": 418.79468843211225,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1950.699999988079,
      "inferenceMs": 81,
      "totalMs": 2031.699999988079,
      "charactersPerSecond": 370.3703703703704,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1950.699999988079,
      "inferenceMs": 146.2000000178814,
      "totalMs": 2096.9000000059605,
      "charactersPerSecond": 300.9575923024518,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1950.699999988079,
      "inferenceMs": 115.19999998807907,
      "totalMs": 2065.899999976158,
      "charactersPerSecond": 243.05555558070702,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1950.699999988079,
      "inferenceMs": 85.5,
      "totalMs": 2036.199999988079,
      "charactersPerSecond": 502.92397660818716,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.5,
      "recall": 1,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2381.2999999821186,
      "inferenceMs": 301,
      "totalMs": 2682.2999999821186,
      "charactersPerSecond": 651.1627906976744,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2381.2999999821186,
      "inferenceMs": 152.80000001192093,
      "totalMs": 2534.0999999940395,
      "charactersPerSecond": 268.32460730890915,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2381.2999999821186,
      "inferenceMs": 132.5,
      "totalMs": 2513.7999999821186,
      "charactersPerSecond": 226.41509433962264,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2381.2999999821186,
      "inferenceMs": 152.5,
      "totalMs": 2533.7999999821186,
      "charactersPerSecond": 288.5245901639344,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2381.2999999821186,
      "inferenceMs": 127.5,
      "totalMs": 2508.7999999821186,
      "charactersPerSecond": 219.6078431372549,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2381.2999999821186,
      "inferenceMs": 132,
      "totalMs": 2513.2999999821186,
      "charactersPerSecond": 325.75757575757575,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.5,
      "recall": 1,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 1927.5999999940395,
      "inferenceMs": 141,
      "totalMs": 2068.5999999940395,
      "charactersPerSecond": 1390.0709219858156,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1927.5999999940395,
      "inferenceMs": 64.90000000596046,
      "totalMs": 1992.5,
      "charactersPerSecond": 631.7411401576969,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1927.5999999940395,
      "inferenceMs": 38.69999998807907,
      "totalMs": 1966.2999999821186,
      "charactersPerSecond": 775.1937986883987,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1927.5999999940395,
      "inferenceMs": 22.299999982118607,
      "totalMs": 1949.8999999761581,
      "charactersPerSecond": 1973.0941719857253,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1927.5999999940395,
      "inferenceMs": 22.599999994039536,
      "totalMs": 1950.199999988079,
      "charactersPerSecond": 1238.9380534240993,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1927.5999999940395,
      "inferenceMs": 65.19999998807907,
      "totalMs": 1992.7999999821186,
      "charactersPerSecond": 659.5092025745699,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 0.5,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 1690.2000000178814,
      "inferenceMs": 194.90000000596046,
      "totalMs": 1885.1000000238419,
      "charactersPerSecond": 1005.6439199281986,
      "grade": "good",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1690.2000000178814,
      "inferenceMs": 54.900000005960464,
      "totalMs": 1745.1000000238419,
      "charactersPerSecond": 746.8123860755675,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1690.2000000178814,
      "inferenceMs": 40.5,
      "totalMs": 1730.7000000178814,
      "charactersPerSecond": 740.7407407407408,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1690.2000000178814,
      "inferenceMs": 56.099999994039536,
      "totalMs": 1746.300000011921,
      "charactersPerSecond": 784.3137255735272,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1690.2000000178814,
      "inferenceMs": 40.60000002384186,
      "totalMs": 1730.8000000417233,
      "charactersPerSecond": 689.6551720088015,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1690.2000000178814,
      "inferenceMs": 53.89999997615814,
      "totalMs": 1744.0999999940395,
      "charactersPerSecond": 797.7736552693952,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
    }
  }
]

BERT Base Uncased NER — English Named Entities

82 configurations tested
Passed78
Failed4
TestedNov 12, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.

PrecisionDeviceResult
Q4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
UINT8GPU · WebGPUAcceleratedPassedFast
INT8GPU · WebGPUAcceleratedPassedFast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
BNB4CPU · WASMPassedFast
BNB4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
BNB4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
BNB4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
BNB4CPU · WASMPassedFast
FP32CPU · WASMPassedFast
Q8CPU · WASMPassedFast
INT8CPU · WASMPassedFast
UINT8CPU · WASMPassedFast
Q8CPU · WASMPassedFast
BNB4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
FP16CPU · WASMFailed—
FP16GPU · WebGPUFailed—
Q4F16CPU · WASMFailed—
Q4F16GPU · WebGPUFailed—
Test setup & sample details
Quality gate
Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.
Tested
2026-11-12T22:47:18.644Z
Environment
Isolated headless Google Chrome on macOS; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
2a2d6873323e0498a3dfe4f9745759748c057b3d
Fixture
{
  "file": "model-samples/browser/bert-ner/quality-gates.json",
  "url": "https://assets.localai.tools/samples/v1/files/858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f/bert-ner-quality-gates.json",
  "size": 4228,
  "sha1": "2e5621be8c41bf169ec2cb42ed93ccd0d7d4c92f",
  "sha256": "858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 5890.5,
      "inferenceMs": 167.30000001192093,
      "totalMs": 6057.800000011921,
      "charactersPerSecond": 1171.5481170713333,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5890.5,
      "inferenceMs": 47.89999997615814,
      "totalMs": 5938.399999976158,
      "charactersPerSecond": 855.9498960419089,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5890.5,
      "inferenceMs": 32.89999997615814,
      "totalMs": 5923.399999976158,
      "charactersPerSecond": 911.8541040042643,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5890.5,
      "inferenceMs": 48,
      "totalMs": 5938.5,
      "charactersPerSecond": 916.6666666666666,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5890.5,
      "inferenceMs": 33.29999998211861,
      "totalMs": 5923.799999982119,
      "charactersPerSecond": 840.8408412923545,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5890.5,
      "inferenceMs": 45,
      "totalMs": 5935.5,
      "charactersPerSecond": 955.5555555555555,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 5346.0999999940395,
      "inferenceMs": 205.2999999821186,
      "totalMs": 5551.399999976158,
      "charactersPerSecond": 954.7004384660077,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5346.0999999940395,
      "inferenceMs": 107.5,
      "totalMs": 5453.5999999940395,
      "charactersPerSecond": 381.3953488372093,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5346.0999999940395,
      "inferenceMs": 78.89999997615814,
      "totalMs": 5424.999999970198,
      "charactersPerSecond": 380.2281369970259,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5346.0999999940395,
      "inferenceMs": 12.700000017881393,
      "totalMs": 5358.800000011921,
      "charactersPerSecond": 3464.566924255804,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5346.0999999940395,
      "inferenceMs": 11.800000011920929,
      "totalMs": 5357.9000000059605,
      "charactersPerSecond": 2372.881353535004,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 5346.0999999940395,
      "inferenceMs": 13.299999982118607,
      "totalMs": 5359.399999976158,
      "charactersPerSecond": 3233.082711113686,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2077.7000000178814,
      "inferenceMs": 181.30000001192093,
      "totalMs": 2259.0000000298023,
      "charactersPerSecond": 1081.0810810099972,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2077.7000000178814,
      "inferenceMs": 56.30000001192093,
      "totalMs": 2134.0000000298023,
      "charactersPerSecond": 728.2415629008648,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2077.7000000178814,
      "inferenceMs": 41.80000001192093,
      "totalMs": 2119.5000000298023,
      "charactersPerSecond": 717.703349077615,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2077.7000000178814,
      "inferenceMs": 56,
      "totalMs": 2133.7000000178814,
      "charactersPerSecond": 785.7142857142857,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2077.7000000178814,
      "inferenceMs": 42.5,
      "totalMs": 2120.2000000178814,
      "charactersPerSecond": 658.8235294117648,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2077.7000000178814,
      "inferenceMs": 56.099999994039536,
      "totalMs": 2133.800000011921,
      "charactersPerSecond": 766.4884136286743,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2058.199999988079,
      "inferenceMs": 354.19999998807907,
      "totalMs": 2412.399999976158,
      "charactersPerSecond": 553.3596838130902,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2058.199999988079,
      "inferenceMs": 97.2000000178814,
      "totalMs": 2155.4000000059605,
      "charactersPerSecond": 421.810699510879,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2058.199999988079,
      "inferenceMs": 86.89999997615814,
      "totalMs": 2145.099999964237,
      "charactersPerSecond": 345.2243959520229,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2058.199999988079,
      "inferenceMs": 88.90000000596046,
      "totalMs": 2147.0999999940395,
      "charactersPerSecond": 494.9381327002243,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2058.199999988079,
      "inferenceMs": 70.80000001192093,
      "totalMs": 2129,
      "charactersPerSecond": 395.4802259221117,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2058.199999988079,
      "inferenceMs": 85.5,
      "totalMs": 2143.699999988079,
      "charactersPerSecond": 502.92397660818716,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2121,
      "inferenceMs": 184.90000000596046,
      "totalMs": 2305.9000000059605,
      "charactersPerSecond": 1060.032449938787,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2121,
      "inferenceMs": 55.79999998211861,
      "totalMs": 2176.7999999821186,
      "charactersPerSecond": 734.7670253250656,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2121,
      "inferenceMs": 41.10000002384186,
      "totalMs": 2162.100000023842,
      "charactersPerSecond": 729.9270068758439,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2121,
      "inferenceMs": 55.80000001192093,
      "totalMs": 2176.800000011921,
      "charactersPerSecond": 788.5304657813617,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2121,
      "inferenceMs": 42.900000005960464,
      "totalMs": 2163.9000000059605,
      "charactersPerSecond": 652.6806525899701,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2121,
      "inferenceMs": 58.599999994039536,
      "totalMs": 2179.5999999940395,
      "charactersPerSecond": 733.7883959790737,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2212.5,
      "inferenceMs": 259.10000002384186,
      "totalMs": 2471.600000023842,
      "charactersPerSecond": 756.464685380025,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2212.5,
      "inferenceMs": 96.19999998807907,
      "totalMs": 2308.699999988079,
      "charactersPerSecond": 426.1954262482396,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2212.5,
      "inferenceMs": 87.7000000178814,
      "totalMs": 2300.2000000178814,
      "charactersPerSecond": 342.07525648669576,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2212.5,
      "inferenceMs": 86.59999999403954,
      "totalMs": 2299.0999999940395,
      "charactersPerSecond": 508.08314091256824,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2212.5,
      "inferenceMs": 70.59999999403954,
      "totalMs": 2283.0999999940395,
      "charactersPerSecond": 396.60056660572127,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2212.5,
      "inferenceMs": 87.09999999403954,
      "totalMs": 2299.5999999940395,
      "charactersPerSecond": 493.6854190923375,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2146.7000000178814,
      "inferenceMs": 188.19999998807907,
      "totalMs": 2334.9000000059605,
      "charactersPerSecond": 1041.4452710542773,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.7000000178814,
      "inferenceMs": 59.400000005960464,
      "totalMs": 2206.100000023842,
      "charactersPerSecond": 690.2356901664289,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.7000000178814,
      "inferenceMs": 44.29999998211861,
      "totalMs": 2191,
      "charactersPerSecond": 677.2009032078848,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.7000000178814,
      "inferenceMs": 60.099999994039536,
      "totalMs": 2206.800000011921,
      "charactersPerSecond": 732.1131448313433,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.7000000178814,
      "inferenceMs": 43.19999998807907,
      "totalMs": 2189.9000000059605,
      "charactersPerSecond": 648.148148327003,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.7000000178814,
      "inferenceMs": 60.5,
      "totalMs": 2207.2000000178814,
      "charactersPerSecond": 710.7438016528926,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2146.899999976158,
      "inferenceMs": 259,
      "totalMs": 2405.899999976158,
      "charactersPerSecond": 756.7567567567568,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.899999976158,
      "inferenceMs": 100.30000001192093,
      "totalMs": 2247.199999988079,
      "charactersPerSecond": 408.7736789145268,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.899999976158,
      "inferenceMs": 83.09999999403954,
      "totalMs": 2229.9999999701977,
      "charactersPerSecond": 361.01083035080376,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.899999976158,
      "inferenceMs": 92.40000000596046,
      "totalMs": 2239.2999999821186,
      "charactersPerSecond": 476.1904761597585,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.899999976158,
      "inferenceMs": 69.40000000596046,
      "totalMs": 2216.2999999821186,
      "charactersPerSecond": 403.45821322183286,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2146.899999976158,
      "inferenceMs": 90,
      "totalMs": 2236.899999976158,
      "charactersPerSecond": 477.77777777777777,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2571.7000000178814,
      "inferenceMs": 283.59999999403954,
      "totalMs": 2855.300000011921,
      "charactersPerSecond": 691.1142454306042,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2571.7000000178814,
      "inferenceMs": 148.59999999403954,
      "totalMs": 2720.300000011921,
      "charactersPerSecond": 275.9084791496941,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2571.7000000178814,
      "inferenceMs": 128.2000000178814,
      "totalMs": 2699.900000035763,
      "charactersPerSecond": 234.00936034177525,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2571.7000000178814,
      "inferenceMs": 144.40000000596046,
      "totalMs": 2716.100000023842,
      "charactersPerSecond": 304.7091412616606,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2571.7000000178814,
      "inferenceMs": 128.59999999403954,
      "totalMs": 2700.300000011921,
      "charactersPerSecond": 217.72939347820972,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2571.7000000178814,
      "inferenceMs": 140.5,
      "totalMs": 2712.2000000178814,
      "charactersPerSecond": 306.0498220640569,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2324.0999999940395,
      "inferenceMs": 68.19999998807907,
      "totalMs": 2392.2999999821186,
      "charactersPerSecond": 2873.9002937574714,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2324.0999999940395,
      "inferenceMs": 20.299999982118607,
      "totalMs": 2344.399999976158,
      "charactersPerSecond": 2019.7044352766075,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2324.0999999940395,
      "inferenceMs": 13.800000011920929,
      "totalMs": 2337.9000000059605,
      "charactersPerSecond": 2173.9130416003577,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2324.0999999940395,
      "inferenceMs": 10,
      "totalMs": 2334.0999999940395,
      "charactersPerSecond": 4400,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2324.0999999940395,
      "inferenceMs": 11.300000011920929,
      "totalMs": 2335.4000000059605,
      "charactersPerSecond": 2477.876103580656,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2324.0999999940395,
      "inferenceMs": 9.099999994039536,
      "totalMs": 2333.199999988079,
      "charactersPerSecond": 4725.274728369762,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2342.600000023842,
      "inferenceMs": 273.90000000596046,
      "totalMs": 2616.5000000298023,
      "charactersPerSecond": 715.5896312367096,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2342.600000023842,
      "inferenceMs": 146,
      "totalMs": 2488.600000023842,
      "charactersPerSecond": 280.82191780821915,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2342.600000023842,
      "inferenceMs": 123.2000000178814,
      "totalMs": 2465.8000000417233,
      "charactersPerSecond": 243.5064934711507,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2342.600000023842,
      "inferenceMs": 143.69999998807907,
      "totalMs": 2486.300000011921,
      "charactersPerSecond": 306.1934586196946,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2342.600000023842,
      "inferenceMs": 123,
      "totalMs": 2465.600000023842,
      "charactersPerSecond": 227.64227642276424,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2342.600000023842,
      "inferenceMs": 161.80000001192093,
      "totalMs": 2504.400000035763,
      "charactersPerSecond": 265.7601977554505,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.6666666666666666,
      "recall": 1,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2270,
      "inferenceMs": 73.59999999403954,
      "totalMs": 2343.5999999940395,
      "charactersPerSecond": 2663.043478476535,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2270,
      "inferenceMs": 27.900000005960464,
      "totalMs": 2297.9000000059605,
      "charactersPerSecond": 1469.534049865265,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2270,
      "inferenceMs": 16.900000005960464,
      "totalMs": 2286.9000000059605,
      "charactersPerSecond": 1775.1479283680055,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2270,
      "inferenceMs": 10.099999994039536,
      "totalMs": 2280.0999999940395,
      "charactersPerSecond": 4356.435646135285,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2270,
      "inferenceMs": 10.200000017881393,
      "totalMs": 2280.2000000178814,
      "charactersPerSecond": 2745.098034403316,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2270,
      "inferenceMs": 10.299999982118607,
      "totalMs": 2280.2999999821186,
      "charactersPerSecond": 4174.757288801017,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/bert/encoder/layer.0/attention/self/Cast_output_0) of node (/bert/encoder/layer.0/attention/self/Cast) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:61873/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:61873/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:61873/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:61873/dist/index.mjs:687:42)"
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/bert/encoder/layer.0/attention/self/Cast_output_0) of node (/bert/encoder/layer.0/attention/self/Cast) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:61873/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:61873/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:61873/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:61873/dist/index.mjs:687:42)"
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/bert/encoder/layer.0/attention/self/Cast_output_0) of node (/bert/encoder/layer.0/attention/self/Cast) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:61873/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:61873/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:61873/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:61873/dist/index.mjs:687:42)"
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/bert/encoder/layer.0/attention/self/Cast_output_0) of node (/bert/encoder/layer.0/attention/self/Cast) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:61873/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:61873/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:61873/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:61873/dist/index.mjs:687:42)"
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 0.6666666666666666,
      "f1": 0.8,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 1750.199999988079,
      "inferenceMs": 177.7999999821186,
      "totalMs": 1927.9999999701977,
      "charactersPerSecond": 1102.3622048352743,
      "grade": "good",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1750.199999988079,
      "inferenceMs": 54.5,
      "totalMs": 1804.699999988079,
      "charactersPerSecond": 752.2935779816514,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1750.199999988079,
      "inferenceMs": 40.19999998807907,
      "totalMs": 1790.3999999761581,
      "charactersPerSecond": 746.2686569377169,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1750.199999988079,
      "inferenceMs": 56,
      "totalMs": 1806.199999988079,
      "charactersPerSecond": 785.7142857142857,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1750.199999988079,
      "inferenceMs": 40.89999997615814,
      "totalMs": 1791.0999999642372,
      "charactersPerSecond": 684.5965774161872,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 1750.199999988079,
      "inferenceMs": 54,
      "totalMs": 1804.199999988079,
      "charactersPerSecond": 796.2962962962963,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "2a2d6873323e0498a3dfe4f9745759748c057b3d"
    }
  }
]

BERT Large NER — English Named Entities

18 configurations tested
Passed18
Failed0
TestedNov 12, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.

PrecisionDeviceResult
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP32CPU · WASMPassedFast
FP32CPU · WASMPassedFast
FP32CPU · WASMPassedFast
FP32CPU · WASMPassedFast
FP32CPU · WASMPassedFast
FP32CPU · WASMPassedModerate
Test setup & sample details
Quality gate
Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.
Tested
2026-11-12T22:47:18.644Z
Environment
Isolated headless Google Chrome on macOS; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
6fe43d9ec0bba0f67e367ecd74399216fc409c7f
Fixture
{
  "file": "model-samples/browser/bert-ner/quality-gates.json",
  "url": "https://assets.localai.tools/samples/v1/files/858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f/bert-ner-quality-gates.json",
  "size": 4228,
  "sha1": "2e5621be8c41bf169ec2cb42ed93ccd0d7d4c92f",
  "sha256": "858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.5,
      "recall": 1,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 31900.90000000596,
      "inferenceMs": 617.0999999940395,
      "totalMs": 32518,
      "charactersPerSecond": 317.61464916851907,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 31900.90000000596,
      "inferenceMs": 162.10000002384186,
      "totalMs": 32063.000000029802,
      "charactersPerSecond": 252.93028990727743,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 31900.90000000596,
      "inferenceMs": 109.69999998807907,
      "totalMs": 32010.59999999404,
      "charactersPerSecond": 273.47310850738427,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 31900.90000000596,
      "inferenceMs": 156.80000001192093,
      "totalMs": 32057.70000001788,
      "charactersPerSecond": 280.61224487662525,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 31900.90000000596,
      "inferenceMs": 104.5,
      "totalMs": 32005.40000000596,
      "charactersPerSecond": 267.9425837320574,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 31900.90000000596,
      "inferenceMs": 152.80000001192093,
      "totalMs": 32053.70000001788,
      "charactersPerSecond": 281.4136125434901,
      "grade": "good",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 0.5,
      "recall": 1,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 27753.70000001788,
      "inferenceMs": 144.69999998807907,
      "totalMs": 27898.40000000596,
      "charactersPerSecond": 1354.526606884224,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 27753.70000001788,
      "inferenceMs": 43.599999994039536,
      "totalMs": 27797.30000001192,
      "charactersPerSecond": 940.3669726056198,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 27753.70000001788,
      "inferenceMs": 32.5,
      "totalMs": 27786.20000001788,
      "charactersPerSecond": 923.0769230769231,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 27753.70000001788,
      "inferenceMs": 33.900000005960464,
      "totalMs": 27787.600000023842,
      "charactersPerSecond": 1297.9351030166285,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 27753.70000001788,
      "inferenceMs": 27.69999998807907,
      "totalMs": 27781.40000000596,
      "charactersPerSecond": 1010.8303253447666,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "validOffsetsAndScores": true,
      "precision": 1,
      "recall": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 27753.70000001788,
      "inferenceMs": 34.099999994039536,
      "totalMs": 27787.80000001192,
      "charactersPerSecond": 1260.9970676690946,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 0.5,
      "f1": 0.6666666666666666,
      "referenceCoverage": "selected-entities"
    },
    "runtime": {
      "loadMs": 2081.7000000178814,
      "inferenceMs": 105.7999999821186,
      "totalMs": 2187.5,
      "charactersPerSecond": 1852.5519851902288,
      "grade": "good",
      "actualPrecision": "fp32",
      "actualDevice": "webgpu",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2081.7000000178814,
      "inferenceMs": 37.19999998807907,
      "totalMs": 2118.9000000059605,
      "charactersPerSecond": 1102.1505379875982,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "webgpu",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2081.7000000178814,
      "inferenceMs": 31.900000005960464,
      "totalMs": 2113.600000023842,
      "charactersPerSecond": 940.4388712976347,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "webgpu",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2081.7000000178814,
      "inferenceMs": 34.900000005960464,
      "totalMs": 2116.600000023842,
      "charactersPerSecond": 1260.7449854580336,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "webgpu",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2081.7000000178814,
      "inferenceMs": 26.599999994039536,
      "totalMs": 2108.300000011921,
      "charactersPerSecond": 1052.6315791832396,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "webgpu",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "recall": 1,
      "precision": 1,
      "f1": 1,
      "referenceCoverage": "complete"
    },
    "runtime": {
      "loadMs": 2081.7000000178814,
      "inferenceMs": 34.20000001788139,
      "totalMs": 2115.900000035763,
      "charactersPerSecond": 1257.3099408630862,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "webgpu",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "6fe43d9ec0bba0f67e367ecd74399216fc409c7f"
    }
  }
]

Something not quite right?

Tell us what happened with BERT NER. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.