A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

OPUS-MT · English to Spanish

Translate English text into Spanish and return the translated text. This worker supports only English-to-Spanish translation, not automatic language detection or other language pairs.

Browser inferencePowered by WebAI · Private · Unlimited runs
About this model

Translate English text into Spanish and return the translated text. This worker supports only English-to-Spanish translation, not automatic language detection or other language pairs.

License
Apache-2.0
Model released
Unknown
Source repository created
Mar 2, 2022
Model weights · FP32
445.8 MB

Best for

  • Draft Spanish translations of everyday English text.
  • Translate short messages, travel phrases, and general prose for human review.

Keep in mind

  • English to Spanish only; Spanish to English and other languages require separate models.
  • Ambiguous language, idioms, names, specialized terminology, and poor source text may be mistranslated.
  • Input is tokenized and truncated at 512 tokens; split long documents into shorter passages.
  • Generated text may omit or change facts, numbers, negation, or tone. Review before use, especially medical, legal, or other consequential communication.
  • Not a conversational assistant or certified translation service.

Processed on your deviceInference runs in this browser. Input/output sharing requires consent for each run. Basic run logs include device information and approximate connection location. Model and runtime files download from external hosts. Saved downloads may be cleared by your browser.

Sources & technical details
Original model
Helsinki-NLP/opus-mt-en-es
Release verification
Unknown
Release evidence
Exact original checkpoint public release date has not been verified. Repository creation, training, paper, artifact conversion and update dates are not release evidence.
Source updated
Aug 16, 2023
Browser model files
Xenova/opus-mt-en-es
Files updated
Jul 14, 2025
Artifact revision
4b002a4c7edd54a7ced58877258b87f7efd3f892

Input

TEXT

Sample result

OPUS-MT · English to Spanish

Settings

Maximum number of output tokens; too small a value can truncate the translation. Lower values finish sooner but can cut answers short. Higher values allow longer answers and can use more time and memory; they do not guarantee better answers.
Advanced settings 1
Translation search width. Higher values may improve phrasing but take more time. 1 uses a single search path. Higher values explore more alternatives and can improve wording, but use more time and memory and can still produce incorrect text.

Output

Your translation will appear here

Enter English text or try the sample to translate it into Spanish.

Benchmark evidence

Saved worker evidence is separate from benchmarks run on your device. It does not guarantee speed or quality on every browser.

OPUS-MT · English to Spanish

16 configurations tested
Passed10
Failed6
TestedOct 31, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

All four translations nonempty and non-repetitive; per-case character n-gram F2 (orders 1–6, Unicode-normalized) >=0.55 against independent references, mean >=0.70. Preserve travel time eight/ocho and negation-free sentence meaning through reference overlap.

PrecisionDeviceResult
Q4GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
INT8GPU · WebGPUAcceleratedPassedModerate
UINT8GPU · WebGPUAcceleratedPassedModerate
Q8GPU · WebGPUAcceleratedPassedModerate
BNB4GPU · WebGPUAcceleratedPassedModerate
FP32CPU · WASMPassedFast
BNB4CPU · WASMPassedModerate
Q4CPU · WASMPassedModerate
FP16CPU · WASMFailed—
INT8CPU · WASMFailed—
UINT8CPU · WASMFailed—
Q8CPU · WASMFailed—
Q4F16CPU · WASMFailed—
Q4F16GPU · WebGPUFailed—
Test setup & sample details
Quality gate
All four translations nonempty and non-repetitive; per-case character n-gram F2 (orders 1–6, Unicode-normalized) >=0.55 against independent references, mean >=0.70. Preserve travel time eight/ocho and negation-free sentence meaning through reference overlap.
Tested
2026-10-31T16:05:37.902Z
Environment
Isolated Chrome 156.0.8078.79 module Web Worker per case on macOS arm64; Transformers.js 4.2.0; cold model cache; single-case inference
Runtime
Transformers.js 4.2.0
Artifact revision
4b002a4c7edd54a7ced58877258b87f7efd3f892
Fixture
{
  "file": "model-samples/opus-mt-en-es.json",
  "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/opus-mt-en-es.json",
  "size": 788,
  "sha1": "6d7e2fff178ede20ba545d0414ad9bc19c93b19f"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 53798.59999999404,
      "inferenceMs": 244.7000000178814,
      "totalMs": 55476.40000000596,
      "grade": "excellent",
      "charactersPerSecond": 457.70331014227884
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 66004.5,
      "inferenceMs": 814.0999999940395,
      "totalMs": 68272.80000001192,
      "grade": "excellent",
      "charactersPerSecond": 137.57523645844492
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 30863,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/layers.5/self_attn_layer_norm/Constant_output_0for node: /layers.0/self_attn_layer_norm/Mul/SimplifiedLayerNormFusion/\n"
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Cierre la puerta. Cierre la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 0.5745801503805409,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 0.8936450375951352,
      "passed": true
    },
    "runtime": {
      "loadMs": 31592.19999998808,
      "inferenceMs": 921.5,
      "totalMs": 34364,
      "grade": "excellent",
      "charactersPerSecond": 121.54096581660336
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 19172.5,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: qdq_actions.cc:137 TransposeDQWeightsForMatMulNBits Missing required scale: model.shared.weight_merged_0_scale for node: model.shared.weight_transposed_DequantizeLinear"
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 21196.69999998808,
      "inferenceMs": 1362.199999988079,
      "totalMs": 24136.59999999404,
      "grade": "good",
      "charactersPerSecond": 82.21993833576578
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 21459.69999998808,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: qdq_actions.cc:137 TransposeDQWeightsForMatMulNBits Missing required scale: model.shared.weight_merged_0_scale for node: model.shared.weight_transposed_DequantizeLinear"
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 17090.59999999404,
      "inferenceMs": 1375.5,
      "totalMs": 19849.19999998808,
      "grade": "good",
      "charactersPerSecond": 81.42493638676845
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 19074.59999999404,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: qdq_actions.cc:137 TransposeDQWeightsForMatMulNBits Missing required scale: model.shared.weight_merged_0_scale for node: model.shared.weight_transposed_DequantizeLinear"
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 19168.100000023842,
      "inferenceMs": 1402.0999999940395,
      "totalMs": 21996.09999999404,
      "grade": "good",
      "charactersPerSecond": 79.88017973074398
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 37645.90000000596,
      "inferenceMs": 1022.7000000178814,
      "totalMs": 39966.79999998212,
      "grade": "excellent",
      "charactersPerSecond": 109.51403148336925
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 37181.69999998808,
      "inferenceMs": 540.9000000059605,
      "totalMs": 39288.69999998808,
      "grade": "excellent",
      "charactersPerSecond": 207.06230356584544
    }
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 25393.20000001788,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/layers.0/self_attn_layer_norm/Constant_output_0for node: /layers.0/self_attn_layer_norm/Mul/SimplifiedLayerNormFusion/\n"
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Cierre la puerta. Cierre la puerta. Cierre la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 0.5079151291702035,
          "nonempty": true,
          "repetitive": false,
          "passed": false
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 0.8769787822925509,
      "passed": false
    },
    "runtime": {
      "loadMs": 23015.70000001788,
      "inferenceMs": 516.9000000059605,
      "totalMs": 25057.5,
      "grade": "excellent",
      "charactersPerSecond": 216.67633971504839
    },
    "failure": "Translation reference quality gate failed"
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 37726.69999998808,
      "inferenceMs": 629.2000000178814,
      "totalMs": 39748.59999999404,
      "grade": "excellent",
      "charactersPerSecond": 178.003814362392
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "source": "Hello, how are you?",
          "references": [
            "Hola, ¿cómo estás?",
            "Hola, ¿cómo está usted?"
          ],
          "output": {
            "translation_text": "Hola, ¿cómo estás?",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "The train leaves at eight in the morning.",
          "references": [
            "El tren sale a las ocho de la mañana."
          ],
          "output": {
            "translation_text": "El tren sale a las ocho de la mañana.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "Please close the door.",
          "references": [
            "Por favor, cierra la puerta.",
            "Por favor, cierre la puerta."
          ],
          "output": {
            "translation_text": "Por favor, cierra la puerta.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        },
        {
          "source": "I would like a glass of water.",
          "references": [
            "Me gustaría un vaso de agua.",
            "Quisiera un vaso de agua."
          ],
          "output": {
            "translation_text": "Me gustaría un vaso de agua.",
            "source_language": "en",
            "target_language": "es"
          },
          "characterF2": 1,
          "nonempty": true,
          "repetitive": false,
          "passed": true
        }
      ],
      "meanCharacterF2": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 36271.80000001192,
      "inferenceMs": 1513.5,
      "totalMs": 39266,
      "grade": "good",
      "charactersPerSecond": 74.000660720185
    }
  }
]

Something not quite right?

Tell us what happened with OPUS-MT. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.