Stable Diffusion XL 1.0
Generate images locally with Stable Diffusion XL Base 1.0. Supports positive/negative prompts, guidance, configurable dimensions, steps and seed; no refiner required.
Desktop app
Run Stable Diffusion XL 1.0 on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
SDXL Base 1.0 — Image Generation
27 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 7388 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 7556 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 7794 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8114 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8347 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8391 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8410 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8531 ms / 1764 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9146 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9250 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 10258 ms / 2540 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 39248 ms / 1757 ms |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 48855 ms / 2210 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 54563 ms / 1882 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 66237 ms / 2312 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 30598 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 30649 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 30823 ms / 1245 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 30993 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 35415 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 35469 ms / 1250 ms |
FP32 | cpu | Passed | Slow | macos · aarch64 | 204449 ms / 1124 ms |
BF16 | mps | Failed | — | macos · aarch64 | 7406 ms / 0 ms |
BF16 | mps | Failed | — | macos · aarch64 | 8794 ms / 0 ms |
BF16 | mps | Failed | — | macos · aarch64 | 8310 ms / 3873 ms |
BF16 | mps | Failed | — | macos · aarch64 | 7247 ms / 0 ms |
FP16 | mps | Failed | — | Not recorded | 42360 ms / — |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-01T16:37:07.634233+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "python": "3.13.1 (main, Dec 3 2024, 17:59:52) [Clang 16.0.0 (clang-1600.0.26.4)]", "runtime": "Torch2.6.0/Diffusers0.32.2/Transformers4.51.3" }
- Runtime
- diffusers 0.32.2
- Artifact revision
- 462165984030d82259a11f4367a4eed129e94a7b
- Fixture
{ "file": "model-samples/desktop/sdxl-red-car-prompt.txt", "size": 51, "sha1": "8f1ff3dafe3aee473e0269e73b7049b25bf64a15", "sha256": "d34c6e72f38b09d86b5f864c1313958191179b8eda4cb98ca7572af3a3b80f17", "url": "https://assets.localai.tools/samples/v1/files/d34c6e72f38b09d86b5f864c1313958191179b8eda4cb98ca7572af3a3b80f17/sdxl-red-car-prompt.txt" }- Rerun when
- artifact revision/checksum; runtime/driver/backend changes; prompt/negative prompt/seed/dimensions/steps/guidance configuration; quality evaluator/revision/gates
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.3099501132965088,
"threshold": 0.22,
"pixelStd": 0.20869044959545135,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.3099501132965088,
0.12112657725811005,
0.0959417000412941,
0.18555428087711334
],
"referencePrompts": [
"A photograph of a red sports car parked on a street",
"An orange cat on a table",
"A snowy mountain above a blue lake",
"A green forest with no cars"
]
},
"runtime": {
"inferenceMs": 54563.070125001104,
"durationMs": 54563.070125001104,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.018327414452835096,
"denoisingStepsPerSecond": 0.3665482890567019,
"driverAllocatedMemoryBytes": 21152382976,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 1881.996000000072,
"totalMs": 56644.0036669992,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.018327414452835096
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.28906795382499695,
"threshold": 0.22,
"pixelStd": 0.296662837266922,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.28906795382499695,
0.14524361491203308,
0.12646064162254333,
0.15507793426513672
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 9145.587459002854,
"durationMs": 9145.587459002854,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.10934234727760508,
"denoisingStepsPerSecond": 1.3121081673312611,
"driverAllocatedMemoryBytes": 19764297728,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 9190.440207999927,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.10934234727760508
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2704277038574219,
"threshold": 0.22,
"pixelStd": 0.25833043456077576,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2704277038574219,
0.09799514710903168,
0.10969637334346771,
0.22659353911876678
],
"referencePrompts": [
"A landscape photograph of snowy mountains above a blue lake",
"A red sports car on a street",
"An orange cat on a table",
"A flat sandy desert with no water"
]
},
"runtime": {
"inferenceMs": 8346.942791999027,
"durationMs": 8346.942791999027,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
12,
12
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.11980434332897924,
"denoisingStepsPerSecond": 1.437652119947751,
"driverAllocatedMemoryBytes": 19764297728,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 8389.879583999573,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.11980434332897924
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.28906795382499695,
"threshold": 0.22,
"pixelStd": 0.296662837266922,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.28906795382499695,
0.14524361491203308,
0.12646064162254333,
0.15507793426513672
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 7794.411334001779,
"durationMs": 7794.411334001779,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.12829705248396014,
"denoisingStepsPerSecond": 1.5395646298075216,
"driverAllocatedMemoryBytes": 19764297728,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 7838.257999999769,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.12829705248396014
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.28906795382499695,
"threshold": 0.22,
"pixelStd": 0.296662837266922,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.28906795382499695,
0.14524361491203308,
0.12646064162254333,
0.15507793426513672
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 8530.868750000081,
"durationMs": 8530.868750000081,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.11722135567962999,
"denoisingStepsPerSecond": 1.4066562681555599,
"driverAllocatedMemoryBytes": 10290069504,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 1764.0299170016078,
"totalMs": 10343.039167000825,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.11722135567962999
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.28906795382499695,
"threshold": 0.22,
"pixelStd": 0.296662837266922,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.28906795382499695,
0.14524361491203308,
0.12646064162254333,
0.15507793426513672
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 7388.27045799917,
"durationMs": 7388.27045799917,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.13534967428233693,
"denoisingStepsPerSecond": 1.6241960913880433,
"driverAllocatedMemoryBytes": 10290069504,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 7440.121833999001,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.13534967428233693
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.30552589893341064,
"threshold": 0.22,
"pixelStd": 0.18326924741268158,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.30552589893341064,
0.16722582280635834,
0.09530088305473328,
0.18409931659698486
],
"referencePrompts": [
"A photograph of a red sports car parked on a street",
"An orange cat on a table",
"A snowy mountain above a blue lake",
"A green forest with no cars"
]
},
"runtime": {
"inferenceMs": 48854.957583000214,
"durationMs": 48854.957583000214,
"placement": {
"unet": {
"mps:0/torch.bfloat16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.bfloat16": 196
},
"text_encoder_2": {
"mps:0/torch.bfloat16": 517
}
},
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.020468751780228018,
"denoisingStepsPerSecond": 0.4093750356045604,
"driverAllocatedMemoryBytes": 21185937408,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 2210.302708001109,
"totalMs": 51257.565500000055,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.020468751780228018
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.152289479970932,
"threshold": 0.22,
"pixelStd": 0.39970725774765015,
"minimumPixelStd": 0.05,
"targetRank": 1,
"cosines": [
0.152289479970932,
0.18239852786064148,
0.16425111889839172,
0.12811413407325745
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 7405.668625000544,
"durationMs": 7405.668625000544,
"placement": {
"unet": {
"mps:0/torch.bfloat16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.bfloat16": 196
},
"text_encoder_2": {
"mps:0/torch.bfloat16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.13503169674972143,
"denoisingStepsPerSecond": 1.6203803609966572,
"driverAllocatedMemoryBytes": 19797852160,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 7451.693750001141,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.13503169674972143
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.28719285130500793,
"threshold": 0.22,
"pixelStd": 0.2512918710708618,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.28719285130500793,
0.10514500737190247,
0.11050992459058762,
0.21751534938812256
],
"referencePrompts": [
"A landscape photograph of snowy mountains above a blue lake",
"A red sports car on a street",
"An orange cat on a table",
"A flat sandy desert with no water"
]
},
"runtime": {
"inferenceMs": 9249.633792001987,
"durationMs": 9249.633792001987,
"placement": {
"unet": {
"mps:0/torch.bfloat16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.bfloat16": 196
},
"text_encoder_2": {
"mps:0/torch.bfloat16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
12,
12
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.10811238828338093,
"denoisingStepsPerSecond": 1.2973486594005712,
"driverAllocatedMemoryBytes": 19797852160,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 9324.329833001684,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.10811238828338093
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.152289479970932,
"threshold": 0.22,
"pixelStd": 0.39970725774765015,
"minimumPixelStd": 0.05,
"targetRank": 1,
"cosines": [
0.152289479970932,
0.18239852786064148,
0.16425111889839172,
0.12811413407325745
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 8794.136500000604,
"durationMs": 8794.136500000604,
"placement": {
"unet": {
"mps:0/torch.bfloat16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.bfloat16": 196
},
"text_encoder_2": {
"mps:0/torch.bfloat16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.11371213080442079,
"denoisingStepsPerSecond": 1.3645455696530495,
"driverAllocatedMemoryBytes": 19797852160,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 8844.17512499931,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.11371213080442079
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.152289479970932,
"threshold": 0.22,
"pixelStd": 0.39970725774765015,
"minimumPixelStd": 0.05,
"targetRank": 1,
"cosines": [
0.152289479970932,
0.18239852786064148,
0.16425111889839172,
0.12811413407325745
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 8310.064042001613,
"durationMs": 8310.064042001613,
"placement": {
"unet": {
"mps:0/torch.bfloat16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.bfloat16": 196
},
"text_encoder_2": {
"mps:0/torch.bfloat16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.12033601605784182,
"denoisingStepsPerSecond": 1.4440321926941018,
"driverAllocatedMemoryBytes": 10357178368,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 3873.1052080001973,
"totalMs": 12237.668999998277,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.12033601605784182
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.152289479970932,
"threshold": 0.22,
"pixelStd": 0.39970725774765015,
"minimumPixelStd": 0.05,
"targetRank": 1,
"cosines": [
0.152289479970932,
0.18239852786064148,
0.16425111889839172,
0.12811413407325745
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 7247.405999998591,
"durationMs": 7247.405999998591,
"placement": {
"unet": {
"mps:0/torch.bfloat16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.bfloat16": 196
},
"text_encoder_2": {
"mps:0/torch.bfloat16": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.137980402919361,
"denoisingStepsPerSecond": 1.655764835032332,
"driverAllocatedMemoryBytes": 10357178368,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 7289.825291998568,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.137980402919361
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.3025013208389282,
"threshold": 0.22,
"pixelStd": 0.17550452053546906,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.3025013208389282,
0.15131855010986328,
0.07895906269550323,
0.1936735063791275
],
"referencePrompts": [
"A photograph of a red sports car parked on a street",
"An orange cat on a table",
"A snowy mountain above a blue lake",
"A green forest with no cars"
]
},
"runtime": {
"inferenceMs": 66236.50058300336,
"durationMs": 66236.50058300336,
"placement": {
"unet": {
"mps:0/torch.float32": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float32": 196
},
"text_encoder_2": {
"mps:0/torch.float32": 517
}
},
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.015097415944353276,
"denoisingStepsPerSecond": 0.3019483188870655,
"driverAllocatedMemoryBytes": 30001168384,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 2311.7020830031834,
"totalMs": 68795.34808300377,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.015097415944353276
},
"performanceGrade": "B",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2612026333808899,
"threshold": 0.22,
"pixelStd": 0.32530075311660767,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2612026333808899,
0.13999365270137787,
0.16308331489562988,
0.24875833094120026
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 8409.630375001143,
"durationMs": 8409.630375001143,
"placement": {
"unet": {
"mps:0/torch.float32": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float32": 196
},
"text_encoder_2": {
"mps:0/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.11891129043823928,
"denoisingStepsPerSecond": 1.4269354852588714,
"driverAllocatedMemoryBytes": 29056663552,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 8458.963042001415,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.11891129043823928
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2753533124923706,
"threshold": 0.22,
"pixelStd": 0.3030684292316437,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2753533124923706,
0.10248155891895294,
0.12241125106811523,
0.18371526896953583
],
"referencePrompts": [
"A landscape photograph of snowy mountains above a blue lake",
"A red sports car on a street",
"An orange cat on a table",
"A flat sandy desert with no water"
]
},
"runtime": {
"inferenceMs": 8390.783541999554,
"durationMs": 8390.783541999554,
"placement": {
"unet": {
"mps:0/torch.float32": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float32": 196
},
"text_encoder_2": {
"mps:0/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
12,
12
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.11917838125540496,
"denoisingStepsPerSecond": 1.4301405750648595,
"driverAllocatedMemoryBytes": 29056663552,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 8464.000542000576,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.11917838125540496
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2612026333808899,
"threshold": 0.22,
"pixelStd": 0.32530075311660767,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2612026333808899,
0.13999365270137787,
0.16308331489562988,
0.24875833094120026
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 8113.9116670019575,
"durationMs": 8113.9116670019575,
"placement": {
"unet": {
"mps:0/torch.float32": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float32": 196
},
"text_encoder_2": {
"mps:0/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.12324511789632214,
"denoisingStepsPerSecond": 1.4789414147558657,
"driverAllocatedMemoryBytes": 29056663552,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 8169.819458002166,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.12324511789632214
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2612026333808899,
"threshold": 0.22,
"pixelStd": 0.32530075311660767,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2612026333808899,
0.13999365270137787,
0.16308331489562988,
0.24875833094120026
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 10257.71720800185,
"durationMs": 10257.71720800185,
"placement": {
"unet": {
"mps:0/torch.float32": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float32": 196
},
"text_encoder_2": {
"mps:0/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.09748757737442001,
"denoisingStepsPerSecond": 1.1698509284930403,
"driverAllocatedMemoryBytes": 17202003968,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 2539.5833750008023,
"totalMs": 12846.661125000537,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.09748757737442001
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2612026333808899,
"threshold": 0.22,
"pixelStd": 0.32530075311660767,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2612026333808899,
0.13999365270137787,
0.16308331489562988,
0.24875833094120026
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 7555.857833998743,
"durationMs": 7555.857833998743,
"placement": {
"unet": {
"mps:0/torch.float32": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float32": 196
},
"text_encoder_2": {
"mps:0/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.13234764628581897,
"denoisingStepsPerSecond": 1.5881717554298278,
"driverAllocatedMemoryBytes": 17202003968,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 0,
"totalMs": 7597.600917000818,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.13234764628581897
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.30264812707901,
"threshold": 0.22,
"pixelStd": 0.17550447583198547,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.30264812707901,
0.1513705998659134,
0.07889587432146072,
0.19370920956134796
],
"referencePrompts": [
"A photograph of a red sports car parked on a street",
"An orange cat on a table",
"A snowy mountain above a blue lake",
"A green forest with no cars"
]
},
"runtime": {
"inferenceMs": 204448.59629100029,
"durationMs": 204448.59629100029,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.004891205017503069,
"denoisingStepsPerSecond": 0.09782410035006138,
"loadMs": 1124.4640000004438,
"totalMs": 205767.25779099797,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.004891205017503069
},
"performanceGrade": "C",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2613724172115326,
"threshold": 0.22,
"pixelStd": 0.32526078820228577,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2613724172115326,
0.13984692096710205,
0.16196058690547943,
0.24857036769390106
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 30993.34579099741,
"durationMs": 30993.34579099741,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.032264990257698106,
"denoisingStepsPerSecond": 0.3871798830923773,
"loadMs": 0,
"totalMs": 31037.47837499759,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.032264990257698106
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2752610445022583,
"threshold": 0.22,
"pixelStd": 0.30306851863861084,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2752610445022583,
0.10254481434822083,
0.12228523939847946,
0.1836145520210266
],
"referencePrompts": [
"A landscape photograph of snowy mountains above a blue lake",
"A red sports car on a street",
"An orange cat on a table",
"A flat sandy desert with no water"
]
},
"runtime": {
"inferenceMs": 30597.968499998387,
"durationMs": 30597.968499998387,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
12,
12
],
"negativePromptTokens": [
2,
2
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.03268190827767055,
"denoisingStepsPerSecond": 0.3921828993320466,
"loadMs": 0,
"totalMs": 30646.7882500001,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.03268190827767055
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2613724172115326,
"threshold": 0.22,
"pixelStd": 0.32526078820228577,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2613724172115326,
0.13984692096710205,
0.16196058690547943,
0.24857036769390106
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 30648.850166999182,
"durationMs": 30648.850166999182,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.032627651430680395,
"denoisingStepsPerSecond": 0.39153181716816476,
"loadMs": 0,
"totalMs": 30691.506875002233,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.032627651430680395
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2613724172115326,
"threshold": 0.22,
"pixelStd": 0.32526078820228577,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2613724172115326,
0.13984692096710205,
0.16196058690547943,
0.24857036769390106
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 30823.36199999918,
"durationMs": 30823.36199999918,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.03244292429878436,
"denoisingStepsPerSecond": 0.3893150915854124,
"loadMs": 1245.372834000591,
"totalMs": 32117.733543000213,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.03244292429878436
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.3329932391643524,
"threshold": 0.22,
"pixelStd": 0.22786079347133636,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.3329932391643524,
0.15929476916790009,
0.11256163567304611,
0.19956912100315094
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 39247.74708300174,
"durationMs": 39247.74708300174,
"placement": {
"unet": {
"mps:0/torch.float16": 1680
},
"vae": {
"mps:0/torch.float32": 248
},
"text_encoder": {
"mps:0/torch.float16": 196
},
"text_encoder_2": {
"mps:0/torch.float16": 517
}
},
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.025479169489275005,
"denoisingStepsPerSecond": 0.5095833897855001,
"driverAllocatedMemoryBytes": 21219491840,
"memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
"loadMs": 1756.9205830004648,
"totalMs": 41189.588707999064,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.025479169489275005
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "Metal/MPS",
"acceleration": "partial",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2613724172115326,
"threshold": 0.22,
"pixelStd": 0.32526078820228577,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2613724172115326,
0.13984692096710205,
0.16196058690547943,
0.24857036769390106
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 35468.713666999975,
"durationMs": 35468.713666999975,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.028193861479966727,
"denoisingStepsPerSecond": 0.33832633775960075,
"loadMs": 1250.0311250005325,
"totalMs": 36768.13754199975,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.028193861479966727
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 2,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
"score": 0.2613724172115326,
"threshold": 0.22,
"pixelStd": 0.32526078820228577,
"minimumPixelStd": 0.05,
"targetRank": 0,
"cosines": [
0.2613724172115326,
0.13984692096710205,
0.16196058690547943,
0.24857036769390106
],
"referencePrompts": [
"A photograph of an orange cat sitting on a wooden table",
"A red sports car on a street",
"A snowy mountain above a blue lake",
"A photograph of a black dog sitting on a wooden table"
]
},
"runtime": {
"inferenceMs": 35415.12062499896,
"durationMs": 35415.12062499896,
"placement": {
"unet": {
"cpu/torch.float32": 1680
},
"vae": {
"cpu/torch.float32": 248
},
"text_encoder": {
"cpu/torch.float32": 196
},
"text_encoder_2": {
"cpu/torch.float32": 517
}
},
"seed": 42,
"steps": 12,
"guidanceScale": 7.5,
"scheduler": "EulerDiscreteScheduler",
"promptTokens": [
13,
13
],
"negativePromptTokens": [
9,
9
],
"promptTruncated": false,
"negativePromptTruncated": false,
"negativePromptIgnored": false,
"safetyCheckerAvailable": false,
"watermarkApplied": false,
"imagesPerSecond": 0.028236526725088043,
"denoisingStepsPerSecond": 0.3388383207010565,
"loadMs": 0,
"totalMs": 35457.88124999672,
"performanceMetric": {
"name": "imagesPerSecond",
"value": 0.028236526725088043
},
"performanceGrade": "A",
"engine": "diffusers",
"version": "0.32.2",
"torchVersion": "2.6.0",
"transformersVersion": "4.51.3",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 2,
"artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
"fallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"grade": "fast"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"pixelStd": 0,
"minimumPixelStd": 0.05,
"reason": "Entire1024px output black with unmodified Diffusers0.32.2 MPS decode: VAE starts FP32 but pipeline silently casts it to FP16 (confirmed by recorded final placement)."
},
"runtime": {
"inferenceMs": 42360.09766699863,
"totalMs": 42360.09766699863,
"performanceGrade": "F",
"imagesPerSecond": 0.023607122152106544
}
}
]