Skip to content

Linux conformance manifest - #11

Merged
mlapin merged 1 commit into
masterfrom
fix/conformance-avx512-variants
Nov 16, 2026
Merged

mlapin merged 1 commit into
masterfrom
fix/conformance-avx512-variants

Conversation

@mlapin

@mlapin mlapin commented Nov 16, 2026

Copy link
Copy Markdown
Owner

Summary

A manual full-matrix CI run (conformance: full) failed 18 conformance cells in Python (Linux): float64 distillation (T = 0.5, 1, 4) on torch-cpu-extension and jax-cpu-auto, and float64 multilabel_cross_entropy on torch-cpu-tensor, jax-cpu-jax and jax-cpu-auto, all on the 4097-class Gaussian rows. The other 2,506 recorded cells matched the manifest entry for entry.

Every failing entry is a near-cancelling gradient of the documented near-distillation and near-mask limitations, with errors inside their documented sizes. Only the set of entries past the 64 eps bound differs from the recorded one: AVX-512 kernels (8 lanes, their own exp) round these rows differently from AVX2 ones.

  • tests/python/conformance/known_failures/Linux-x86_64.json: the runner's 18 profiles are added as variants with their own ceilings. The manifest's cells are unchanged; the variants are written one cell per line.
  • tests/python/conformance/known.py: the variants docstring names the CPU profiles.

The Rust (BLAS) failure of the same run (cargo fmt of rust/consumer) is already fixed on master.

Validation

  • The run's conformance records (2,524 cells) against the manifest: 18 failures before, 0 after.
  • With the runner's Python and package versions (3.12, torch 2.15.0+cpu, jax 0.12.0.1), an AVX2 machine reproduces the recorded profile in all 2,524 cells and passes the full CPU matrix with this change (23,736 passed, 2,486 expected failures). An AVX-512 machine reproduces the runner's profile in 16 of the 18 cells and passes them with this change; its two torch-cpu-tensor cells keep the recorded profile, so those two variants are checked against the run's records only.
  • The regular CI profile does not include these cells and is unaffected.

… runners

A full-matrix conformance run on a hosted Linux runner failed 18 CPU cells: float64
distillation (CPU extension, JAX auto) and multilabel cross-entropy (PyTorch tensor, JAX)
on the 4097-class Gaussian rows. The entries are near-cancelling gradients within the
documented near-distillation and near-mask errors; AVX-512 kernels put a different set of
them past the bound than AVX2 ones. The runner's 18 profiles are recorded as variants with
their own ceilings; the manifest's cells are unchanged, and its variants are written one
cell per line.
@mlapin mlapin changed the title Linux conformance manifest: variants for the float64 Gaussian profiles of AVX-512 runners Linux conformance manifest Nov 16, 2026
@mlapin
mlapin merged commit f59ba62 into master Nov 16, 2026
33 checks passed
@mlapin
mlapin deleted the fix/conformance-avx512-variants branch November 16, 2026 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant