gemm_quantized
benchmarks/matmul.py
quantize_rhs: false
1 × 128
1 × 512
1 × K
scale + cast
FP8 × INT4
W4A8
A
float8_e4m3fn
float8_e5m2
B
int4
FP8
float32
quant_dtype