Skip to content

[tpums] specs: Use the bfloat16 peak for float32 compute rooflines - #165

Merged
copybara-service[bot] merged 1 commit into
mainfrom
test_1022617738
Nov 18, 2026
Merged

copybara-service[bot] merged 1 commit into
mainfrom
test_1022617738

Conversation

@copybara-service

Copy link
Copy Markdown

[tpums] specs: Use the bfloat16 peak for float32 compute rooflines

float32 GEMM reported roofline efficiency above 100% because the float32 peak was set to half the bfloat16 peak. MXU multiplies take bfloat16 inputs (https://docs.cloud.google.com/tpu/docs/system-architecture-tpu-vm) and the benchmarks run at JAX's default matmul precision, so a float32 matmul is a single bfloat16 pass. Set the float32 peak to the bfloat16 peak for tpu7x and v6e.

@google-cla

google-cla Bot commented Nov 16, 2026

Copy link
Copy Markdown

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@copybara-service
copybara-service Bot force-pushed the test_1022617738 branch 3 times, most recently from f93befe to 0c15d31 Compare November 18, 2026 01:45
float32 GEMM reported roofline efficiency above 100% because the float32 peak was set to half the bfloat16 peak. MXU multiplies take bfloat16 inputs (https://docs.cloud.google.com/tpu/docs/system-architecture-tpu-vm) and the benchmarks run at JAX's default matmul precision, so a float32 matmul is a single bfloat16 pass. Set the float32 peak to the bfloat16 peak for tpu7x and v6e.

PiperOrigin-RevId: 1024209837
@copybara-service
copybara-service Bot merged commit d961958 into main Nov 18, 2026
1 of 2 checks passed
@copybara-service
copybara-service Bot deleted the test_1022617738 branch November 18, 2026 01:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants