Skip to content

Wire the AIE trace buffer through the fused full ELF flow - #154

Closed
asyms wants to merge 7 commits into
amd:develfrom
KULeuven-MICAS:tracing-on-devel
Closed

Wire the AIE trace buffer through the fused full ELF flow#154
asyms wants to merge 7 commits into
amd:develfrom
KULeuven-MICAS:tracing-on-devel

Conversation

@asyms

@asyms asyms commented Aug 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

stream-dse can now emit AIE tracing, but the trace buffer never reaches the device through the fused full ELF flow: lowering appends it to the operator's runtime sequence, and the address gets patched against the dispatched kernel instead, which is the wrapper. This wires the buffer through so a traced design produces real data, and leaves untraced builds exactly as they were.

  • Give the fused runtime sequence a trace buffer per operator, at the index that operator uses. That index is what lowering patches against, so the wrapper has to match it or the trace DMA writes nowhere and the buffer comes back empty.
  • Allocate one buffer per operator, bind them, and sync them back with the outputs.
  • Let the SwiGLU-prefill operator use it: it passes trace_size into the sequence, and trace_size and trace_max_tiles into stream-dse's codegen, so the design is generated with tracing rather than having it added afterwards.
  • Turn tracing on with IRON_TRACE_SIZE, and pick how many tiles with IRON_TRACE_NTILES. Off by default, since tracing changes the calling convention and its packet flows need routing a full design may not have spare.
  • Key both the generated design and the sequence's ELF on whether tracing is on, so traced and untraced builds never share an entry. Without the second one, turning the flag on reuses an untraced ELF and binding the trace buffer fails against a kernel that has no argument for it.
  • Require stream-dse 1.13.14, the first release with the tracing codegen and the tile count argument. This is a floor for every build, not just traced ones.
  • Add unit tests for the slot layout.

This reopens #151, which targeted update-mlir-aie-latest-nightly and was closed when that branch merged as #150. It is based on devel now, and carries one extra commit for the ELF cache key above.

Checked on Strix in a clean venv built exactly as .github/actions/prereqs does, against stream-dse 1.14.0 (what the >=1.13.14 floor resolves to today) and mlir-aie 1.4.2.dev16: pytest -m "not extensive" iron/operators/ iron/tests/ gives 990 passed, a traced k=1 build passes on hardware, and turning tracing on and off again in one build directory works both ways. black --check and reuse lint are clean.

asyms added 5 commits August 26, 2026 09:52
@asyms
require the stream-dse release that generates mlir-aie 1.4.0 buffer d…
1478cbe 
…escriptors
@asyms
carry a hardware trace buffer through the fused sequence
aaa07b9
@asyms
patch the trace buffer address against the dispatched kernel
979f9b4 
Trace lowering records the buffer's index in the sequence it configures, but that
index is resolved against the kernel the host dispatches, which for a fused build
is the wrapper rather than the operator. The address was patched from an argument
the wrapper did not have, so the trace DMA wrote nowhere and the buffer came back
empty. Give the wrapper the buffer at the same index.
@asyms
give every traced operator its own trace buffer slot
fc25b47
@asyms
key the fused sequence artifacts on the trace size
dac0b4c 
Tracing adds a runtime-sequence argument, so a traced ELF cannot be reused by an
untraced run or the other way round: the two now get different artifact names and
toggling the flag no longer needs the build directory wiped.
andrej
andrej requested changes Aug 28, 2026
View reviewed changes

@andrej andrej left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for submitting this. I see two things that worry me:

  • The error about "operators taking the same number of arguments".
  • The "pick the IR file with the most write32s" logic.

I think the fundamental problem is that tracing currently does not play nice with aiex.configure. What I read from this PR is that tracing always patches a buffer at a fixed index, but we'd want separate indices for each sub-operator to have its own trace buffer. To me, this PR looks like mostly a workaround around that.

I hate rejecting this work, but could we instead implement a proper fix upstream? For example, make trace aware of aiex.configure and allocate separate trace buffers / different offsets into the same trace buffer for each called runtime sequence. I think at the end of the day that will be fewer lines of code, and it will benefit everyone upstream.

As a solution in the meantime, have you tried the "separate xclbin" dispatch mode for tracing?

Comment thread iron/common/tracing_utils.py Outdated
Comment on lines +75 to +76
Picks the file with the most ``write32`` ops rather than hardcoding a stage name,
since those names are aiecc's business and have changed before.

@andrej andrej Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That seems like a hack ...

If the trace parser util needs a certain form of IR, we should explicitly request it to be generated using aiecc --get-<whatever it needs>. If it is not exposed as --get-<whatever it needs>, we should enable that in aiecc. Relying on intermediate outputs in <source>.mlir.d seems hacky; the compiler may choose to not generate them and do things all in-memory instead.

Comment thread iron/common/compilation/sequence.py Outdated
Comment on lines +48 to +54
counts = list(trace_slots.values())
shared = sorted({n for n in counts if counts.count(n) > 1})
if shared:
raise NotImplementedError(
"operators taking the same number of arguments would share one trace "
f"buffer (slots {shared}); trace them in separate dispatches"
)

@andrej andrej Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Am I understanding correctly that this rejects anything where multiple operators in the same sequence take the same number of arguments?

@andrej

andrej commented Aug 28, 2026

Copy link
Copy Markdown
Collaborator

I've sent off an agent to look into a proper upstream fix to help with this, will report back.

@andrej

andrej commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator

Upstream WIP Xilinx/mlir-aie#3652

@asyms

asyms commented Aug 31, 2026

Copy link
Copy Markdown
Contributor Author

@andrej Thanks for the upstream PR, that's indeed the way to go I think. Those things you mentioned were indeed added as hacks around a cleaner upstream change. I can work more on this tomorrow, would you like me to work directly in that mlir-aie branch in your fork or what do you think is the most appropriate way forward?

@andrej

andrej commented Aug 31, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

@asyms I haven't had a chance to review the WIP PR in-depth yet but skimming it the overall shape seems correct. If you want to push directly to my branch on my fork, that'd be great. I think timezones will sequentialize us so we won't step on each other's toes too much. I'm hoping to get this merged this week.

@andrej andrej mentioned this pull request Aug 31, 2026
Merged
@asyms
Take the trace buffer from the fused sequence lowering
c83afec 
mlir-aie now gives a dispatching runtime sequence one trace buffer and hands
each call site a slice of it, so the wrapper no longer has to place a buffer per
operator at the index that operator's argument count happens to occupy. That
placement could not represent two operators taking the same number of arguments.

Emit only the consolidated buffers and let the lowering append the fused one.
Bind a single buffer for it, and split the readback by the recorded slices.
@github-actions

github-actions Bot commented Sep 8, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

CI Test Results

aa2656c (2026_09_08_21_02_34)

IRON - CI Summary

Small

iron/operators/axpy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0] - - ✅ 365.54
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0] - - ✅ 725.70
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0] - - ✅ 423.52
iron/operators/dequant
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32] - - ✅ 326.40
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32] - - ✅ 405.42
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32] - - ✅ 374.86
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32] - - ✅ 733.58
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32] - - ✅ 672.54
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32] - - ✅ 482.82
iron/operators/elementwise_add
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 353.46
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 324.40
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 411.40
iron/operators/elementwise_mul
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 406.46
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 468.94
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 524.06
iron/operators/gelu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 303.34
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 350.26
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 774.26
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 423.94
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 277.84
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 721.94
iron/operators/gemm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 543.04
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 587.08
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 82249.82
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 24763.18
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1] - - ✅ 3416.14
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4] - - ✅ 6594.78
iron/operators/gemv
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ✅ 0.10
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ✅ 3.67
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024] - - ✅ 6.81
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512] - - ✅ 8.66
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ✅ 3.62
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024] - - ✅ 6.61
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024] - - ✅ 9.62
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2] - - ✅ 1.74
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2] - - ✅ 0.34
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4] - - ✅ 0.49
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8] - - ✅ 1.52
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ❌ -
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ❌ -
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ❌ -
iron/operators/layer_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 370.42
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 438.30
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 439.48
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 374.80
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 471.28
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 428.30
iron/operators/leaky_relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01] - - ✅ 421.32
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1] - - ✅ 340.30
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25] - - ✅ 352.84
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01] - - ✅ 285.94
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01] - - ✅ 336.78
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01] - - ✅ 749.36
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01] - - ✅ 392.20
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01] - - ✅ 481.28
iron/operators/mem_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048] - - ✅ 406.18
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024] - - ✅ 892.46
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024] - - ✅ 372.58
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512] - - ✅ 496.10
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512] - - ✅ 467.54
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256] - - ✅ 729.90
iron/operators/relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 305.54
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 794.38
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 389.62
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 362.52
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 395.76
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 460.86
iron/operators/repeat
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word] - - ✅ -
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None] - - ✅ 434.36
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64] - - ✅ 340.74
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None] - - ✅ 413.76
iron/operators/rms_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False] - - ✅ 406.86
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True] - - ✅ 465.74
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False] - - ✅ 387.00
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True] - - ✅ 702.00
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False] - - ✅ 334.94
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True] - - ✅ 435.50
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False] - - ✅ 454.74
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True] - - ✅ 755.08
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False] - - ✅ 431.48
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True] - - ✅ 474.34
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False] - - ✅ 453.66
iron/operators/rope
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0] - - ✅ 348.56
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0] - - ✅ 417.94
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0] - - ✅ 480.00
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0] - - ✅ 419.50
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0] - - ✅ 390.36
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0] - - ✅ 409.38
iron/operators/sigmoid
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 350.34
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 765.18
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 260.12
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 425.44
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 487.70
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 545.04
iron/operators/silu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 300.26
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 404.52
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 332.64
iron/operators/softmax
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024] - - ✅ 402.94
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048] - - ✅ 596.42
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 462.86
iron/operators/strided_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_strided_copy[chunked_transfer] - - ✅ 403.90
test_strided_copy[contiguous] - - ✅ 356.78
test_strided_copy[four_channels] - - ✅ 396.34
test_strided_copy[kv_slot0] - - ✅ 353.94
test_strided_copy[kv_slot5] - - ✅ 300.56
test_strided_copy[kv_slot5_four_channels] - - ✅ 358.28
test_strided_copy[kv_slot5_two_channels] - - ✅ 345.36
test_strided_copy[kv_slot_last] - - ✅ 462.42
test_strided_copy[two_channels] - - ✅ 405.24
test_strided_copy[two_channels_chunked] - - ✅ 393.78
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4] - - ✅ -
iron/operators/swiglu_decode
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584] - - ✅ 13991.88
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048] - - ✅ 14993.90
iron/operators/swiglu_prefill
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False] - - ✅ 23774.98
iron/operators/tanh
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 255.74
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 263.90
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 381.32
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 431.08
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 439.30
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 363.00
iron/operators/transpose
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1] - - ✅ 544.32
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2] - - ✅ 671.80
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1] - - ✅ 441.88
Phoenix - Small

IRON

Tested on 2026_09_08_21_02_34 at commit aa2656c.

iron/operators/axpy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]✅ 5/5365.540.04n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]✅ 5/5725.700.03n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]✅ 5/5423.520.03n/a
iron/operators/dequant
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]✅ 5/5326.400.02n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]✅ 5/5405.420.01n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]✅ 5/5374.860.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]✅ 5/5733.580.01n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]✅ 5/5672.540.01n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]✅ 5/5482.820.01n/a
iron/operators/elementwise_add
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5353.460.04n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5324.400.04n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5411.400.04n/a
iron/operators/elementwise_mul
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5406.460.04n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5468.940.03n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5524.060.02n/a
iron/operators/gelu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5303.340.03n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5350.260.03n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5774.260.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5423.940.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5277.840.03n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5721.940.02n/a
iron/operators/gemm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5543.040.4418.76
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5587.080.4017.07
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/582249.820.31208.89
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/524763.181.02693.82
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]✅ 5/53416.142.58676.64
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]✅ 5/56594.780.1910.31
iron/operators/gemv
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]✅ 5/5n/a0.100.09
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]✅ 5/5n/a3.673.67
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]✅ 5/5n/a6.816.80
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]✅ 5/5n/a8.668.66
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a3.623.62
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a6.616.61
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a9.629.62
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]✅ 5/5n/a1.741.73
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]✅ 5/5n/a0.340.33
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]✅ 5/5n/a0.490.49
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]✅ 5/5n/a1.521.49
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]❌ 0/5n/an/an/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]❌ 0/5n/an/an/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]❌ 0/5n/an/an/a
iron/operators/layer_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5370.420.03n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5438.300.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5439.480.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5374.800.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5471.280.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5428.300.02n/a
iron/operators/leaky_relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]✅ 5/5421.320.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]✅ 5/5340.300.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]✅ 5/5352.840.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]✅ 5/5285.940.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]✅ 5/5336.780.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]✅ 5/5749.360.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]✅ 5/5392.200.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]✅ 5/5481.280.02n/a
iron/operators/mem_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]✅ 5/5406.180.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]✅ 5/5892.460.01n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]✅ 5/5372.580.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]✅ 5/5496.100.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]✅ 5/5467.540.02n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]✅ 5/5729.900.02n/a
iron/operators/relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5305.540.03n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5794.380.02n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5389.620.02n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5362.520.03n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5395.760.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5460.860.02n/a
iron/operators/repeat
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]✅ 5/5n/an/an/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]✅ 5/5434.360.06n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]✅ 5/5340.740.13n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]✅ 5/5413.760.01n/a
iron/operators/rms_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]✅ 5/5406.860.02n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]✅ 5/5465.740.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]✅ 5/5387.000.02n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]✅ 5/5702.000.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]✅ 5/5334.940.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]✅ 5/5435.500.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]✅ 5/5454.740.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]✅ 5/5755.080.01n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]✅ 5/5431.480.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]✅ 5/5474.340.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]✅ 5/5453.660.02n/a
iron/operators/rope
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]✅ 5/5348.560.30n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]✅ 5/5417.940.26n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]✅ 5/5480.000.24n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]✅ 5/5419.500.19n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]✅ 5/5390.360.20n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]✅ 5/5409.380.20n/a
iron/operators/sigmoid
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5350.340.03n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5765.180.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5260.120.03n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5425.440.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5487.700.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5545.040.02n/a
iron/operators/silu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5300.260.03n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5404.520.02n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5332.640.03n/a
iron/operators/softmax
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]✅ 5/5402.940.35n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]✅ 5/5596.420.26n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5462.860.31n/a
iron/operators/strided_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_strided_copy[chunked_transfer]✅ 5/5403.900.01n/a
test_strided_copy[contiguous]✅ 5/5356.780.01n/a
test_strided_copy[four_channels]✅ 5/5396.340.01n/a
test_strided_copy[kv_slot0]✅ 5/5353.940.44n/a
test_strided_copy[kv_slot5]✅ 5/5300.560.48n/a
test_strided_copy[kv_slot5_four_channels]✅ 5/5358.280.40n/a
test_strided_copy[kv_slot5_two_channels]✅ 5/5345.360.43n/a
test_strided_copy[kv_slot_last]✅ 5/5462.420.32n/a
test_strided_copy[two_channels]✅ 5/5405.240.01n/a
test_strided_copy[two_channels_chunked]✅ 5/5393.780.01n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]✅ 1/1n/an/an/a
iron/operators/swiglu_decode
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]✅ 5/513991.880.00n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]✅ 5/514993.900.00n/a
iron/operators/swiglu_prefill
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]✅ 5/523774.980.09n/a
iron/operators/tanh
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5255.740.03n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5263.900.03n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5381.320.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5431.080.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5439.300.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5363.000.02n/a
iron/operators/transpose
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]✅ 5/5544.321.11n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]✅ 5/5671.801.73n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]✅ 5/5441.881.34n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.06 (+28.09%)0.04 (+15.87%)0.03 (+2.47%)0.02 (+4.10%)0.02 (+39.61%)537.50 (-3.93%)365.54 (-9.98%)411.80 (-2.42%)198.30 (-21.90%)144.60 (+3.16%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)559.50 (n/a)406.08 (n/a)422.00 (n/a)253.90 (n/a)140.18 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (-16.00%)0.03 (-19.39%)0.03 (+19.50%)0.01 (-48.74%)0.02 (-28.95%)2047.00 (+95.06%)725.70 (+40.45%)453.20 (-16.32%)239.30 (+19.05%)745.79 (+114.79%)
deb6e1e — 2026-09-03 22:38:330.06 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)1049.40 (n/a)516.68 (n/a)541.60 (n/a)201.00 (n/a)347.21 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (-2.68%)0.03 (-1.77%)0.03 (-2.56%)0.02 (-7.43%)0.01 (-1.14%)634.10 (+8.02%)423.52 (+2.23%)394.80 (+2.63%)261.60 (+2.75%)157.91 (+5.86%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)587.00 (n/a)414.30 (n/a)384.70 (n/a)254.60 (n/a)149.17 (n/a)
iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-39.66%)0.02 (-26.74%)0.02 (-9.74%)0.01 (-34.32%)0.00 (-38.69%)486.00 (+52.26%)326.40 (+36.36%)269.00 (+10.79%)252.90 (+65.73%)98.26 (+57.92%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)319.20 (n/a)239.36 (n/a)242.80 (n/a)152.60 (n/a)62.22 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-29.80%)0.01 (-22.59%)0.01 (-36.91%)0.01 (-11.52%)0.00 (-42.26%)554.40 (+13.00%)405.42 (+21.49%)427.60 (+58.49%)295.30 (+42.45%)110.15 (-16.83%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)490.60 (n/a)333.72 (n/a)269.80 (n/a)207.30 (n/a)132.45 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-4.69%)0.02 (-17.82%)0.02 (-13.74%)0.01 (-51.68%)0.01 (+117.58%)684.70 (+106.92%)374.86 (+36.41%)302.60 (+15.94%)251.70 (+4.96%)177.79 (+392.52%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)330.90 (n/a)274.80 (n/a)261.00 (n/a)239.80 (n/a)36.10 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-1.56%)0.01 (+5.00%)0.01 (+14.91%)0.00 (+1.58%)0.01 (-4.78%)1860.30 (-1.55%)733.58 (-8.34%)491.50 (-12.98%)247.30 (+1.56%)666.74 (-2.57%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.01 (n/a)1889.60 (n/a)800.34 (n/a)564.80 (n/a)243.50 (n/a)684.35 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+15.16%)0.01 (-4.06%)0.01 (+20.46%)0.00 (-74.16%)0.01 (+50.69%)1998.00 (+287.06%)672.54 (+65.59%)401.40 (-17.00%)221.40 (-13.14%)744.67 (+489.34%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)516.20 (n/a)406.14 (n/a)483.60 (n/a)254.90 (n/a)126.36 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+1.48%)0.01 (-19.34%)0.01 (-32.54%)0.01 (+6.86%)0.01 (-4.99%)661.00 (-6.41%)482.82 (+20.06%)490.10 (+48.25%)242.00 (-1.47%)152.15 (-19.45%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)706.30 (n/a)402.16 (n/a)330.60 (n/a)245.60 (n/a)188.89 (n/a)
iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)477.70 (n/a)353.46 (n/a)342.30 (n/a)243.80 (n/a)112.04 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)588.90 (n/a)324.40 (n/a)237.30 (n/a)229.90 (n/a)153.84 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)600.50 (n/a)411.40 (n/a)439.00 (n/a)226.80 (n/a)171.51 (n/a)
iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)635.70 (n/a)406.46 (n/a)295.10 (n/a)246.20 (n/a)189.43 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)586.20 (n/a)468.94 (n/a)493.80 (n/a)328.20 (n/a)95.16 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)604.40 (n/a)524.06 (n/a)550.70 (n/a)366.80 (n/a)97.07 (n/a)
iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)403.20 (n/a)303.34 (n/a)247.10 (n/a)231.80 (n/a)84.78 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)658.10 (n/a)350.26 (n/a)258.40 (n/a)227.50 (n/a)179.01 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)2422.30 (n/a)774.26 (n/a)474.20 (n/a)231.70 (n/a)928.19 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)538.60 (n/a)423.94 (n/a)429.00 (n/a)243.30 (n/a)121.08 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)377.10 (n/a)277.84 (n/a)245.80 (n/a)225.70 (n/a)61.67 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1880.40 (n/a)721.94 (n/a)452.90 (n/a)394.00 (n/a)648.32 (n/a)
iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.60 (-8.81%)0.44 (-5.20%)0.44 (+2.15%)0.26 (-30.24%)0.12 (+7.87%)859.10 (+43.35%)543.04 (+9.47%)506.30 (-2.11%)367.10 (+9.65%)185.85 (+88.57%)25.70 (-8.81%)18.76 (-5.20%)18.64 (+2.15%)10.99 (-30.24%)5.25 (+7.87%)
deb6e1e — 2026-09-03 22:38:330.66 (n/a)0.46 (n/a)0.43 (n/a)0.37 (n/a)0.11 (n/a)599.30 (n/a)496.08 (n/a)517.20 (n/a)334.80 (n/a)98.56 (n/a)28.19 (n/a)19.79 (n/a)18.25 (n/a)15.75 (n/a)4.86 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.49 (-11.45%)0.40 (-4.71%)0.43 (+1.43%)0.25 (-25.48%)0.10 (+9.65%)879.60 (+34.19%)587.08 (+7.69%)517.00 (-1.39%)448.90 (+12.96%)176.82 (+62.69%)21.02 (-11.45%)17.07 (-4.71%)18.26 (+1.43%)10.73 (-25.48%)4.20 (+9.65%)
deb6e1e — 2026-09-03 22:38:330.56 (n/a)0.42 (n/a)0.42 (n/a)0.34 (n/a)0.09 (n/a)655.50 (n/a)545.14 (n/a)524.30 (n/a)397.40 (n/a)108.69 (n/a)23.74 (n/a)17.91 (n/a)18.00 (n/a)14.40 (n/a)3.83 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.31 (+0.41%)0.31 (+0.88%)0.31 (+0.41%)0.30 (+1.59%)0.00 (-36.06%)83121.80 (-1.56%)82249.82 (-0.88%)82402.20 (-0.41%)81352.60 (-0.40%)793.98 (-37.38%)211.18 (+0.41%)208.89 (+0.88%)208.49 (+0.41%)206.68 (+1.59%)2.02 (-36.06%)
deb6e1e — 2026-09-03 22:38:330.31 (n/a)0.30 (n/a)0.30 (n/a)0.30 (n/a)0.00 (n/a)84441.40 (n/a)82982.52 (n/a)82742.70 (n/a)81682.30 (n/a)1268.00 (n/a)210.33 (n/a)207.07 (n/a)207.63 (n/a)203.45 (n/a)3.16 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:511.03 (+0.23%)1.02 (+0.33%)1.02 (+0.41%)1.00 (+0.54%)0.01 (-5.97%)25115.70 (-0.54%)24763.18 (-0.33%)24698.00 (-0.41%)24487.10 (-0.23%)237.70 (-6.79%)701.59 (+0.23%)693.82 (+0.33%)695.60 (+0.41%)684.03 (+0.54%)6.63 (-5.97%)
deb6e1e — 2026-09-03 22:38:331.03 (n/a)1.01 (n/a)1.01 (n/a)1.00 (n/a)0.01 (n/a)25251.20 (n/a)24846.02 (n/a)24799.50 (n/a)24544.40 (n/a)255.00 (n/a)699.95 (n/a)691.51 (n/a)692.75 (n/a)680.36 (n/a)7.06 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:513.45 (-5.56%)2.58 (-8.76%)2.52 (-13.81%)1.48 (-24.17%)0.79 (-6.57%)5438.50 (+31.87%)3416.14 (+11.00%)3197.70 (+16.02%)2333.20 (+5.90%)1239.24 (+28.82%)906.03 (-5.56%)676.64 (-8.76%)661.07 (-13.81%)388.70 (-24.17%)206.01 (-6.57%)
deb6e1e — 2026-09-03 22:38:333.66 (n/a)2.83 (n/a)2.92 (n/a)1.95 (n/a)0.84 (n/a)4124.00 (n/a)3077.52 (n/a)2756.20 (n/a)2203.30 (n/a)962.01 (n/a)959.42 (n/a)741.61 (n/a)766.98 (n/a)512.59 (n/a)220.50 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.23 (-6.40%)0.19 (-7.34%)0.20 (-6.41%)0.16 (-7.58%)0.03 (-4.86%)7573.10 (+8.20%)6594.78 (+7.99%)6331.90 (+6.85%)5487.00 (+6.84%)845.86 (+9.84%)12.23 (-6.40%)10.31 (-7.34%)10.60 (-6.41%)8.86 (-7.58%)1.35 (-4.86%)
deb6e1e — 2026-09-03 22:38:330.24 (n/a)0.21 (n/a)0.21 (n/a)0.18 (n/a)0.03 (n/a)6999.10 (n/a)6106.98 (n/a)5925.70 (n/a)5135.70 (n/a)770.08 (n/a)13.07 (n/a)11.13 (n/a)11.33 (n/a)9.59 (n/a)1.42 (n/a)
iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.13 (n/a)0.10 (n/a)0.11 (n/a)0.06 (n/a)0.03 (n/a)0.13 (n/a)0.09 (n/a)0.11 (n/a)0.06 (n/a)0.03 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:513.84 (n/a)3.67 (n/a)3.70 (n/a)3.34 (n/a)0.20 (n/a)3.84 (n/a)3.67 (n/a)3.70 (n/a)3.34 (n/a)0.20 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:517.36 (-0.69%)6.81 (+5.57%)6.74 (+0.73%)6.11 (+7.88%)0.52 (-31.87%)7.35 (-0.69%)6.80 (+5.57%)6.74 (+0.73%)6.10 (+7.88%)0.52 (-31.87%)
deb6e1e — 2026-09-03 22:38:337.41 (n/a)6.45 (n/a)6.69 (n/a)5.66 (n/a)0.76 (n/a)7.40 (n/a)6.44 (n/a)6.69 (n/a)5.66 (n/a)0.76 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:519.89 (-2.54%)8.66 (-1.12%)8.27 (-2.67%)7.39 (-9.96%)1.04 (+32.55%)9.88 (-2.54%)8.66 (-1.12%)8.26 (-2.67%)7.38 (-9.96%)1.04 (+32.55%)
deb6e1e — 2026-09-03 22:38:3310.15 (n/a)8.76 (n/a)8.50 (n/a)8.20 (n/a)0.78 (n/a)10.14 (n/a)8.75 (n/a)8.49 (n/a)8.20 (n/a)0.78 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:513.95 (n/a)3.62 (n/a)3.65 (n/a)3.32 (n/a)0.26 (n/a)3.95 (n/a)3.62 (n/a)3.65 (n/a)3.32 (n/a)0.26 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:516.83 (-8.77%)6.61 (-0.12%)6.70 (+2.70%)6.11 (+6.00%)0.29 (-55.80%)6.83 (-8.77%)6.61 (-0.12%)6.69 (+2.70%)6.11 (+6.00%)0.29 (-55.80%)
deb6e1e — 2026-09-03 22:38:337.49 (n/a)6.62 (n/a)6.52 (n/a)5.77 (n/a)0.66 (n/a)7.49 (n/a)6.62 (n/a)6.52 (n/a)5.77 (n/a)0.66 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:5113.61 (-3.13%)9.62 (-23.28%)8.19 (-40.32%)7.69 (+2.45%)2.51 (-10.98%)13.61 (-3.13%)9.62 (-23.28%)8.19 (-40.32%)7.69 (+2.45%)2.51 (-10.98%)
deb6e1e — 2026-09-03 22:38:3314.05 (n/a)12.54 (n/a)13.73 (n/a)7.51 (n/a)2.82 (n/a)14.05 (n/a)12.54 (n/a)13.72 (n/a)7.50 (n/a)2.82 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:512.78 (-11.86%)1.74 (-30.97%)1.67 (-44.92%)1.03 (-5.74%)0.73 (-17.96%)2.77 (-11.86%)1.73 (-30.97%)1.67 (-44.92%)1.02 (-5.74%)0.73 (-17.96%)
deb6e1e — 2026-09-03 22:38:333.15 (n/a)2.52 (n/a)3.04 (n/a)1.09 (n/a)0.89 (n/a)3.14 (n/a)2.51 (n/a)3.03 (n/a)1.09 (n/a)0.89 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.51 (-9.90%)0.34 (-9.77%)0.36 (+3.75%)0.08 (+0.89%)0.16 (-19.99%)0.51 (-9.90%)0.33 (-9.77%)0.36 (+3.75%)0.08 (+0.89%)0.16 (-19.99%)
deb6e1e — 2026-09-03 22:38:330.57 (n/a)0.37 (n/a)0.35 (n/a)0.08 (n/a)0.20 (n/a)0.56 (n/a)0.37 (n/a)0.34 (n/a)0.08 (n/a)0.20 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:510.72 (-0.95%)0.49 (+20.65%)0.60 (+28.45%)0.14 (+79.43%)0.24 (+0.30%)0.71 (-0.95%)0.49 (+20.65%)0.59 (+28.45%)0.14 (+79.43%)0.24 (+0.30%)
deb6e1e — 2026-09-03 22:38:330.73 (n/a)0.41 (n/a)0.46 (n/a)0.08 (n/a)0.24 (n/a)0.72 (n/a)0.41 (n/a)0.46 (n/a)0.08 (n/a)0.24 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
aa2656c — 2026-09-08 20:57:512.47 (+0.01%)1.52 (-3.92%)1.85 (+4.15%)0.44 (-1.36%)1.01 (+31.84%)2.43 (+0.01%)1.49 (-3.92%)1.82 (+4.15%)0.43 (-1.36%)0.99 (+31.84%)
deb6e1e — 2026-09-03 22:38:332.47 (n/a)1.58 (n/a)1.78 (n/a)0.44 (n/a)0.76 (n/a)2.43 (n/a)1.55 (n/a)1.75 (n/a)0.43 (n/a)0.75 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)540.00 (n/a)370.42 (n/a)299.90 (n/a)242.20 (n/a)149.97 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)662.80 (n/a)438.30 (n/a)493.20 (n/a)231.20 (n/a)174.19 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)614.00 (n/a)439.48 (n/a)402.60 (n/a)295.40 (n/a)124.54 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)589.30 (n/a)374.80 (n/a)303.40 (n/a)238.50 (n/a)142.24 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)561.00 (n/a)471.28 (n/a)476.90 (n/a)369.90 (n/a)67.86 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)614.60 (n/a)428.30 (n/a)470.40 (n/a)185.90 (n/a)167.97 (n/a)
iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (+3.58%)0.02 (+15.14%)0.03 (+86.07%)0.01 (-18.15%)0.01 (+19.59%)724.20 (+22.19%)421.32 (-6.77%)279.10 (-46.25%)244.40 (-3.44%)220.26 (+35.61%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)592.70 (n/a)451.90 (n/a)519.30 (n/a)253.10 (n/a)162.42 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (+4.61%)0.03 (+16.10%)0.03 (+56.45%)0.02 (+28.48%)0.01 (-32.79%)453.50 (-22.16%)340.30 (-20.05%)316.30 (-36.08%)248.00 (-4.39%)79.77 (-46.93%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)582.60 (n/a)425.66 (n/a)494.80 (n/a)259.40 (n/a)150.31 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (-6.39%)0.03 (-3.70%)0.02 (-21.35%)0.02 (+5.59%)0.01 (-10.38%)460.40 (-5.31%)352.84 (+1.63%)386.50 (+27.14%)232.90 (+6.83%)101.97 (-15.18%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)486.20 (n/a)347.18 (n/a)304.00 (n/a)218.00 (n/a)120.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (+17.02%)0.03 (+44.11%)0.03 (+67.70%)0.02 (+16.02%)0.01 (+9.82%)423.20 (-13.81%)285.94 (-30.74%)263.00 (-40.38%)225.80 (-14.53%)78.77 (-12.49%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)491.00 (n/a)412.84 (n/a)441.10 (n/a)264.20 (n/a)90.01 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-36.28%)0.03 (+4.88%)0.02 (+39.18%)0.02 (+20.03%)0.01 (-60.45%)458.50 (-16.70%)336.78 (-19.05%)330.00 (-28.17%)241.00 (+57.00%)86.37 (-44.33%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)550.40 (n/a)416.02 (n/a)459.40 (n/a)153.50 (n/a)155.14 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (+93.52%)0.02 (+32.83%)0.02 (+43.95%)0.00 (-76.28%)0.01 (+619.63%)2475.10 (+321.58%)749.36 (+52.86%)328.70 (-30.52%)232.60 (-48.32%)967.67 (+1634.99%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)587.10 (n/a)490.24 (n/a)473.10 (n/a)450.10 (n/a)55.77 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (+0.55%)0.02 (+37.74%)0.03 (+57.66%)0.01 (+234.06%)0.01 (-19.11%)604.40 (-70.06%)392.20 (-48.41%)321.60 (-36.58%)248.70 (-0.56%)154.51 (-78.34%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)2018.90 (n/a)760.24 (n/a)507.10 (n/a)250.10 (n/a)713.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (+26.93%)0.02 (+11.31%)0.02 (+8.76%)0.01 (+2.62%)0.01 (+50.59%)609.30 (-2.54%)481.28 (-6.20%)493.30 (-8.05%)243.70 (-21.21%)146.73 (+11.94%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)625.20 (n/a)513.10 (n/a)536.50 (n/a)309.30 (n/a)131.08 (n/a)
iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (+11.39%)0.02 (-7.73%)0.02 (-28.54%)0.01 (-12.42%)0.01 (+52.26%)621.70 (+14.18%)406.18 (+19.27%)435.20 (+39.94%)199.50 (-10.22%)176.35 (+45.61%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)544.50 (n/a)340.56 (n/a)311.00 (n/a)222.20 (n/a)121.11 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-25.43%)0.01 (-40.37%)0.01 (-42.33%)0.00 (-78.53%)0.01 (-13.15%)2510.10 (+365.78%)892.46 (+142.37%)584.20 (+73.40%)313.20 (+34.13%)911.21 (+539.36%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)538.90 (n/a)368.22 (n/a)336.90 (n/a)233.50 (n/a)142.52 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-16.55%)0.02 (+2.88%)0.03 (+72.62%)0.02 (+8.97%)0.01 (-31.12%)538.50 (-8.25%)372.58 (-9.82%)290.30 (-42.07%)257.40 (+19.83%)135.59 (-20.97%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)586.90 (n/a)413.14 (n/a)501.10 (n/a)214.80 (n/a)171.55 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-15.42%)0.02 (-43.76%)0.02 (-56.74%)0.01 (-24.23%)0.01 (-4.63%)578.90 (+31.96%)496.10 (+81.68%)541.00 (+131.20%)264.90 (+18.21%)130.59 (+40.52%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)438.70 (n/a)273.06 (n/a)234.00 (n/a)224.10 (n/a)92.93 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-7.75%)0.02 (-13.52%)0.02 (-29.22%)0.01 (-20.53%)0.01 (+17.38%)766.50 (+25.84%)467.54 (+23.90%)440.80 (+41.28%)262.20 (+8.39%)215.42 (+47.04%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)609.10 (n/a)377.36 (n/a)312.00 (n/a)241.90 (n/a)146.51 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-8.80%)0.02 (-4.87%)0.02 (+9.35%)0.00 (-5.91%)0.01 (-12.77%)1941.50 (+6.28%)729.90 (+3.77%)470.10 (-8.56%)284.20 (+9.65%)682.45 (+6.85%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1826.80 (n/a)703.40 (n/a)514.10 (n/a)259.20 (n/a)638.71 (n/a)
iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.09 (-21.69%)0.06 (-26.08%)0.05 (-35.97%)0.04 (-8.56%)0.02 (-22.82%)581.30 (+9.37%)434.36 (+32.90%)459.90 (+56.16%)288.80 (+27.67%)116.18 (-1.52%)
deb6e1e — 2026-09-03 22:38:330.11 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)531.50 (n/a)326.84 (n/a)294.50 (n/a)226.20 (n/a)117.97 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.17 (-5.93%)0.13 (-7.23%)0.14 (-0.38%)0.07 (-19.75%)0.04 (+17.01%)548.10 (+24.62%)340.74 (+11.70%)292.40 (+0.38%)248.00 (+6.30%)123.31 (+52.73%)
deb6e1e — 2026-09-03 22:38:330.18 (n/a)0.14 (n/a)0.14 (n/a)0.09 (n/a)0.03 (n/a)439.80 (n/a)305.04 (n/a)291.30 (n/a)233.30 (n/a)80.73 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-3.56%)0.01 (+12.47%)0.01 (+23.48%)0.01 (-21.37%)0.01 (+11.91%)737.40 (+27.18%)413.76 (-5.78%)368.80 (-19.02%)238.60 (+3.69%)204.09 (+42.08%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)579.80 (n/a)439.12 (n/a)455.40 (n/a)230.10 (n/a)143.64 (n/a)
iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-10.63%)0.02 (-21.40%)0.02 (-42.94%)0.02 (-3.12%)0.01 (-18.47%)494.50 (+3.21%)406.86 (+24.83%)475.00 (+75.28%)249.70 (+11.87%)110.18 (-3.55%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)479.10 (n/a)325.92 (n/a)271.00 (n/a)223.20 (n/a)114.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (+1.97%)0.03 (-18.82%)0.03 (-39.03%)0.02 (-15.85%)0.01 (+5.72%)655.90 (+18.84%)465.74 (+25.43%)488.20 (+64.05%)270.30 (-1.92%)146.94 (+21.98%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)551.90 (n/a)371.30 (n/a)297.60 (n/a)275.60 (n/a)120.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (+33.97%)0.02 (+22.51%)0.02 (-3.37%)0.02 (+7.39%)0.01 (+83.34%)541.20 (-6.88%)387.00 (-11.90%)443.30 (+3.48%)209.70 (-25.35%)142.88 (+31.36%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)581.20 (n/a)439.26 (n/a)428.40 (n/a)280.90 (n/a)108.78 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (-16.62%)0.03 (-8.22%)0.03 (+25.59%)0.00 (-64.36%)0.02 (-12.61%)2110.70 (+180.60%)702.00 (+51.08%)391.90 (-20.38%)225.20 (+19.91%)793.52 (+234.49%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)752.20 (n/a)464.64 (n/a)492.20 (n/a)187.80 (n/a)237.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (+44.72%)0.03 (+47.28%)0.03 (+64.70%)0.02 (+21.87%)0.01 (+81.52%)463.30 (-17.94%)334.94 (-29.74%)299.10 (-39.28%)226.50 (-30.88%)100.53 (+8.25%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)564.60 (n/a)476.72 (n/a)492.60 (n/a)327.70 (n/a)92.86 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (-2.83%)0.03 (-15.96%)0.02 (-38.31%)0.02 (+8.98%)0.01 (-16.51%)559.30 (-8.24%)435.50 (+11.43%)453.40 (+62.10%)229.40 (+2.92%)127.99 (-29.56%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)609.50 (n/a)390.82 (n/a)279.70 (n/a)222.90 (n/a)181.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-57.93%)0.02 (-40.24%)0.02 (-35.47%)0.01 (-15.59%)0.00 (-80.38%)592.70 (+18.47%)454.74 (+42.84%)430.90 (+55.00%)388.00 (+137.75%)80.74 (-45.15%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)500.30 (n/a)318.36 (n/a)278.00 (n/a)163.20 (n/a)147.20 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (-49.98%)0.01 (-34.86%)0.02 (-19.01%)0.01 (-11.69%)0.01 (-51.77%)1173.90 (+13.25%)755.08 (+41.34%)576.10 (+23.47%)486.20 (+99.92%)314.20 (+5.89%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1036.60 (n/a)534.22 (n/a)466.60 (n/a)243.20 (n/a)296.73 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.05 (-8.82%)0.02 (-23.91%)0.02 (-38.58%)0.01 (-16.13%)0.01 (-2.84%)671.60 (+19.23%)431.48 (+33.35%)423.00 (+62.82%)181.80 (+9.72%)174.88 (+13.53%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)563.30 (n/a)323.58 (n/a)259.80 (n/a)165.70 (n/a)154.03 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.03 (-36.92%)0.02 (+2.49%)0.02 (+21.42%)0.01 (+150.02%)0.00 (-66.33%)659.90 (-60.00%)474.34 (-31.76%)438.60 (-17.65%)354.60 (+58.52%)114.87 (-79.17%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1649.90 (n/a)695.12 (n/a)532.60 (n/a)223.70 (n/a)551.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.04 (+44.27%)0.02 (+11.68%)0.02 (-1.97%)0.01 (+11.48%)0.01 (+104.79%)568.10 (-10.30%)453.66 (-4.29%)485.40 (+2.00%)224.00 (-30.69%)133.97 (+21.74%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)633.30 (n/a)474.00 (n/a)475.90 (n/a)323.20 (n/a)110.04 (n/a)
iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.40 (+14.15%)0.30 (+4.06%)0.33 (-2.06%)0.20 (+4.12%)0.08 (+10.08%)504.10 (-3.96%)348.56 (-3.50%)297.60 (+2.09%)246.80 (-12.42%)107.21 (-2.42%)
deb6e1e — 2026-09-03 22:38:330.35 (n/a)0.29 (n/a)0.34 (n/a)0.19 (n/a)0.08 (n/a)524.90 (n/a)361.20 (n/a)291.50 (n/a)281.80 (n/a)109.88 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.37 (+23.58%)0.26 (+19.31%)0.22 (+8.68%)0.17 (-7.39%)0.09 (+98.21%)579.90 (+7.99%)417.94 (-10.18%)445.20 (-8.00%)267.40 (-19.09%)141.34 (+64.91%)
deb6e1e — 2026-09-03 22:38:330.30 (n/a)0.22 (n/a)0.20 (n/a)0.18 (n/a)0.05 (n/a)537.00 (n/a)465.30 (n/a)483.90 (n/a)330.50 (n/a)85.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.47 (+31.74%)0.24 (+13.56%)0.19 (-4.32%)0.16 (+295.62%)0.13 (+13.18%)612.40 (-74.72%)480.00 (-41.13%)522.10 (+4.52%)208.40 (-24.08%)158.55 (-82.45%)
deb6e1e — 2026-09-03 22:38:330.36 (n/a)0.21 (n/a)0.20 (n/a)0.04 (n/a)0.12 (n/a)2422.70 (n/a)815.30 (n/a)499.50 (n/a)274.50 (n/a)903.57 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.31 (+5.27%)0.19 (-14.22%)0.18 (-23.71%)0.13 (-12.19%)0.07 (+12.28%)574.00 (+13.87%)419.50 (+18.64%)399.50 (+31.07%)237.90 (-4.99%)124.94 (+15.34%)
deb6e1e — 2026-09-03 22:38:330.29 (n/a)0.22 (n/a)0.24 (n/a)0.15 (n/a)0.06 (n/a)504.10 (n/a)353.58 (n/a)304.80 (n/a)250.40 (n/a)108.32 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.25 (-27.27%)0.20 (-9.18%)0.21 (+39.53%)0.15 (+19.05%)0.04 (-59.64%)502.40 (-16.00%)390.36 (-5.50%)349.80 (-28.33%)290.50 (+37.48%)91.06 (-49.89%)
deb6e1e — 2026-09-03 22:38:330.35 (n/a)0.22 (n/a)0.15 (n/a)0.12 (n/a)0.11 (n/a)598.10 (n/a)413.10 (n/a)488.10 (n/a)211.30 (n/a)181.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.30 (+6.49%)0.20 (+43.58%)0.16 (+28.92%)0.12 (+70.85%)0.08 (-1.94%)611.30 (-41.47%)409.38 (-36.16%)446.90 (-22.43%)243.50 (-6.09%)155.40 (-46.58%)
deb6e1e — 2026-09-03 22:38:330.28 (n/a)0.14 (n/a)0.13 (n/a)0.07 (n/a)0.08 (n/a)1044.50 (n/a)641.28 (n/a)576.10 (n/a)259.30 (n/a)290.93 (n/a)
iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.42 (-13.28%)0.35 (+1.43%)0.38 (+32.80%)0.23 (+8.00%)0.09 (-32.70%)573.70 (-7.41%)402.94 (-7.08%)342.10 (-24.70%)308.50 (+15.28%)118.98 (-26.00%)
deb6e1e — 2026-09-03 22:38:330.49 (n/a)0.34 (n/a)0.29 (n/a)0.21 (n/a)0.13 (n/a)619.60 (n/a)433.62 (n/a)454.30 (n/a)267.60 (n/a)160.77 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.48 (+0.98%)0.26 (-24.52%)0.20 (-41.79%)0.17 (-21.87%)0.13 (+27.24%)791.50 (+27.99%)596.42 (+43.10%)651.40 (+71.83%)273.80 (-0.98%)220.71 (+62.30%)
deb6e1e — 2026-09-03 22:38:330.47 (n/a)0.34 (n/a)0.35 (n/a)0.21 (n/a)0.10 (n/a)618.40 (n/a)416.80 (n/a)379.10 (n/a)276.50 (n/a)135.99 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.47 (-15.45%)0.31 (-20.14%)0.24 (-37.37%)0.22 (-13.44%)0.11 (+4.67%)583.50 (+15.52%)462.86 (+29.54%)556.50 (+59.68%)280.70 (+18.24%)144.66 (+47.25%)
deb6e1e — 2026-09-03 22:38:330.55 (n/a)0.39 (n/a)0.38 (n/a)0.26 (n/a)0.11 (n/a)505.10 (n/a)357.32 (n/a)348.50 (n/a)237.40 (n/a)98.24 (n/a)
iron/operators/strided_copy

test_strided_copy[chunked_transfer]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+31.13%)0.01 (+3.00%)0.01 (-7.31%)0.01 (-19.10%)0.01 (+78.69%)605.50 (+23.60%)403.90 (+6.93%)406.60 (+7.88%)194.70 (-23.74%)159.90 (+63.15%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)489.90 (n/a)377.72 (n/a)376.90 (n/a)255.30 (n/a)98.01 (n/a)

test_strided_copy[contiguous]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+11.77%)0.01 (+34.92%)0.01 (+65.05%)0.01 (+6.89%)0.00 (+33.70%)524.50 (-6.44%)356.78 (-23.66%)293.80 (-39.41%)255.20 (-10.52%)123.97 (+13.07%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)560.60 (n/a)467.36 (n/a)484.90 (n/a)285.20 (n/a)109.64 (n/a)

test_strided_copy[four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+18.79%)0.01 (+4.82%)0.01 (-21.25%)0.01 (+5.52%)0.01 (+35.07%)524.70 (-5.24%)396.34 (-1.12%)464.40 (+26.99%)211.40 (-15.81%)138.01 (+5.50%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)553.70 (n/a)400.84 (n/a)365.70 (n/a)251.10 (n/a)130.81 (n/a)

test_strided_copy[kv_slot0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.67 (+8.84%)0.44 (-12.09%)0.49 (-1.03%)0.22 (-30.49%)0.18 (+57.66%)601.00 (+43.85%)353.94 (+26.06%)269.00 (+1.05%)196.80 (-8.12%)163.37 (+104.78%)
deb6e1e — 2026-09-03 22:38:330.62 (n/a)0.50 (n/a)0.50 (n/a)0.32 (n/a)0.11 (n/a)417.80 (n/a)280.78 (n/a)266.20 (n/a)214.20 (n/a)79.78 (n/a)

test_strided_copy[kv_slot5]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.60 (+15.00%)0.48 (+27.32%)0.49 (+67.03%)0.27 (+3.06%)0.13 (+2.13%)490.70 (-2.99%)300.56 (-21.81%)268.50 (-40.12%)221.70 (-13.06%)109.35 (-6.10%)
deb6e1e — 2026-09-03 22:38:330.52 (n/a)0.37 (n/a)0.29 (n/a)0.26 (n/a)0.12 (n/a)505.80 (n/a)384.38 (n/a)448.40 (n/a)255.00 (n/a)116.45 (n/a)

test_strided_copy[kv_slot5_four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.53 (-6.96%)0.40 (-12.27%)0.47 (-2.57%)0.26 (-7.21%)0.12 (+12.81%)515.90 (+7.77%)358.28 (+16.88%)281.60 (+2.62%)249.40 (+7.45%)122.65 (+24.93%)
deb6e1e — 2026-09-03 22:38:330.57 (n/a)0.46 (n/a)0.48 (n/a)0.28 (n/a)0.11 (n/a)478.70 (n/a)306.54 (n/a)274.40 (n/a)232.10 (n/a)98.18 (n/a)

test_strided_copy[kv_slot5_two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.67 (+46.68%)0.43 (+8.84%)0.46 (+7.83%)0.25 (-20.33%)0.16 (+160.93%)537.30 (+25.51%)345.36 (+1.56%)286.00 (-7.26%)198.20 (-31.84%)136.16 (+130.49%)
deb6e1e — 2026-09-03 22:38:330.45 (n/a)0.40 (n/a)0.43 (n/a)0.31 (n/a)0.06 (n/a)428.10 (n/a)340.06 (n/a)308.40 (n/a)290.80 (n/a)59.07 (n/a)

test_strided_copy[kv_slot_last]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.58 (+4.00%)0.32 (-29.22%)0.26 (-47.14%)0.22 (-13.21%)0.15 (+27.77%)595.70 (+15.22%)462.42 (+47.89%)510.00 (+89.17%)227.50 (-3.85%)149.52 (+29.71%)
deb6e1e — 2026-09-03 22:38:330.56 (n/a)0.46 (n/a)0.49 (n/a)0.26 (n/a)0.12 (n/a)517.00 (n/a)312.68 (n/a)269.60 (n/a)236.60 (n/a)115.27 (n/a)

test_strided_copy[two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+8.55%)0.01 (+9.94%)0.01 (+6.92%)0.01 (-4.74%)0.00 (+27.07%)602.00 (+4.97%)405.24 (-6.02%)369.20 (-6.46%)259.40 (-7.88%)143.43 (+19.94%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)573.50 (n/a)431.22 (n/a)394.70 (n/a)281.60 (n/a)119.59 (n/a)

test_strided_copy[two_channels_chunked]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.02 (+35.60%)0.01 (+13.86%)0.01 (+12.97%)0.01 (-13.98%)0.00 (+117.56%)538.20 (+16.24%)393.78 (-5.50%)384.20 (-11.47%)222.30 (-26.24%)127.02 (+90.89%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)463.00 (n/a)416.70 (n/a)434.00 (n/a)301.40 (n/a)66.54 (n/a)

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]

No metrics available.

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.00 (-28.57%)0.00 (-34.78%)0.00 (-40.00%)0.00 (+0.00%)0.00 (-51.20%)18073.98 (-15.60%)13991.88 (+18.68%)12889.24 (+65.66%)8861.96 (+55.08%)3774.84 (-49.67%)
deb6e1e — 2026-09-03 22:38:330.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)21415.50 (n/a)11789.16 (n/a)7780.39 (n/a)5714.62 (n/a)7500.24 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.00 (-23.08%)0.00 (-27.50%)0.00 (-16.67%)0.00 (-20.00%)0.00 (-36.19%)19741.69 (+11.02%)14993.90 (+19.11%)16010.45 (+7.56%)7885.12 (+29.75%)4349.01 (-19.74%)
deb6e1e — 2026-09-03 22:38:330.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)17782.76 (n/a)12587.83 (n/a)14885.21 (n/a)6077.00 (n/a)5418.64 (n/a)
iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:510.14 (+0.49%)0.09 (+3.87%)0.09 (+9.13%)0.07 (-0.70%)0.03 (-0.93%)29627.17 (+0.78%)23774.98 (-3.69%)24361.80 (-8.34%)14543.96 (-0.50%)5930.38 (+2.75%)
deb6e1e — 2026-09-03 22:38:330.14 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.03 (n/a)29397.45 (n/a)24686.08 (n/a)26578.49 (n/a)14617.47 (n/a)5771.46 (n/a)
iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:511.69 (-8.24%)1.11 (-18.22%)0.86 (-48.42%)0.64 (-9.70%)0.47 (-8.54%)820.10 (+10.75%)544.32 (+21.53%)612.40 (+93.92%)309.40 (+8.98%)215.85 (+5.44%)
deb6e1e — 2026-09-03 22:38:331.85 (n/a)1.36 (n/a)1.66 (n/a)0.71 (n/a)0.52 (n/a)740.50 (n/a)447.88 (n/a)315.80 (n/a)283.90 (n/a)204.70 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:512.62 (-14.52%)1.73 (-11.79%)1.58 (+13.52%)1.02 (-25.38%)0.61 (-24.50%)1029.30 (+34.02%)671.80 (+10.92%)663.10 (-11.90%)400.30 (+16.98%)239.24 (+12.32%)
deb6e1e — 2026-09-03 22:38:333.06 (n/a)1.96 (n/a)1.39 (n/a)1.37 (n/a)0.81 (n/a)768.00 (n/a)605.68 (n/a)752.70 (n/a)342.20 (n/a)213.00 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.58 (-2.67%)1.21 (+5.65%)1.29 (+41.89%)0.66 (-20.05%)0.38 (-2.53%)792.90 (+25.08%)479.12 (-3.80%)406.80 (-29.52%)331.10 (+2.76%)189.18 (+26.62%)
4bb8427 — 2026-06-23 22:46:491.63 (n/a)1.14 (n/a)0.91 (n/a)0.83 (n/a)0.38 (n/a)633.90 (n/a)498.02 (n/a)577.20 (n/a)322.20 (n/a)149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
aa2656c — 2026-09-08 20:57:511.74 (-11.20%)1.34 (+1.49%)1.59 (+17.39%)0.74 (-8.40%)0.47 (+11.47%)708.00 (+9.18%)441.88 (+2.56%)329.50 (-14.81%)301.60 (+12.62%)185.03 (+30.46%)
deb6e1e — 2026-09-03 22:38:331.96 (n/a)1.32 (n/a)1.36 (n/a)0.81 (n/a)0.42 (n/a)648.50 (n/a)430.84 (n/a)386.80 (n/a)267.80 (n/a)141.82 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.75 (-15.44%)1.32 (-0.50%)1.36 (+22.47%)0.77 (-19.20%)0.36 (-21.75%)678.10 (+23.76%)430.02 (-0.09%)385.10 (-18.34%)300.10 (+18.29%)146.96 (+19.46%)
4bb8427 — 2026-06-23 22:46:492.07 (n/a)1.32 (n/a)1.11 (n/a)0.96 (n/a)0.46 (n/a)547.90 (n/a)430.40 (n/a)471.60 (n/a)253.70 (n/a)123.02 (n/a)
Phoenix - Examples

IRON

Tested on 2026_09_08_20_56_00 at commit aa2656c.

Trends:

IRON Trends

@andrej

andrej commented Sep 8, 2026

Copy link
Copy Markdown
Collaborator

Sorry, bad communication on my part, I already have #178 open that picks up the changes from upstream.

@andrej andrej closed this Sep 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andrej andrej andrej requested changes
@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner
@hunhoffe hunhoffe Awaiting requested review from hunhoffe hunhoffe is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@asyms @andrej