Skip to content

Enable trace in OperatorSequence - #178

Merged
andrej merged 12 commits into
amd:develfrom
andrej:trace-buffer-from-compiler
Sep 9, 2026
Merged

Enable trace in OperatorSequence#178
andrej merged 12 commits into
amd:develfrom
andrej:trace-buffer-from-compiler

Conversation

@andrej

@andrej andrej commented Aug 31, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Requires upstream MLIR-AIE PR Xilinx/mlir-aie#3652

Supersedes #154

asyms and others added 9 commits August 26, 2026 09:52
@asyms
require the stream-dse release that generates mlir-aie 1.4.0 buffer d…
1478cbe 
…escriptors
@asyms
carry a hardware trace buffer through the fused sequence
aaa07b9
@asyms
patch the trace buffer address against the dispatched kernel
979f9b4 
Trace lowering records the buffer's index in the sequence it configures, but that
index is resolved against the kernel the host dispatches, which for a fused build
is the wrapper rather than the operator. The address was patched from an argument
the wrapper did not have, so the trace DMA wrote nowhere and the buffer came back
empty. Give the wrapper the buffer at the same index.
@asyms
give every traced operator its own trace buffer slot
fc25b47
@asyms
key the fused sequence artifacts on the trace size
dac0b4c 
Tracing adds a runtime-sequence argument, so a traced ELF cannot be reused by an
untraced run or the other way round: the two now get different artifact names and
toggling the flag no longer needs the build directory wiped.
@asyms
separate out tracing_utils.py and call in swiglu_prefill_stream/test.py
18b17d3
@andrej
Let the compiler place the trace buffer for a fused sequence
19b8f78 
mlir-aie appends a single trace buffer to the dispatched runtime sequence and
hands each configured design a slice of it. The fused sequence no longer has to
place one buffer per operator at the index that operator patches against.

Drop trace_argument_layout. The three consolidated buffers keep indices 0-2 and
the trace buffer lands after them, so operators taking the same number of
arguments no longer contend for one slot.

Size the host buffer from aie.trace_slices in the lowered module. trace_size is
per design and says nothing about how many channels or sub-designs claim a
share. Bind the buffer at index 3 and sync it back with the outputs.

Ask aiecc for --get-input-with-addresses on a traced build and read the lowered
module from that path, rather than picking the work-dir file with the most
write32 ops.

Split the buffer by recorded slice when dumping traces, and parse each slice
against the device that wrote it: sub-designs routinely occupy the same tiles,
and a merged parse cannot tell their events apart.
@andrej
Simplify the trace comments and docstrings
c30c332 
Rewrite in the plain style: active voice, one idea per sentence, and no
attribution of understanding to the parser.

Match the module docstring of tracing_utils to a single trace buffer. It
described one buffer per operator, which the compiler no longer produces.
@andrej
Import the trace helpers at module scope
b1a618f 
Both files already load the aie bindings at import time, so a deferred import
saves nothing.
@andrej andrej mentioned this pull request Sep 8, 2026
Closed
@andrej
Split the trace buffer with mlir-aie's own parser
bf45f8f 
mlir-aie 1.4.3.dev55 carries the trace slice API this branch needs, so raise the
pin to a nightly that has it. Below that pin the module-scope import of
get_trace_slices fails, and every operator import fails with it.

parse_trace_slices splits a fused trace buffer by the recorded layout and decodes
each region against the device that wrote it, which is what dump_traces did by
hand. Call it instead. The layout helper then only serves the buffer size, so
return that and drop the slice list from the sequence callable.

Write the raw words once per dump rather than once per slice, since the parser
takes the whole buffer.
@github-actions

github-actions Bot commented Sep 8, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

CI Test Results

d908422 (2026_09_08_23_07_48)

IRON - CI Summary

Small

iron/operators/axpy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0] - - ✅ 352.02
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0] - - ✅ 417.98
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0] - - ✅ 522.06
iron/operators/dequant
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32] - - ✅ 426.40
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32] - - ✅ 396.60
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32] - - ✅ 297.84
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32] - - ✅ 356.92
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32] - - ✅ 367.54
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32] - - ✅ 371.84
iron/operators/elementwise_add
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 518.40
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 817.90
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 483.56
iron/operators/elementwise_mul
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 413.84
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 571.04
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 414.46
iron/operators/gelu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 498.12
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 294.54
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 414.02
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 500.18
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 426.38
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 613.78
iron/operators/gemm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 502.22
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 495.62
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 82495.18
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 25305.84
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1] - - ✅ 3288.38
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4] - - ✅ 5834.72
iron/operators/gemv
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ✅ 0.07
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ✅ 3.71
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024] - - ✅ 6.40
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512] - - ✅ 11.52
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ✅ 3.61
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024] - - ✅ 6.19
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024] - - ✅ 10.97
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2] - - ✅ 1.87
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2] - - ✅ 0.30
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4] - - ✅ 0.43
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8] - - ✅ 1.48
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ❌ -
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ❌ -
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ❌ -
iron/operators/layer_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 358.64
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 427.58
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 385.08
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 392.60
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 380.36
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 480.80
iron/operators/leaky_relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01] - - ✅ 358.50
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1] - - ✅ 332.04
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25] - - ✅ 275.50
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01] - - ✅ 388.56
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01] - - ✅ 637.34
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01] - - ✅ 429.92
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01] - - ✅ 434.56
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01] - - ✅ 430.56
iron/operators/mem_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048] - - ✅ 458.16
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024] - - ✅ 396.64
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024] - - ✅ 434.18
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512] - - ✅ 495.32
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512] - - ✅ 425.84
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256] - - ✅ 383.82
iron/operators/relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 329.10
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 343.62
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 385.38
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 368.14
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 488.98
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 385.90
iron/operators/repeat
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word] - - ✅ -
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None] - - ✅ 864.26
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64] - - ✅ 439.90
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None] - - ✅ 382.06
iron/operators/rms_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False] - - ✅ 343.86
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True] - - ✅ 409.32
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False] - - ✅ 395.14
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True] - - ✅ 467.42
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False] - - ✅ 362.08
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True] - - ✅ 438.04
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False] - - ✅ 478.84
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True] - - ✅ 464.98
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False] - - ✅ 744.28
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True] - - ✅ 366.82
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False] - - ✅ 417.64
iron/operators/rope
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0] - - ✅ 433.58
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0] - - ✅ 454.48
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0] - - ✅ 381.80
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0] - - ✅ 374.54
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0] - - ✅ 422.48
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0] - - ✅ 489.06
iron/operators/sigmoid
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 371.48
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 353.22
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 393.18
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 414.24
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 552.02
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 435.36
iron/operators/silu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 236.86
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 326.22
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 400.56
iron/operators/softmax
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024] - - ✅ 461.10
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048] - - ✅ 1209.48
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 419.36
iron/operators/strided_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_strided_copy[chunked_transfer] - - ✅ 284.88
test_strided_copy[contiguous] - - ✅ 310.06
test_strided_copy[four_channels] - - ✅ 694.80
test_strided_copy[kv_slot0] - - ✅ 457.86
test_strided_copy[kv_slot5] - - ✅ 328.24
test_strided_copy[kv_slot5_four_channels] - - ✅ 676.20
test_strided_copy[kv_slot5_two_channels] - - ✅ 351.74
test_strided_copy[kv_slot_last] - - ✅ 366.74
test_strided_copy[two_channels] - - ✅ 326.82
test_strided_copy[two_channels_chunked] - - ✅ 383.74
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4] - - ✅ -
iron/operators/swiglu_decode
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584] - - ✅ 16111.98
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048] - - ✅ 18907.28
iron/operators/swiglu_prefill
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False] - - ✅ 22328.21
iron/operators/tanh
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 422.36
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 269.50
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 390.16
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 458.70
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 478.04
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 433.44
iron/operators/transpose
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1] - - ✅ 523.42
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2] - - ✅ 579.82
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1] - - ✅ 448.34
Phoenix - Small

IRON

Tested on 2026_09_08_23_07_48 at commit d908422.

iron/operators/axpy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]✅ 5/5352.020.04n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]✅ 5/5417.980.03n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]✅ 5/5522.060.03n/a
iron/operators/dequant
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]✅ 5/5426.400.01n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]✅ 5/5396.600.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]✅ 5/5297.840.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]✅ 5/5356.920.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]✅ 5/5367.540.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]✅ 5/5371.840.02n/a
iron/operators/elementwise_add
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5518.400.03n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5817.900.02n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5483.560.03n/a
iron/operators/elementwise_mul
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5413.840.04n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5571.040.03n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5414.460.03n/a
iron/operators/gelu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5498.120.02n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5294.540.03n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5414.020.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5500.180.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5426.380.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5613.780.02n/a
iron/operators/gemm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5502.220.4720.04
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5495.620.4920.83
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/582495.180.31208.27
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/525305.841.00679.35
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]✅ 5/53288.382.96775.13
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]✅ 5/55834.720.2111.51
iron/operators/gemv
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]✅ 5/5n/a0.070.07
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]✅ 5/5n/a3.713.70
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]✅ 5/5n/a6.406.40
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]✅ 5/5n/a11.5211.51
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a3.613.60
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a6.196.18
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a10.9710.96
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]✅ 5/5n/a1.871.86
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]✅ 5/5n/a0.300.29
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]✅ 5/5n/a0.430.42
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]✅ 5/5n/a1.481.46
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]❌ 0/5n/an/an/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]❌ 0/5n/an/an/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]❌ 0/5n/an/an/a
iron/operators/layer_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5358.640.02n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5427.580.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5385.080.03n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5392.600.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5380.360.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5480.800.02n/a
iron/operators/leaky_relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]✅ 5/5358.500.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]✅ 5/5332.040.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]✅ 5/5275.500.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]✅ 5/5388.560.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]✅ 5/5637.340.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]✅ 5/5429.920.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]✅ 5/5434.560.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]✅ 5/5430.560.02n/a
iron/operators/mem_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]✅ 5/5458.160.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]✅ 5/5396.640.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]✅ 5/5434.180.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]✅ 5/5495.320.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]✅ 5/5425.840.02n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]✅ 5/5383.820.02n/a
iron/operators/relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5329.100.03n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5343.620.03n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5385.380.02n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5368.140.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5488.980.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5385.900.02n/a
iron/operators/repeat
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]✅ 5/5n/an/an/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]✅ 5/5864.260.04n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]✅ 5/5439.900.10n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]✅ 5/5382.060.02n/a
iron/operators/rms_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]✅ 5/5343.860.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]✅ 5/5409.320.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]✅ 5/5395.140.02n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]✅ 5/5467.420.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]✅ 5/5362.080.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]✅ 5/5438.040.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]✅ 5/5478.840.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]✅ 5/5464.980.03n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]✅ 5/5744.280.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]✅ 5/5366.820.03n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]✅ 5/5417.640.02n/a
iron/operators/rope
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]✅ 5/5433.580.23n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]✅ 5/5454.480.23n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]✅ 5/5381.800.27n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]✅ 5/5374.540.21n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]✅ 5/5422.480.20n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]✅ 5/5489.060.16n/a
iron/operators/sigmoid
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5371.480.02n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5353.220.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5393.180.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5414.240.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5552.020.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5435.360.02n/a
iron/operators/silu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5236.860.04n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5326.220.03n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5400.560.03n/a
iron/operators/softmax
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]✅ 5/5461.100.33n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]✅ 5/51209.480.22n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5419.360.33n/a
iron/operators/strided_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_strided_copy[chunked_transfer]✅ 5/5284.880.01n/a
test_strided_copy[contiguous]✅ 5/5310.060.01n/a
test_strided_copy[four_channels]✅ 5/5694.800.01n/a
test_strided_copy[kv_slot0]✅ 5/5457.860.34n/a
test_strided_copy[kv_slot5]✅ 5/5328.240.44n/a
test_strided_copy[kv_slot5_four_channels]✅ 5/5676.200.34n/a
test_strided_copy[kv_slot5_two_channels]✅ 5/5351.740.40n/a
test_strided_copy[kv_slot_last]✅ 5/5366.740.39n/a
test_strided_copy[two_channels]✅ 5/5326.820.01n/a
test_strided_copy[two_channels_chunked]✅ 5/5383.740.01n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]✅ 1/1n/an/an/a
iron/operators/swiglu_decode
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]✅ 5/516111.980.00n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]✅ 5/518907.280.00n/a
iron/operators/swiglu_prefill
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]✅ 5/522328.210.10n/a
iron/operators/tanh
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5422.360.02n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5269.500.03n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5390.160.03n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5458.700.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5478.040.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5433.440.02n/a
iron/operators/transpose
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]✅ 5/5523.421.08n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]✅ 5/5579.821.97n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]✅ 5/5448.341.39n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (+3.10%)0.04 (+8.80%)0.04 (+20.51%)0.03 (+22.32%)0.01 (-26.58%)457.40 (-18.25%)352.02 (-13.31%)350.10 (-17.04%)246.30 (-2.99%)82.98 (-40.80%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)559.50 (n/a)406.08 (n/a)422.00 (n/a)253.90 (n/a)140.18 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (-25.37%)0.03 (-10.81%)0.03 (+21.49%)0.02 (+104.85%)0.01 (-60.00%)512.20 (-51.19%)417.98 (-19.10%)445.80 (-17.69%)269.40 (+34.03%)106.06 (-69.46%)
deb6e1e — 2026-09-03 22:38:330.06 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)1049.40 (n/a)516.68 (n/a)541.60 (n/a)201.00 (n/a)347.21 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (-4.98%)0.03 (-20.73%)0.02 (-31.01%)0.02 (-14.03%)0.01 (-5.53%)682.80 (+16.32%)522.06 (+26.01%)557.60 (+44.94%)267.90 (+5.22%)157.30 (+5.45%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)587.00 (n/a)414.30 (n/a)384.70 (n/a)254.60 (n/a)149.17 (n/a)
iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (-42.55%)0.01 (-44.00%)0.01 (-46.28%)0.01 (-38.19%)0.00 (-42.42%)516.40 (+61.78%)426.40 (+78.14%)452.00 (+86.16%)265.60 (+74.05%)102.55 (+64.80%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)319.20 (n/a)239.36 (n/a)242.80 (n/a)152.60 (n/a)62.22 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (+38.02%)0.02 (-5.32%)0.01 (-41.27%)0.01 (-15.41%)0.01 (+65.51%)580.00 (+18.22%)396.60 (+18.84%)459.30 (+70.24%)150.20 (-27.54%)175.03 (+32.15%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)490.60 (n/a)333.72 (n/a)269.80 (n/a)207.30 (n/a)132.45 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (-1.11%)0.02 (-6.22%)0.02 (-8.49%)0.01 (-16.63%)0.00 (+37.04%)396.90 (+19.95%)297.84 (+8.38%)285.30 (+9.31%)242.50 (+1.13%)60.45 (+67.47%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)330.90 (n/a)274.80 (n/a)261.00 (n/a)239.80 (n/a)36.10 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (-7.48%)0.02 (+33.02%)0.02 (+62.23%)0.01 (+329.29%)0.00 (-58.51%)440.20 (-76.70%)356.92 (-55.40%)348.10 (-38.37%)263.10 (+8.05%)78.31 (-88.56%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.01 (n/a)1889.60 (n/a)800.34 (n/a)564.80 (n/a)243.50 (n/a)684.35 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (+17.45%)0.02 (+9.19%)0.01 (+22.59%)0.01 (+6.91%)0.01 (+6.86%)482.80 (-6.47%)367.54 (-9.50%)394.40 (-18.44%)217.10 (-14.83%)104.47 (-17.32%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)516.20 (n/a)406.14 (n/a)483.60 (n/a)254.90 (n/a)126.36 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (+45.39%)0.02 (+9.67%)0.02 (-2.27%)0.01 (+33.15%)0.01 (+48.84%)530.50 (-24.89%)371.84 (-7.54%)338.30 (+2.33%)168.90 (-31.23%)142.44 (-24.59%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)706.30 (n/a)402.16 (n/a)330.60 (n/a)245.60 (n/a)188.89 (n/a)
iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)971.80 (n/a)518.40 (n/a)462.10 (n/a)236.90 (n/a)274.40 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)2039.10 (n/a)817.90 (n/a)482.70 (n/a)453.10 (n/a)686.92 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)812.60 (n/a)483.56 (n/a)478.80 (n/a)240.20 (n/a)243.25 (n/a)
iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (n/a)0.04 (n/a)0.04 (n/a)0.01 (n/a)0.02 (n/a)902.00 (n/a)413.84 (n/a)284.70 (n/a)239.20 (n/a)280.05 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)1055.40 (n/a)571.04 (n/a)473.40 (n/a)241.40 (n/a)301.87 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)573.10 (n/a)414.46 (n/a)432.50 (n/a)280.60 (n/a)123.47 (n/a)
iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)641.00 (n/a)498.12 (n/a)523.90 (n/a)294.50 (n/a)125.79 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)477.90 (n/a)294.54 (n/a)244.40 (n/a)227.00 (n/a)105.95 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)547.70 (n/a)414.02 (n/a)469.00 (n/a)257.60 (n/a)144.13 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)604.30 (n/a)500.18 (n/a)543.90 (n/a)267.00 (n/a)139.82 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)702.00 (n/a)426.38 (n/a)316.50 (n/a)197.10 (n/a)217.22 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)1117.60 (n/a)613.78 (n/a)551.40 (n/a)332.80 (n/a)296.91 (n/a)
iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.62 (-5.45%)0.47 (+1.29%)0.41 (-3.65%)0.34 (-7.04%)0.14 (+19.19%)644.70 (+7.58%)502.22 (+1.24%)536.80 (+3.79%)354.10 (+5.76%)136.28 (+38.27%)26.65 (-5.45%)20.04 (+1.29%)17.58 (-3.65%)14.64 (-7.04%)5.80 (+19.19%)
deb6e1e — 2026-09-03 22:38:330.66 (n/a)0.46 (n/a)0.43 (n/a)0.37 (n/a)0.11 (n/a)599.30 (n/a)496.08 (n/a)517.20 (n/a)334.80 (n/a)98.56 (n/a)28.19 (n/a)19.79 (n/a)18.25 (n/a)15.75 (n/a)4.86 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.71 (+28.00%)0.49 (+16.27%)0.44 (+5.45%)0.33 (-2.94%)0.17 (+85.00%)675.40 (+3.04%)495.62 (-9.08%)497.20 (-5.17%)310.50 (-21.87%)159.21 (+46.49%)30.39 (+28.00%)20.83 (+16.27%)18.98 (+5.45%)13.97 (-2.94%)7.08 (+85.00%)
deb6e1e — 2026-09-03 22:38:330.56 (n/a)0.42 (n/a)0.42 (n/a)0.34 (n/a)0.09 (n/a)655.50 (n/a)545.14 (n/a)524.30 (n/a)397.40 (n/a)108.69 (n/a)23.74 (n/a)17.91 (n/a)18.00 (n/a)14.40 (n/a)3.83 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.31 (+0.79%)0.31 (+0.58%)0.30 (-0.06%)0.30 (+1.76%)0.00 (-33.83%)82981.70 (-1.73%)82495.18 (-0.59%)82794.00 (+0.06%)81042.10 (-0.78%)816.80 (-35.58%)211.99 (+0.79%)208.27 (+0.58%)207.50 (-0.06%)207.03 (+1.76%)2.09 (-33.83%)
deb6e1e — 2026-09-03 22:38:330.31 (n/a)0.30 (n/a)0.30 (n/a)0.30 (n/a)0.00 (n/a)84441.40 (n/a)82982.52 (n/a)82742.70 (n/a)81682.30 (n/a)1268.00 (n/a)210.33 (n/a)207.07 (n/a)207.63 (n/a)203.45 (n/a)3.16 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:331.03 (+0.18%)1.00 (-1.76%)1.00 (-1.31%)0.95 (-4.53%)0.03 (+178.85%)26449.60 (+4.75%)25305.84 (+1.85%)25129.70 (+1.33%)24500.70 (-0.18%)744.15 (+191.83%)701.20 (+0.18%)679.35 (-1.76%)683.65 (-1.31%)649.53 (-4.53%)19.67 (+178.84%)
deb6e1e — 2026-09-03 22:38:331.03 (n/a)1.01 (n/a)1.01 (n/a)1.00 (n/a)0.01 (n/a)25251.20 (n/a)24846.02 (n/a)24799.50 (n/a)24544.40 (n/a)255.00 (n/a)699.95 (n/a)691.51 (n/a)692.75 (n/a)680.36 (n/a)7.06 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:334.10 (+12.05%)2.96 (+4.52%)3.42 (+16.90%)1.38 (-29.24%)1.25 (+48.09%)5828.50 (+41.33%)3288.38 (+6.85%)2357.70 (-14.46%)1966.30 (-10.76%)1705.36 (+77.27%)1075.08 (+12.05%)775.13 (+4.52%)896.61 (+16.90%)362.69 (-29.24%)326.55 (+48.09%)
deb6e1e — 2026-09-03 22:38:333.66 (n/a)2.83 (n/a)2.92 (n/a)1.95 (n/a)0.84 (n/a)4124.00 (n/a)3077.52 (n/a)2756.20 (n/a)2203.30 (n/a)962.01 (n/a)959.42 (n/a)741.61 (n/a)766.98 (n/a)512.59 (n/a)220.50 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.22 (-8.89%)0.21 (+3.37%)0.21 (+1.60%)0.21 (+16.48%)0.01 (-80.89%)6008.70 (-14.15%)5834.72 (-4.46%)5832.30 (-1.58%)5637.00 (+9.76%)136.59 (-82.26%)11.91 (-8.89%)11.51 (+3.37%)11.51 (+1.60%)11.17 (+16.48%)0.27 (-80.89%)
deb6e1e — 2026-09-03 22:38:330.24 (n/a)0.21 (n/a)0.21 (n/a)0.18 (n/a)0.03 (n/a)6999.10 (n/a)6106.98 (n/a)5925.70 (n/a)5135.70 (n/a)770.08 (n/a)13.07 (n/a)11.13 (n/a)11.33 (n/a)9.59 (n/a)1.42 (n/a)
iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.11 (n/a)0.07 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.11 (n/a)0.07 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:333.95 (n/a)3.71 (n/a)3.74 (n/a)3.40 (n/a)0.20 (n/a)3.94 (n/a)3.70 (n/a)3.74 (n/a)3.40 (n/a)0.20 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:337.40 (-0.09%)6.40 (-0.68%)6.35 (-5.16%)5.54 (-2.10%)0.82 (+7.52%)7.40 (-0.09%)6.40 (-0.68%)6.35 (-5.16%)5.54 (-2.10%)0.82 (+7.52%)
deb6e1e — 2026-09-03 22:38:337.41 (n/a)6.45 (n/a)6.69 (n/a)5.66 (n/a)0.76 (n/a)7.40 (n/a)6.44 (n/a)6.69 (n/a)5.66 (n/a)0.76 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:3313.53 (+33.31%)11.52 (+31.47%)12.95 (+52.39%)6.96 (-15.16%)2.77 (+253.42%)13.52 (+33.31%)11.51 (+31.47%)12.94 (+52.39%)6.96 (-15.16%)2.77 (+253.42%)
deb6e1e — 2026-09-03 22:38:3310.15 (n/a)8.76 (n/a)8.50 (n/a)8.20 (n/a)0.78 (n/a)10.14 (n/a)8.75 (n/a)8.49 (n/a)8.20 (n/a)0.78 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:333.78 (n/a)3.61 (n/a)3.61 (n/a)3.42 (n/a)0.13 (n/a)3.77 (n/a)3.60 (n/a)3.61 (n/a)3.42 (n/a)0.13 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:337.51 (+0.29%)6.19 (-6.56%)5.73 (-12.08%)5.06 (-12.32%)1.03 (+56.52%)7.51 (+0.29%)6.18 (-6.56%)5.73 (-12.08%)5.06 (-12.32%)1.03 (+56.52%)
deb6e1e — 2026-09-03 22:38:337.49 (n/a)6.62 (n/a)6.52 (n/a)5.77 (n/a)0.66 (n/a)7.49 (n/a)6.62 (n/a)6.52 (n/a)5.77 (n/a)0.66 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:3313.68 (-2.64%)10.97 (-12.54%)11.22 (-18.28%)8.06 (+7.43%)2.64 (-6.38%)13.67 (-2.64%)10.96 (-12.54%)11.21 (-18.28%)8.06 (+7.43%)2.64 (-6.38%)
deb6e1e — 2026-09-03 22:38:3314.05 (n/a)12.54 (n/a)13.73 (n/a)7.51 (n/a)2.82 (n/a)14.05 (n/a)12.54 (n/a)13.72 (n/a)7.50 (n/a)2.82 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:332.85 (-9.42%)1.87 (-25.84%)1.65 (-45.63%)1.04 (-4.57%)0.70 (-20.86%)2.85 (-9.42%)1.86 (-25.84%)1.65 (-45.63%)1.04 (-4.57%)0.70 (-20.86%)
deb6e1e — 2026-09-03 22:38:333.15 (n/a)2.52 (n/a)3.04 (n/a)1.09 (n/a)0.89 (n/a)3.14 (n/a)2.51 (n/a)3.03 (n/a)1.09 (n/a)0.89 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.59 (+3.49%)0.30 (-19.91%)0.32 (-7.00%)0.08 (+4.18%)0.20 (+1.28%)0.58 (+3.49%)0.29 (-19.91%)0.32 (-7.00%)0.08 (+4.18%)0.20 (+1.28%)
deb6e1e — 2026-09-03 22:38:330.57 (n/a)0.37 (n/a)0.35 (n/a)0.08 (n/a)0.20 (n/a)0.56 (n/a)0.37 (n/a)0.34 (n/a)0.08 (n/a)0.20 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:330.65 (-10.26%)0.43 (+4.54%)0.46 (-0.63%)0.11 (+40.14%)0.20 (-17.17%)0.64 (-10.26%)0.42 (+4.54%)0.46 (-0.63%)0.11 (+40.14%)0.20 (-17.17%)
deb6e1e — 2026-09-03 22:38:330.73 (n/a)0.41 (n/a)0.46 (n/a)0.08 (n/a)0.24 (n/a)0.72 (n/a)0.41 (n/a)0.46 (n/a)0.08 (n/a)0.24 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
d908422 — 2026-09-08 23:03:331.86 (-24.50%)1.48 (-6.23%)1.69 (-4.79%)0.45 (+2.00%)0.58 (-24.03%)1.83 (-24.50%)1.46 (-6.23%)1.66 (-4.79%)0.44 (+2.00%)0.57 (-24.03%)
deb6e1e — 2026-09-03 22:38:332.47 (n/a)1.58 (n/a)1.78 (n/a)0.44 (n/a)0.76 (n/a)2.43 (n/a)1.55 (n/a)1.75 (n/a)0.43 (n/a)0.75 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)411.70 (n/a)358.64 (n/a)385.90 (n/a)291.60 (n/a)56.12 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)609.60 (n/a)427.58 (n/a)380.40 (n/a)339.40 (n/a)107.21 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)558.80 (n/a)385.08 (n/a)423.90 (n/a)213.80 (n/a)160.89 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)532.10 (n/a)392.60 (n/a)435.50 (n/a)219.50 (n/a)138.54 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)617.70 (n/a)380.36 (n/a)336.40 (n/a)262.20 (n/a)140.72 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)691.00 (n/a)480.80 (n/a)535.30 (n/a)240.50 (n/a)199.74 (n/a)
iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+9.51%)0.03 (+22.25%)0.02 (+57.65%)0.02 (+14.78%)0.01 (-1.50%)516.40 (-12.87%)358.50 (-20.67%)329.40 (-36.57%)231.20 (-8.65%)123.94 (-23.69%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)592.70 (n/a)451.90 (n/a)519.30 (n/a)253.10 (n/a)162.42 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-0.68%)0.03 (+21.57%)0.03 (+67.08%)0.02 (+10.88%)0.01 (-26.57%)525.40 (-9.82%)332.04 (-21.99%)296.20 (-40.14%)261.20 (+0.69%)109.63 (-27.06%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)582.60 (n/a)425.66 (n/a)494.80 (n/a)259.40 (n/a)150.31 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-10.72%)0.03 (+16.23%)0.03 (+12.97%)0.02 (+40.46%)0.00 (-54.95%)346.10 (-28.82%)275.50 (-20.65%)269.10 (-11.48%)244.20 (+12.02%)41.40 (-65.56%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)486.20 (n/a)347.18 (n/a)304.00 (n/a)218.00 (n/a)120.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+27.10%)0.02 (+16.03%)0.02 (+10.44%)0.02 (-9.74%)0.01 (+78.48%)544.00 (+10.79%)388.56 (-5.88%)399.40 (-9.45%)207.90 (-21.31%)148.66 (+65.16%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)491.00 (n/a)412.84 (n/a)441.10 (n/a)264.20 (n/a)90.01 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (-19.20%)0.03 (+13.11%)0.04 (+102.95%)0.00 (-73.47%)0.02 (+1.36%)2074.60 (+276.93%)637.34 (+53.20%)226.30 (-50.74%)190.00 (+23.78%)811.90 (+423.35%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)550.40 (n/a)416.02 (n/a)459.40 (n/a)153.50 (n/a)155.14 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+111.80%)0.02 (+27.94%)0.02 (+7.34%)0.01 (-5.30%)0.01 (+476.13%)620.00 (+5.60%)429.92 (-12.30%)440.80 (-6.83%)212.50 (-52.79%)145.84 (+161.48%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)587.10 (n/a)490.24 (n/a)473.10 (n/a)450.10 (n/a)55.77 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-16.14%)0.02 (+14.90%)0.02 (+11.31%)0.02 (+294.26%)0.00 (-54.77%)512.10 (-74.63%)434.56 (-42.84%)455.60 (-10.16%)298.20 (+19.23%)84.78 (-88.11%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)2018.90 (n/a)760.24 (n/a)507.10 (n/a)250.10 (n/a)713.23 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (+80.23%)0.02 (+33.84%)0.02 (+11.89%)0.01 (+14.07%)0.01 (+151.59%)548.10 (-12.33%)430.56 (-16.09%)479.50 (-10.62%)171.60 (-44.52%)149.77 (+14.26%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)625.20 (n/a)513.10 (n/a)536.50 (n/a)309.30 (n/a)131.08 (n/a)
iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-23.33%)0.02 (-26.85%)0.02 (-36.52%)0.01 (-7.83%)0.01 (-23.80%)590.80 (+8.50%)458.16 (+34.53%)489.90 (+57.52%)289.80 (+30.42%)123.78 (+2.20%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)544.50 (n/a)340.56 (n/a)311.00 (n/a)222.20 (n/a)121.11 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+6.97%)0.02 (-5.10%)0.02 (-23.85%)0.02 (+0.00%)0.01 (+10.54%)538.90 (+0.00%)396.64 (+7.72%)442.40 (+31.31%)218.30 (-6.51%)153.07 (+7.40%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)538.90 (n/a)368.22 (n/a)336.90 (n/a)233.50 (n/a)142.52 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-20.77%)0.02 (-9.94%)0.02 (+27.64%)0.01 (-18.53%)0.01 (-34.31%)720.40 (+22.75%)434.18 (+5.09%)392.60 (-21.65%)271.10 (+26.21%)179.21 (+4.46%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)586.90 (n/a)413.14 (n/a)501.10 (n/a)214.80 (n/a)171.55 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-11.02%)0.02 (-38.47%)0.01 (-57.55%)0.01 (-44.00%)0.01 (+24.42%)783.30 (+78.55%)495.32 (+81.40%)551.20 (+135.56%)251.80 (+12.36%)217.37 (+133.90%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)438.70 (n/a)273.06 (n/a)234.00 (n/a)224.10 (n/a)92.93 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-19.78%)0.02 (-17.51%)0.02 (-28.97%)0.02 (+16.30%)0.00 (-45.67%)523.80 (-14.00%)425.84 (+12.85%)439.20 (+40.77%)301.60 (+24.68%)79.69 (-45.61%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)609.10 (n/a)377.36 (n/a)312.00 (n/a)241.90 (n/a)146.51 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (+44.25%)0.02 (+38.47%)0.02 (+21.52%)0.02 (+247.52%)0.01 (+22.70%)525.70 (-71.22%)383.82 (-45.43%)423.00 (-17.72%)179.70 (-30.67%)136.94 (-78.56%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1826.80 (n/a)703.40 (n/a)514.10 (n/a)259.20 (n/a)638.71 (n/a)
iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (-54.71%)0.04 (-54.00%)0.04 (-52.26%)0.01 (-74.11%)0.02 (-32.97%)2053.20 (+286.30%)864.26 (+164.43%)616.90 (+109.47%)499.40 (+120.78%)667.41 (+465.75%)
deb6e1e — 2026-09-03 22:38:330.11 (n/a)0.08 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)531.50 (n/a)326.84 (n/a)294.50 (n/a)226.20 (n/a)117.97 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.16 (-9.22%)0.10 (-29.38%)0.09 (-38.60%)0.08 (-13.59%)0.03 (+7.13%)509.00 (+15.73%)439.90 (+44.21%)474.40 (+62.86%)257.00 (+10.16%)103.67 (+28.41%)
deb6e1e — 2026-09-03 22:38:330.18 (n/a)0.14 (n/a)0.14 (n/a)0.09 (n/a)0.03 (n/a)439.80 (n/a)305.04 (n/a)291.30 (n/a)233.30 (n/a)80.73 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (-14.79%)0.02 (+17.78%)0.02 (+54.64%)0.01 (-19.90%)0.00 (-10.10%)723.90 (+24.85%)382.06 (-12.99%)294.50 (-35.33%)270.00 (+17.34%)193.77 (+34.90%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)579.80 (n/a)439.12 (n/a)455.40 (n/a)230.10 (n/a)143.64 (n/a)
iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-9.70%)0.03 (-7.48%)0.03 (-13.51%)0.02 (-3.62%)0.01 (-19.51%)497.00 (+3.74%)343.86 (+5.50%)313.30 (+15.61%)247.10 (+10.71%)103.93 (-9.02%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)479.10 (n/a)325.92 (n/a)271.00 (n/a)223.20 (n/a)114.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.05 (+11.61%)0.03 (-7.18%)0.03 (-18.28%)0.02 (-10.40%)0.01 (+15.43%)616.00 (+11.61%)409.32 (+10.24%)364.20 (+22.38%)246.90 (-10.41%)142.86 (+18.59%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.04 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)551.90 (n/a)371.30 (n/a)297.60 (n/a)275.60 (n/a)120.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+22.34%)0.02 (+26.02%)0.03 (+53.97%)0.01 (-11.61%)0.01 (+86.01%)657.60 (+13.15%)395.14 (-10.04%)278.20 (-35.06%)229.60 (-18.26%)196.71 (+80.84%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)581.20 (n/a)439.26 (n/a)428.40 (n/a)280.90 (n/a)108.78 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.06 (+15.89%)0.03 (-2.89%)0.02 (-12.90%)0.02 (+25.32%)0.02 (+14.52%)600.20 (-20.21%)467.42 (+0.60%)565.10 (+14.81%)162.00 (-13.74%)181.64 (-23.43%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)752.20 (n/a)464.64 (n/a)492.20 (n/a)187.80 (n/a)237.23 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (+20.14%)0.02 (+35.65%)0.03 (+51.97%)0.01 (-0.97%)0.01 (+42.82%)570.20 (+0.99%)362.08 (-24.05%)324.10 (-34.21%)272.80 (-16.75%)119.74 (+28.94%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)564.60 (n/a)476.72 (n/a)492.60 (n/a)327.70 (n/a)92.86 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.03 (-40.33%)0.02 (-23.41%)0.02 (-35.13%)0.02 (+21.90%)0.00 (-77.06%)500.00 (-17.97%)438.04 (+12.08%)431.10 (+54.13%)373.60 (+67.61%)54.29 (-70.12%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)609.50 (n/a)390.82 (n/a)279.70 (n/a)222.90 (n/a)181.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (-51.95%)0.02 (-41.03%)0.02 (-35.91%)0.01 (-27.49%)0.00 (-66.91%)690.00 (+37.92%)478.84 (+50.41%)433.80 (+56.04%)339.70 (+108.15%)137.26 (-6.76%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)500.30 (n/a)318.36 (n/a)278.00 (n/a)163.20 (n/a)147.20 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+4.58%)0.03 (+18.22%)0.03 (+45.69%)0.01 (+7.93%)0.01 (+9.75%)960.50 (-7.34%)464.98 (-12.96%)320.30 (-31.35%)232.60 (-4.36%)293.24 (-1.18%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1036.60 (n/a)534.22 (n/a)466.60 (n/a)243.20 (n/a)296.73 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (-18.47%)0.02 (-35.76%)0.02 (-44.89%)0.00 (-72.80%)0.01 (+0.68%)2071.20 (+267.69%)744.28 (+130.01%)471.40 (+81.45%)203.30 (+22.69%)753.96 (+389.48%)
deb6e1e — 2026-09-03 22:38:330.05 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)563.30 (n/a)323.58 (n/a)259.80 (n/a)165.70 (n/a)154.03 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+5.57%)0.03 (+54.86%)0.04 (+110.51%)0.01 (+163.18%)0.01 (+2.24%)626.90 (-62.00%)366.82 (-47.23%)253.00 (-52.50%)211.90 (-5.27%)191.10 (-65.35%)
deb6e1e — 2026-09-03 22:38:330.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1649.90 (n/a)695.12 (n/a)532.60 (n/a)223.70 (n/a)551.46 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.04 (+51.72%)0.02 (+28.33%)0.02 (-5.09%)0.01 (+5.98%)0.01 (+147.91%)597.60 (-5.64%)417.64 (-11.89%)501.40 (+5.36%)213.00 (-34.10%)171.05 (+55.44%)
deb6e1e — 2026-09-03 22:38:330.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)633.30 (n/a)474.00 (n/a)475.90 (n/a)323.20 (n/a)110.04 (n/a)
iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.32 (-6.98%)0.23 (-19.33%)0.22 (-33.85%)0.19 (+2.65%)0.05 (-31.03%)511.30 (-2.59%)433.58 (+20.04%)440.70 (+51.18%)302.90 (+7.49%)79.76 (-27.41%)
deb6e1e — 2026-09-03 22:38:330.35 (n/a)0.29 (n/a)0.34 (n/a)0.19 (n/a)0.08 (n/a)524.90 (n/a)361.20 (n/a)291.50 (n/a)281.80 (n/a)109.88 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.33 (+11.95%)0.23 (+5.52%)0.22 (+6.89%)0.15 (-15.62%)0.07 (+39.29%)636.40 (+18.51%)454.48 (-2.33%)452.70 (-6.45%)295.20 (-10.68%)124.64 (+45.43%)
deb6e1e — 2026-09-03 22:38:330.30 (n/a)0.22 (n/a)0.20 (n/a)0.18 (n/a)0.05 (n/a)537.00 (n/a)465.30 (n/a)483.90 (n/a)330.50 (n/a)85.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.36 (-0.62%)0.27 (+29.26%)0.26 (+34.15%)0.19 (+372.43%)0.07 (-39.54%)512.80 (-78.83%)381.80 (-53.17%)372.40 (-25.45%)276.20 (+0.62%)99.72 (-88.96%)
deb6e1e — 2026-09-03 22:38:330.36 (n/a)0.21 (n/a)0.20 (n/a)0.04 (n/a)0.12 (n/a)2422.70 (n/a)815.30 (n/a)499.50 (n/a)274.50 (n/a)903.57 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.29 (-0.66%)0.21 (-6.49%)0.19 (-22.99%)0.15 (+3.65%)0.06 (-5.05%)486.30 (-3.53%)374.54 (+5.93%)395.80 (+29.86%)252.10 (+0.68%)98.09 (-9.44%)
deb6e1e — 2026-09-03 22:38:330.29 (n/a)0.22 (n/a)0.24 (n/a)0.15 (n/a)0.06 (n/a)504.10 (n/a)353.58 (n/a)304.80 (n/a)250.40 (n/a)108.32 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.29 (-16.84%)0.20 (-8.77%)0.15 (+0.15%)0.12 (-2.29%)0.08 (-27.57%)612.10 (+2.34%)422.48 (+2.27%)487.30 (-0.16%)254.00 (+20.21%)157.22 (-13.48%)
deb6e1e — 2026-09-03 22:38:330.35 (n/a)0.22 (n/a)0.15 (n/a)0.12 (n/a)0.11 (n/a)598.10 (n/a)413.10 (n/a)488.10 (n/a)211.30 (n/a)181.71 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.28 (-2.54%)0.16 (+15.82%)0.15 (+15.95%)0.12 (+68.19%)0.06 (-22.89%)621.00 (-40.55%)489.06 (-23.74%)496.90 (-13.75%)266.00 (+2.58%)136.98 (-52.92%)
deb6e1e — 2026-09-03 22:38:330.28 (n/a)0.14 (n/a)0.13 (n/a)0.07 (n/a)0.08 (n/a)1044.50 (n/a)641.28 (n/a)576.10 (n/a)259.30 (n/a)290.93 (n/a)
iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.46 (-6.72%)0.33 (-3.89%)0.38 (+31.05%)0.19 (-12.43%)0.13 (-5.83%)707.50 (+14.19%)461.10 (+6.34%)346.70 (-23.68%)286.80 (+7.17%)202.06 (+25.68%)
deb6e1e — 2026-09-03 22:38:330.49 (n/a)0.34 (n/a)0.29 (n/a)0.21 (n/a)0.13 (n/a)619.60 (n/a)433.62 (n/a)454.30 (n/a)267.60 (n/a)160.77 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.42 (-10.76%)0.22 (-36.02%)0.12 (-63.88%)0.05 (-74.93%)0.19 (+81.87%)2467.00 (+298.93%)1209.48 (+190.18%)1049.70 (+176.89%)309.80 (+12.04%)963.24 (+608.29%)
deb6e1e — 2026-09-03 22:38:330.47 (n/a)0.34 (n/a)0.35 (n/a)0.21 (n/a)0.10 (n/a)618.40 (n/a)416.80 (n/a)379.10 (n/a)276.50 (n/a)135.99 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.45 (-18.99%)0.33 (-14.43%)0.35 (-8.24%)0.24 (-7.66%)0.09 (-14.04%)547.00 (+8.30%)419.36 (+17.36%)379.90 (+9.01%)293.00 (+23.42%)119.37 (+21.51%)
deb6e1e — 2026-09-03 22:38:330.55 (n/a)0.39 (n/a)0.38 (n/a)0.26 (n/a)0.11 (n/a)505.10 (n/a)357.32 (n/a)348.50 (n/a)237.40 (n/a)98.24 (n/a)
iron/operators/strided_copy

test_strided_copy[chunked_transfer]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (-5.09%)0.01 (+25.88%)0.01 (+37.38%)0.01 (+47.85%)0.00 (-62.51%)331.30 (-32.37%)284.88 (-24.58%)274.40 (-27.20%)269.00 (+5.37%)26.16 (-73.31%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)489.90 (n/a)377.72 (n/a)376.90 (n/a)255.30 (n/a)98.01 (n/a)

test_strided_copy[contiguous]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (+18.26%)0.01 (+50.38%)0.02 (+80.05%)0.01 (+21.43%)0.00 (+15.26%)461.70 (-17.64%)310.06 (-33.66%)269.30 (-44.46%)241.20 (-15.43%)91.33 (-16.70%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)560.60 (n/a)467.36 (n/a)484.90 (n/a)285.20 (n/a)109.64 (n/a)

test_strided_copy[four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (+17.21%)0.01 (+1.23%)0.01 (+24.71%)0.00 (-71.93%)0.01 (+93.80%)1972.70 (+256.28%)694.80 (+73.34%)293.30 (-19.80%)214.20 (-14.70%)744.31 (+468.99%)
deb6e1e — 2026-09-03 22:38:330.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)553.70 (n/a)400.84 (n/a)365.70 (n/a)251.10 (n/a)130.81 (n/a)

test_strided_copy[kv_slot0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.54 (-11.91%)0.34 (-32.28%)0.30 (-40.04%)0.20 (-37.14%)0.15 (+31.73%)664.60 (+59.07%)457.86 (+63.07%)444.00 (+66.79%)243.20 (+13.54%)187.58 (+135.12%)
deb6e1e — 2026-09-03 22:38:330.62 (n/a)0.50 (n/a)0.50 (n/a)0.32 (n/a)0.11 (n/a)417.80 (n/a)280.78 (n/a)266.20 (n/a)214.20 (n/a)79.78 (n/a)

test_strided_copy[kv_slot5]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.62 (+20.08%)0.44 (+17.95%)0.45 (+53.68%)0.25 (-5.69%)0.13 (+7.95%)536.20 (+6.01%)328.24 (-14.61%)291.80 (-34.92%)212.40 (-16.71%)122.76 (+5.42%)
deb6e1e — 2026-09-03 22:38:330.52 (n/a)0.37 (n/a)0.29 (n/a)0.26 (n/a)0.12 (n/a)505.80 (n/a)384.38 (n/a)448.40 (n/a)255.00 (n/a)116.45 (n/a)

test_strided_copy[kv_slot5_four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.66 (+16.08%)0.34 (-26.45%)0.35 (-26.51%)0.07 (-74.53%)0.22 (+98.37%)1879.40 (+292.60%)676.20 (+120.59%)373.40 (+36.08%)199.90 (-13.87%)685.45 (+598.18%)
deb6e1e — 2026-09-03 22:38:330.57 (n/a)0.46 (n/a)0.48 (n/a)0.28 (n/a)0.11 (n/a)478.70 (n/a)306.54 (n/a)274.40 (n/a)232.10 (n/a)98.18 (n/a)

test_strided_copy[kv_slot5_two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.50 (+9.06%)0.40 (+0.29%)0.46 (+6.51%)0.28 (-10.03%)0.10 (+61.15%)475.80 (+11.14%)351.74 (+3.43%)289.60 (-6.10%)266.60 (-8.32%)98.68 (+67.06%)
deb6e1e — 2026-09-03 22:38:330.45 (n/a)0.40 (n/a)0.43 (n/a)0.31 (n/a)0.06 (n/a)428.10 (n/a)340.06 (n/a)308.40 (n/a)290.80 (n/a)59.07 (n/a)

test_strided_copy[kv_slot_last]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.58 (+3.42%)0.39 (-15.30%)0.34 (-30.77%)0.27 (+4.58%)0.12 (+4.52%)494.30 (-4.39%)366.74 (+17.29%)389.40 (+44.44%)228.80 (-3.30%)102.21 (-11.33%)
deb6e1e — 2026-09-03 22:38:330.56 (n/a)0.46 (n/a)0.49 (n/a)0.26 (n/a)0.12 (n/a)517.00 (n/a)312.68 (n/a)269.60 (n/a)236.60 (n/a)115.27 (n/a)

test_strided_copy[two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (+15.34%)0.01 (+32.54%)0.02 (+46.48%)0.01 (+13.95%)0.00 (+19.04%)503.30 (-12.24%)326.82 (-24.21%)269.50 (-31.72%)244.20 (-13.28%)106.87 (-10.63%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)573.50 (n/a)431.22 (n/a)394.70 (n/a)281.60 (n/a)119.59 (n/a)

test_strided_copy[two_channels_chunked]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.02 (+25.99%)0.01 (+18.87%)0.01 (+16.87%)0.01 (-14.49%)0.00 (+126.52%)541.40 (+16.93%)383.74 (-7.91%)371.40 (-14.42%)239.20 (-20.64%)141.78 (+113.07%)
deb6e1e — 2026-09-03 22:38:330.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)463.00 (n/a)416.70 (n/a)434.00 (n/a)301.40 (n/a)66.54 (n/a)

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]

No metrics available.

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.00 (+0.00%)0.00 (-34.78%)0.00 (-60.00%)0.00 (+0.00%)0.00 (-10.91%)20595.31 (-3.83%)16111.98 (+36.67%)17791.62 (+128.67%)5542.03 (-3.02%)6115.04 (-18.47%)
deb6e1e — 2026-09-03 22:38:330.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)21415.50 (n/a)11789.16 (n/a)7780.39 (n/a)5714.62 (n/a)7500.24 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.00 (-53.85%)0.00 (-45.00%)0.00 (-33.33%)0.00 (-40.00%)0.00 (-69.53%)24042.10 (+35.20%)18907.28 (+50.20%)19621.12 (+31.82%)14400.29 (+136.96%)3668.14 (-32.31%)
deb6e1e — 2026-09-03 22:38:330.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)17782.76 (n/a)12587.83 (n/a)14885.21 (n/a)6077.00 (n/a)5418.64 (n/a)
iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:330.15 (+6.34%)0.10 (+9.97%)0.09 (+10.77%)0.08 (+8.56%)0.03 (+2.28%)27098.63 (-7.82%)22328.21 (-9.55%)23995.54 (-9.72%)13744.43 (-5.97%)5190.55 (-10.07%)
deb6e1e — 2026-09-03 22:38:330.14 (n/a)0.09 (n/a)0.08 (n/a)0.07 (n/a)0.03 (n/a)29397.45 (n/a)24686.08 (n/a)26578.49 (n/a)14617.47 (n/a)5771.46 (n/a)
iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:331.52 (-17.94%)1.08 (-20.14%)0.95 (-42.71%)0.68 (-3.90%)0.33 (-35.62%)770.60 (+4.06%)523.42 (+16.87%)551.30 (+74.57%)346.00 (+21.87%)166.31 (-18.76%)
deb6e1e — 2026-09-03 22:38:331.85 (n/a)1.36 (n/a)1.66 (n/a)0.71 (n/a)0.52 (n/a)740.50 (n/a)447.88 (n/a)315.80 (n/a)283.90 (n/a)204.70 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:332.55 (-16.64%)1.97 (+0.82%)2.01 (+44.26%)1.12 (-17.61%)0.58 (-28.23%)932.20 (+21.38%)579.82 (-4.27%)521.80 (-30.68%)410.50 (+19.96%)212.33 (-0.32%)
deb6e1e — 2026-09-03 22:38:333.06 (n/a)1.96 (n/a)1.39 (n/a)1.37 (n/a)0.81 (n/a)768.00 (n/a)605.68 (n/a)752.70 (n/a)342.20 (n/a)213.00 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.58 (-2.67%)1.21 (+5.65%)1.29 (+41.89%)0.66 (-20.05%)0.38 (-2.53%)792.90 (+25.08%)479.12 (-3.80%)406.80 (-29.52%)331.10 (+2.76%)189.18 (+26.62%)
4bb8427 — 2026-06-23 22:46:491.63 (n/a)1.14 (n/a)0.91 (n/a)0.83 (n/a)0.38 (n/a)633.90 (n/a)498.02 (n/a)577.20 (n/a)322.20 (n/a)149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
d908422 — 2026-09-08 23:03:331.80 (-8.23%)1.39 (+5.42%)1.76 (+30.21%)0.63 (-21.71%)0.55 (+29.64%)828.40 (+27.74%)448.34 (+4.06%)297.00 (-23.22%)291.80 (+8.96%)236.32 (+66.63%)
deb6e1e — 2026-09-03 22:38:331.96 (n/a)1.32 (n/a)1.36 (n/a)0.81 (n/a)0.42 (n/a)648.50 (n/a)430.84 (n/a)386.80 (n/a)267.80 (n/a)141.82 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.75 (-15.44%)1.32 (-0.50%)1.36 (+22.47%)0.77 (-19.20%)0.36 (-21.75%)678.10 (+23.76%)430.02 (-0.09%)385.10 (-18.34%)300.10 (+18.29%)146.96 (+19.46%)
4bb8427 — 2026-06-23 22:46:492.07 (n/a)1.32 (n/a)1.11 (n/a)0.96 (n/a)0.46 (n/a)547.90 (n/a)430.40 (n/a)471.60 (n/a)253.70 (n/a)123.02 (n/a)
Phoenix - Examples

IRON

Tested on 2026_09_08_23_00_40 at commit d908422.

Trends:

IRON Trends

@andrej
Name trace files by device and sequence, summarize with mlir-aie
d3d93a3 
A device holds several runtime sequences, so the device name alone does not
identify a slice. Append the sequence name to each JSON file name.

mlir-aie's print_cycles_summary already reports kernel invocation counts and
cycle statistics per tile. Call it and delete the local reimplementation, which
was 140 of the module's 339 lines.
@andrej
Skip the stream operator test against the pinned mlir-aie
7e39821 
mlir-aie removed the `!aie.objectfifosubview` type in Xilinx/mlir-aie#3553 on
2026-08-27. stream-dse up to 1.14.1 still emits it, so its generated module does
not parse. The trace slice API this branch requires landed on 2026-09-03, after
that removal, so no wheel satisfies both.

Skip the module until a stream-dse release targets a post-#3553 mlir-aie. This
commit is self-contained: revert it to re-enable the test.
@andrej

andrej commented Sep 8, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator Author

This PR requires Xilinx/mlir-aie#3652 (multi aiex.run-trace-enablement), but that PR landed after Xilinx/mlir-aie#3553 (objectFifo refactor), which is a syntax-breaking change that removes the objectfifo.subview op. Stream still emits objectfifo.subviews, cc @asyms. Stream will therefore need to update and remove the usage of objectfifo.subview. I will temporarily disable Stream testing so we can get this in; opened issue #194 for this. The tracing functionality is tested and works. Sorry for the complications.

@andrej andrej mentioned this pull request Sep 8, 2026
Open
@andrej
andrej enabled auto-merge September 8, 2026 23:19
@andrej
andrej added this pull request to the merge queue Sep 9, 2026
Merged via the queue into amd:devel with commit 72002fb Sep 9, 2026
5 checks passed
@andrej
andrej deleted the trace-buffer-from-compiler branch September 9, 2026 02:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@hunhoffe hunhoffe hunhoffe approved these changes
@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@andrej @hunhoffe @asyms