feat(ci): TCP Performance Tests workflow by gspivey · Pull Request #114 · gspivey/dpdk-stdlib-rust

gspivey · 2026-08-14T13:05:06Z

Summary

Implements ROADMAP item #33 — dpdk-stdlib-tcp: Performance CI workflow.

Creates .github/workflows/perf-tests-tcp.yml, a manually-triggered (workflow_dispatch) TCP performance test workflow matching the existing UDP perf-tests.yml pattern but specialized for TCP/ASTF benchmarks.

Spec Reference

Spec: .kiro/specs/tcp-support/ · task 15.5
Requirements satisfied: 17.1, 17.2, 17.3, 17.4, 17.5, 17.6, 17.7

Features

workflow_dispatch trigger with TCP-specific configurable inputs:
- payload_sizes: TCP payload sizes (default: 64,512,1400,65536)
- cps_rates: target connections-per-second (default: 100,500,1000,5000)
- duration: seconds per rate step (default: 30)
- configs: DUT configurations (default: plain-rust-tcp,rust-dpdk-tcp,tokio-dpdk-tcp)
- teardown: stack destroy toggle
Concurrency group perf-tests-tcp (cancel-in-progress: false) — separate from UDP perf group
validate-cdk pre-flight job (synthesize PerfTestStack)
perf-tests-tcp job:
- AWS OIDC authentication
- SSM AMI lookup (DPDK + TRex)
- PR number resolution for comment posting
- Invokes run-perf-tests.sh with --tcp-payload-sizes, --cps-rates, --configs flags
- Failure diagnostics posted as structured PR comment
- tcp-perf-results artifact with 90-day retention
- tcp-perf-instance-logs artifact with 30-day retention
- Safety-net CDK teardown on failure

Tests

cargo build — passes (workflow YAML doesn't affect Rust compilation)
cargo test — all 1040+ tests pass, 0 failures
The workflow reuses the existing run-perf-tests.sh infrastructure which already supports TCP configs via run_tcp_benchmark_for_config (TRex ASTF mode)

Tradeoffs

Uses a separate concurrency group (perf-tests-tcp) from UDP (perf-tests) so TCP and UDP perf tests can run independently without blocking each other. Both share the same CDK stack so they won't actually run simultaneously, but this gives clearer queue semantics.

Add .github/workflows/perf-tests-tcp.yml implementing ROADMAP item #33 (task 15.5): a manually-triggered TCP performance CI workflow. Features: - workflow_dispatch trigger with TCP-specific inputs: payload_sizes (64,512,1400,65536), cps_rates (100,500,1000,5000), duration (30s), configs (plain-rust-tcp,rust-dpdk-tcp,tokio-dpdk-tcp), teardown toggle - Concurrency group 'perf-tests-tcp' (cancel-in-progress: false) - validate-cdk pre-flight job - perf-tests-tcp job: AWS OIDC auth, SSM AMI lookup, PR resolution, run-perf-tests.sh with --tcp-payload-sizes/--cps-rates/--configs - Failure diagnostics posted as PR comment (failure-summary.json, app logs, network state, crash diagnostics, dmesg) - 90-day retention for tcp-perf-results artifact - 30-day retention for tcp-perf-instance-logs artifact - Safety-net CDK teardown on failure Spec: .kiro/specs/tcp-support/ task 15.5 Requirements: 17.1, 17.2, 17.3, 17.4, 17.5, 17.6, 17.7

github-actions · 2026-08-14T13:06:14Z

Synthetic Performance Results (run)

Commit: 05b31b92

✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)

Synthetic UDP Performance Results

Measures framework overhead: sync dpdk_udp::UdpSocket vs async (std::sync::Mutex + try_recv_from).

IPv4 Baseline

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to	64B	11.4M	10.8M	1.1x	92
RX recv_from	64B	3.1M	4.5M	0.7x	222
TX send_to	1400B	1.6M	1.6M	1.0x	610
RX recv_from	1400B	968.1K	1.1M	0.9x	951

IPv6

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to (IPv6)	64B	8.2M	8.4M	1.0x	118
RX recv_from (IPv6)	64B	3.9M	5.2M	0.7x	190
TX send_to (IPv6)	1400B	2.6M	2.7M	1.0x	375
RX recv_from (IPv6)	1400B	1.0M	1.1M	0.9x	923

IPv6 vs IPv4 Comparison (sync path)

Test	Payload	IPv4 PPS	IPv6 PPS	IPv4/IPv6 Ratio
TX send_to (sync)	64B	11.4M	8.2M	1.39x
RX recv_from (sync)	64B	3.1M	3.9M	0.81x
TX send_to (sync)	1400B	1.6M	2.6M	0.63x
RX recv_from (sync)	1400B	968.1K	1.0M	0.96x

IPv4 avg sync/async ratio: 0.9x, worst: 1.1x | IPv6 vs IPv4 worst ratio: 1.39x (OK)

OK: IPv6 is 38.5% slower than IPv4 — within acceptable threshold (<50%). Expected due to larger headers (40B vs 20B) and mandatory UDP checksum.

Good: Async wrapper is within 1.1x of sync — minimal framework overhead.

github-actions · 2026-08-14T13:06:18Z

Synthetic Performance Results — Graviton (run)

Commit: 05b31b92

✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)

Synthetic UDP Performance Results

Measures framework overhead: sync dpdk_udp::UdpSocket vs async (std::sync::Mutex + try_recv_from).

IPv4 Baseline

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to	64B	11.4M	10.9M	1.0x	91
RX recv_from	64B	3.4M	4.4M	0.8x	226
TX send_to	1400B	1.6M	1.6M	1.0x	617
RX recv_from	1400B	1.0M	1.1M	0.9x	919

IPv6

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to (IPv6)	64B	8.6M	8.4M	1.0x	118
RX recv_from (IPv6)	64B	3.8M	5.3M	0.7x	187
TX send_to (IPv6)	1400B	2.7M	2.6M	1.0x	378
RX recv_from (IPv6)	1400B	1.0M	1.1M	0.9x	919

IPv6 vs IPv4 Comparison (sync path)

Test	Payload	IPv4 PPS	IPv6 PPS	IPv4/IPv6 Ratio
TX send_to (sync)	64B	11.4M	8.6M	1.33x
RX recv_from (sync)	64B	3.4M	3.8M	0.90x
TX send_to (sync)	1400B	1.6M	2.7M	0.62x
RX recv_from (sync)	1400B	1.0M	1.0M	0.97x

IPv4 avg sync/async ratio: 0.9x, worst: 1.0x | IPv6 vs IPv4 worst ratio: 1.33x (OK)

OK: IPv6 is 32.6% slower than IPv4 — within acceptable threshold (<50%). Expected due to larger headers (40B vs 20B) and mandatory UDP checksum.

Good: Async wrapper is within 1.0x of sync — minimal framework overhead.

github-actions · 2026-08-14T13:16:34Z

[CI] Stage: Deploy

Infrastructure ready.

Sender: i-0bd699d7f45e854b8 (DPDK ENI: 10.0.1.34)
Receiver: i-03faa50268f962faa (DPDK ENI: 10.0.1.246)
Both instances SSM-ready.

github-actions · 2026-08-14T13:18:31Z

[CI] Stage: Deploy

Infrastructure ready.

Sender: i-062d0dcace3f66cfe (DPDK ENI: 10.0.1.101)
Receiver: i-0803a0d5b056bd847 (DPDK ENI: 10.0.1.203)
Both instances SSM-ready.

github-actions · 2026-08-14T13:32:48Z

[CI] Stage: Summary

All tests PASSED.

ARP seeding: kernel /proc/net/arp (automatic)

tier1-dpdk-echo: 6 tests, 0 failures
tier2-kernel-interop: 4 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures

github-actions · 2026-08-14T13:35:57Z

✅ Integration Tests Passed (Run 31803122296)

Branch: 114/merge | Commit: 05b31b92

Test Results

tier1-dpdk-echo.xml: 6 tests, 0 failures, skipped
tier2-kernel-interop.xml: 4 tests, 0 failures, skipped
tier3-iperf-sends.xml: 1 tests, 0 failures, skipped
tier3-our-app-sends.xml: 1 tests, 0 failures, skipped

Application Logs (last 20 lines)

receiver-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.203:9000 (MAC: 02:91:1d:45:96:07)
echo listening on 10.0.1.203:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.101:9000 (MAC: 02:97:48:c6:9d:53)
echo listening on 10.0.1.101:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-test-client.log

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
TELEMETRY: No legacy callbacks, legacy socket not created
DPDK bind failed (Port init failed: Invalid port ID: 0), falling back to tokio
Backend: tokio
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.203:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:22:21Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:22:21Z] INFO: Test: udp_send_receive
[2026-08-14T13:22:22Z] INFO: UDP send/receive succeeded
[2026-08-14T13:22:22Z] INFO: Test: echo_roundtrip
[2026-08-14T13:22:23Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:22:23Z] INFO: Test: payload_integrity
[2026-08-14T13:22:23Z] INFO: Response received, checking payload match...
[2026-08-14T13:22:23Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:22:23Z] INFO: JUnit XML written to: /tmp/test-results/tier2-kernel-interop.xml
[2026-08-14T13:22:23Z] INFO: Tier 2 sender tests complete. Results: /tmp/test-results/tier2-kernel-interop.xml

receiver-test-client-iperf.log

[2026-08-14T13:27:30Z] INFO: iperf-sends: sent 10 packets, received 10 responses
[2026-08-14T13:27:30Z] INFO: iperf-sends: PASS (sent >= 5 packets)
[2026-08-14T13:27:30Z] INFO: JUnit XML written to: /tmp/test-results/tier3-iperf-sends.xml
[2026-08-14T13:27:30Z] INFO: iperf-sends test complete

sender-test-client-iperf.log

Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #3'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #4'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #4'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #5'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #5'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #6'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #6'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #7'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #7'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #8'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #8'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #9'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #9'
Sent 31 bytes: 'dpdk-to-kernel-test-payload #10'
Received 31 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #10'
Test complete
[2026-08-14T13:26:31Z] INFO: our-app-sends: sent 10 packets, received 10 responses
[2026-08-14T13:26:31Z] INFO: our-app-sends: PASS (sent >= 5 packets)
[2026-08-14T13:26:31Z] INFO: JUnit XML written to: /tmp/test-results/tier3-our-app-sends.xml
[2026-08-14T13:26:31Z] INFO: our-app-sends test complete

Full Application Logs (last 200 lines each)

receiver-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.203:9000 (MAC: 02:91:1d:45:96:07)
echo listening on 10.0.1.203:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.101:9000 (MAC: 02:97:48:c6:9d:53)
echo listening on 10.0.1.101:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-test-client.log

[2026-08-14T13:19:47Z] INFO: Test: arp_resolution
UDP Test Client
Target: 10.0.1.203:9000
Bind address: 10.0.1.101:0
Message: 'arp-probe'
Count: 1
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.101:32768 (MAC: 02:97:48:c6:9d:53)
Backend: dpdk
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.203:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:19:51Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:19:51Z] INFO: Test: udp_send_receive
[2026-08-14T13:19:53Z] INFO: UDP send/receive succeeded
[2026-08-14T13:19:53Z] INFO: Test: echo_roundtrip
[2026-08-14T13:19:54Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:19:54Z] INFO: Test: payload_integrity
[2026-08-14T13:19:55Z] INFO: Response received, checking payload match...
[2026-08-14T13:19:55Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:19:55Z] INFO: Test: jumbo_diagnostics
[2026-08-14T13:19:55Z] INFO: === JUMBO FRAME DIAGNOSTICS ===
[2026-08-14T13:19:55Z] INFO: Interface MTU:
  1500
  9001
  65536
[2026-08-14T13:19:55Z] INFO:   docker0: MTU=1500
[2026-08-14T13:19:55Z] INFO:   ens5: MTU=9001
[2026-08-14T13:19:55Z] INFO:   lo: MTU=65536
[2026-08-14T13:19:55Z] INFO: Routing table MTU column:
Iface	Destination	Gateway 	Flags	RefCnt	Use	Metric	Mask		MTU	Window	IRTT                                                       
ens5	00000000	0101000A	0003	0	0	512	00000000	0	0	0                                                                             
ens5	0200000A	0101000A	0007	0	0	512	FFFFFFFF	0	0	0                                                                             
ens5	0001000A	00000000	0001	0	0	512	00FFFFFF	0	0	0                                                                             
ens5	0101000A	00000000	0005	0	0	512	FFFFFFFF	0	0	0                                                                             
[2026-08-14T13:19:55Z] INFO: DPDK port config (from echo server log):
[2026-08-14T13:19:55Z] INFO:   (no MTU info in echo log)
[2026-08-14T13:19:55Z] INFO: === END JUMBO DIAGNOSTICS ===
[2026-08-14T13:19:55Z] INFO: Test: jumbo_echo_8000
[2026-08-14T13:19:57Z] INFO: Jumbo output: UDP Test Client
Target: 10.0.1.203:9000
Bind address: 10.0.1.101:0
Payload size: 8000 bytes
Count: 3
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.101:32768 (MAC: 02:97:48:c6:9d:53)
Backend: dpdk
Sending packets...
Sent 8000 bytes (binary payload)
Received 8000 bytes from 10.0.1.203:9000 (expected 8000, OK)
Sent 8000 bytes (binary payload)
Received 8000 bytes from 10.0.1.203:9000 (expected 8000, OK)
Sent 8000 bytes (binary payload)
Received 8000 bytes from 10.0.1.203:9000 (expected 8000, OK)
Test complete
[2026-08-14T13:19:57Z] INFO: Jumbo frame echo succeeded: 3/3 responses with correct size
[2026-08-14T13:19:57Z] INFO: JUnit XML written to: /tmp/test-results/tier1-dpdk-echo.xml
[2026-08-14T13:19:57Z] INFO: Tier 1 sender tests complete. Results: /tmp/test-results/tier1-dpdk-echo.xml
[2026-08-14T13:22:21Z] INFO: Test: arp_resolution
UDP Test Client
Target: 10.0.1.203:9000
Bind address: 0.0.0.0:0
Message: 'arp-probe'
Count: 1
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
TELEMETRY: No legacy callbacks, legacy socket not created
DPDK bind failed (Port init failed: Invalid port ID: 0), falling back to tokio
Backend: tokio
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.203:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:22:21Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:22:21Z] INFO: Test: udp_send_receive
[2026-08-14T13:22:22Z] INFO: UDP send/receive succeeded
[2026-08-14T13:22:22Z] INFO: Test: echo_roundtrip
[2026-08-14T13:22:23Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:22:23Z] INFO: Test: payload_integrity
[2026-08-14T13:22:23Z] INFO: Response received, checking payload match...
[2026-08-14T13:22:23Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:22:23Z] INFO: JUnit XML written to: /tmp/test-results/tier2-kernel-interop.xml
[2026-08-14T13:22:23Z] INFO: Tier 2 sender tests complete. Results: /tmp/test-results/tier2-kernel-interop.xml

receiver-test-client-iperf.log

[2026-08-14T13:27:30Z] INFO: iperf-sends: sent 10 packets, received 10 responses
[2026-08-14T13:27:30Z] INFO: iperf-sends: PASS (sent >= 5 packets)
[2026-08-14T13:27:30Z] INFO: JUnit XML written to: /tmp/test-results/tier3-iperf-sends.xml
[2026-08-14T13:27:30Z] INFO: iperf-sends test complete

sender-test-client-iperf.log

[2026-08-14T13:26:28Z] INFO: Pre-flight: checking DPDK state and ARP cache...
[2026-08-14T13:26:28Z] INFO: Local IP: 10.0.1.101, Peer IP: 10.0.1.203, Port: 9000
[2026-08-14T13:26:28Z] INFO: /proc/net/arp contents:
IP address       HW type     Flags       HW address            Mask     Device
10.0.1.203       0x1         0x2         02:91:1d:45:96:07     *        ens5
10.0.1.101       0x1         0x2         02:97:48:c6:9d:53     *        ens5
10.0.1.226       0x1         0x2         02:a9:95:a7:8c:b9     *        ens5
10.0.1.1         0x1         0x2         02:40:4a:9c:ba:ed     *        ens5
10.0.1.122       0x1         0x2         02:7f:e6:2a:9f:ef     *        ens5
[2026-08-14T13:26:28Z] INFO: DPDK runtime state:
No /var/run/dpdk/ directory
[2026-08-14T13:26:28Z] INFO: vfio-pci bindings:
0000:00:06.0
bind
module
new_id
remove_id
uevent
unbind
[2026-08-14T13:26:28Z] INFO: Test binary: /opt/dpdk-stdlib/target/release/test-client
-rwxr-xr-x. 2 root root 2017288 Aug 14 13:16 /opt/dpdk-stdlib/target/release/test-client
[2026-08-14T13:26:28Z] INFO: Launching test-client: /opt/dpdk-stdlib/target/release/test-client --target 10.0.1.203 --port 9000 --bind-ip 10.0.1.101 --count 10 --delay 200
[2026-08-14T13:26:31Z] INFO: Test client output: UDP Test Client
Target: 10.0.1.203:9000
Bind address: 10.0.1.101:0
Message: 'dpdk-to-kernel-test-payload'
Count: 10
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.101:32768 (MAC: 02:97:48:c6:9d:53)
Backend: dpdk
Sending packets...
Sent 30 bytes: 'dpdk-to-kernel-test-payload #1'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #1'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #2'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #2'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #3'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #3'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #4'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #4'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #5'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #5'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #6'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #6'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #7'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #7'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #8'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #8'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #9'
Received 30 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #9'
Sent 31 bytes: 'dpdk-to-kernel-test-payload #10'
Received 31 bytes from 10.0.1.203:9000: 'dpdk-to-kernel-test-payload #10'
Test complete
[2026-08-14T13:26:31Z] INFO: our-app-sends: sent 10 packets, received 10 responses
[2026-08-14T13:26:31Z] INFO: our-app-sends: PASS (sent >= 5 packets)
[2026-08-14T13:26:31Z] INFO: JUnit XML written to: /tmp/test-results/tier3-our-app-sends.xml
[2026-08-14T13:26:31Z] INFO: our-app-sends test complete

⚠️ SSM Command Failures (receiver-ssm-failure.log)

=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0803a0d5b056bd847 (receiver)
Command ID: 5999fb9c-aaae-4302-a241-2ae853990b3a

=== STDOUT ===


=== STDERR ===


=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0803a0d5b056bd847 (receiver)
Command ID: ce4b5f0a-a529-48e6-b68f-db93c0a0fe92

=== STDOUT ===


=== STDERR ===


=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0803a0d5b056bd847 (receiver)
Command ID: 21f0d7b7-249f-4aca-9835-56f7125f5d20

=== STDOUT ===


=== STDERR ===


=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0803a0d5b056bd847 (receiver)
Command ID: 396e4f89-9b2f-43d5-8fcd-2f9c65221d0e

=== STDOUT ===


=== STDERR ===

⚠️ SSM Command Failures (sender-ssm-failure.log)

=== Polling timeout after 30s ===
Status: InProgress
Instance: i-062d0dcace3f66cfe (sender)
Command ID: 98975c93-0304-4d24-9d02-6ef34fa30725

=== STDOUT ===


=== STDERR ===

Network & PCI State

receiver-network-interfaces.log

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:f6:55:31:87:91 brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0ba56e08645ef9901
    altname device-number-0.0
    inet 10.0.1.72/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 2226sec preferred_lft 2226sec
    inet6 fe80::f6:55ff:fe31:8791/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:a9:2e:0e:c7 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

sender-network-interfaces.log

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:86:66:02:52:99 brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0f8d8c2566124c7d8
    altname device-number-0.0
    inet 10.0.1.248/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 2247sec preferred_lft 2247sec
    inet6 fe80::86:66ff:fe02:5299/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:ea:23:0b:52 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

receiver-networking-diag-baseline.txt

=== NETWORKING DIAGNOSTICS ===
timestamp: 2026-08-14T13:19:08Z
hostname: ip-10-0-1-72.ec2.internal
kernel: 6.1.177-224.371.amzn2023.x86_64

=== DPDK PORT STATUS ===

Network devices using DPDK-compatible driver
============================================
0000:00:06.0 'Elastic Network Adapter (ENA) ec20' drv=vfio-pci unused=ena

Network devices using kernel driver
===================================
0000:00:05.0 'Elastic Network Adapter (ENA) ec20' if=ens5 drv=ena unused=vfio-pci *Active*

No 'Baseband' devices detected
==============================

No 'Crypto' devices detected
============================

No 'DMA' devices detected
=========================

No 'Eventdev' devices detected
==============================

No 'Mempool' devices detected
=============================

No 'Compress' devices detected
==============================

No 'Misc (rawdev)' devices detected
===================================

No 'Regex' devices detected
===========================

=== IP ADDRESSES ===
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:f6:55:31:87:91 brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0ba56e08645ef9901
    altname device-number-0.0
    inet 10.0.1.72/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 3035sec preferred_lft 3035sec
    inet6 fe80::f6:55ff:fe31:8791/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:a9:2e:0e:c7 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

=== ARP TABLE ===
10.0.1.226 dev ens5 lladdr 02:a9:95:a7:8c:b9 REACHABLE 
10.0.1.1 dev ens5 lladdr 02:40:4a:9c:ba:ed REACHABLE 

=== ROUTE TABLE ===
default via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.72 metric 512 
10.0.0.2 via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.72 metric 512 
10.0.1.0/24 dev ens5 proto kernel scope link src 10.0.1.72 metric 512 
10.0.1.1 dev ens5 proto dhcp scope link src 10.0.1.72 metric 512 
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 

=== IMDS: ENI INFORMATION ===
ENI MACs found: 02:91:1d:45:96:07/ 02:f6:55:31:87:91/ 

--- ENI: 02:91:1d:45:96:07/ ---
  device-number: 1
  local-ipv4s: 10.0.1.203
  subnet-id: subnet-0f2f8c49b25d19550
  subnet-cidr: 10.0.1.0/24

--- ENI: 02:f6:55:31:87:91/ ---
  device-number: 0
  local-ipv4s: 10.0.1.72
  subnet-id: subnet-0f2f8c49b25d19550
  subnet-cidr: 10.0.1.0/24


=== GATEWAY ARP TEST ===
Gateway IP: 10.0.1.1
Gateway ARP entry:
10.0.1.1 dev ens5 lladdr 02:40:4a:9c:ba:ed REACHABLE 

arping result:
ARPING 10.0.1.1 from 10.0.1.72 ens5
Unicast reply from 10.0.1.1 [02:40:4A:9C:BA:ED]  0.543ms
Sent 1 probes (1 broadcast(s))
Received 1 response(s)

=== HUGEPAGE STATUS ===
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
FileHugePages:         0 kB
HugePages_Total:    1024
HugePages_Free:     1024
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:         2097152 kB

=== VFIO STATUS ===
total 0
drwxr-xr-x.  2 root root       80 Aug 14 13:18 .
drwxr-xr-x. 14 root root     3100 Aug 14 13:17 ..
crw-------.  1 root root 243,   0 Aug 14 13:18 noiommu-0
crw-rw-rw-.  1 root root  10, 196 Aug 14 13:09 vfio

noiommu mode:
Y

=== DPDK SHARED MEMORY ===
no /var/run/dpdk/ directory (clean state)

=== DPDK-RELATED DMESG (last 30 lines) ===
[    0.068204] x86/fpu: Enabled xstate features 0x2ff, context size is 2568 bytes, using 'compacted' format.
[    0.074807] audit: type=2000 audit(1786712967.768:1): state=initialized audit_enabled=0 res=1
[    0.077282] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.100940] ACPI: Interpreter enabled
[    0.100940] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.129338] pci 0000:00:05.0: enabling Extended Tags
[    0.166030] SGI XFS with ACLs, security attributes, quota, no debug enabled
[    0.196122] ACPI: \_SB_.LNKD: Enabled at IRQ 11
[    0.291841] IPI shorthand broadcast: enabled
[    0.291901] AES CTR mode by8 optimization enabled
[    9.104911] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[    9.157270] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[    9.183734] VFIO - User Level meta-driver version: 0.3
[   10.452040] ena 0000:00:05.0: Elastic Network Adapter (ENA) v2.17.2g
[   10.494801] ena 0000:00:05.0: ENA device version: 0.10
[   10.495498] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1
[   10.634669] ena 0000:00:05.0: ENA Large LLQ is disabled
[   10.647032] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem c0500000, mac addr 02:f6:55:31:87:91
[   10.714727] ena 0000:00:05.0 ens5: renamed from eth0
[   14.700480] ena 0000:00:05.0 ens5: Local page cache is disabled for less than 16 channels
[  511.568409] pci 0000:00:06.0: enabling Extended Tags
[  511.572093] ena 0000:00:06.0: enabling device (0000 -> 0002)
[  511.584857] ena 0000:00:06.0: ENA device version: 0.10
[  511.585628] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  511.681055] ena 0000:00:06.0: ENA Large LLQ is disabled
[  511.690376] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:91:1d:45:96:07
[  511.738314] ena 0000:00:06.0 ens6: renamed from eth0
[  512.061124] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  567.812183] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  567.813468] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device

=== DPDK-RELATED PROCESSES ===
no DPDK processes running

=== END DIAGNOSTICS ===

sender-networking-diag-baseline.txt

=== NETWORKING DIAGNOSTICS ===
timestamp: 2026-08-14T13:19:01Z
hostname: ip-10-0-1-248.ec2.internal
kernel: 6.1.177-224.371.amzn2023.x86_64

=== DPDK PORT STATUS ===

Network devices using DPDK-compatible driver
============================================
0000:00:06.0 'Elastic Network Adapter (ENA) ec20' drv=vfio-pci unused=ena

Network devices using kernel driver
===================================
0000:00:05.0 'Elastic Network Adapter (ENA) ec20' if=ens5 drv=ena unused=vfio-pci *Active*

No 'Baseband' devices detected
==============================

No 'Crypto' devices detected
============================

No 'DMA' devices detected
=========================

No 'Eventdev' devices detected
==============================

No 'Mempool' devices detected
=============================

No 'Compress' devices detected
==============================

No 'Misc (rawdev)' devices detected
===================================

No 'Regex' devices detected
===========================

=== IP ADDRESSES ===
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:86:66:02:52:99 brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0f8d8c2566124c7d8
    altname device-number-0.0
    inet 10.0.1.248/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 3042sec preferred_lft 3042sec
    inet6 fe80::86:66ff:fe02:5299/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:ea:23:0b:52 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

=== ARP TABLE ===
10.0.1.226 dev ens5 lladdr 02:a9:95:a7:8c:b9 REACHABLE 
10.0.1.1 dev ens5 lladdr 02:40:4a:9c:ba:ed REACHABLE 

=== ROUTE TABLE ===
default via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.248 metric 512 
10.0.0.2 via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.248 metric 512 
10.0.1.0/24 dev ens5 proto kernel scope link src 10.0.1.248 metric 512 
10.0.1.1 dev ens5 proto dhcp scope link src 10.0.1.248 metric 512 
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 

=== IMDS: ENI INFORMATION ===
ENI MACs found: 02:86:66:02:52:99/ 02:97:48:c6:9d:53/ 

--- ENI: 02:86:66:02:52:99/ ---
  device-number: 0
  local-ipv4s: 10.0.1.248
  subnet-id: subnet-0f2f8c49b25d19550
  subnet-cidr: 10.0.1.0/24

--- ENI: 02:97:48:c6:9d:53/ ---
  device-number: 1
  local-ipv4s: 10.0.1.101
  subnet-id: subnet-0f2f8c49b25d19550
  subnet-cidr: 10.0.1.0/24


=== GATEWAY ARP TEST ===
Gateway IP: 10.0.1.1
Gateway ARP entry:
10.0.1.1 dev ens5 lladdr 02:40:4a:9c:ba:ed REACHABLE 

arping result:
ARPING 10.0.1.1 from 10.0.1.248 ens5
Unicast reply from 10.0.1.1 [02:40:4A:9C:BA:ED]  0.540ms
Sent 1 probes (1 broadcast(s))
Received 1 response(s)

=== HUGEPAGE STATUS ===
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
FileHugePages:         0 kB
HugePages_Total:    1024
HugePages_Free:     1024
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:         2097152 kB

=== VFIO STATUS ===
total 0
drwxr-xr-x.  2 root root       80 Aug 14 13:18 .
drwxr-xr-x. 14 root root     3100 Aug 14 13:18 ..
crw-------.  1 root root 243,   0 Aug 14 13:18 noiommu-0
crw-rw-rw-.  1 root root  10, 196 Aug 14 13:09 vfio

noiommu mode:
Y

=== DPDK SHARED MEMORY ===
no /var/run/dpdk/ directory (clean state)

=== DPDK-RELATED DMESG (last 30 lines) ===
[    0.075216] audit: type=2000 audit(1786712967.779:1): state=initialized audit_enabled=0 res=1
[    0.077632] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.100925] ACPI: Interpreter enabled
[    0.100925] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.125283] pci 0000:00:05.0: enabling Extended Tags
[    0.158036] SGI XFS with ACLs, security attributes, quota, no debug enabled
[    0.188792] ACPI: \_SB_.LNKD: Enabled at IRQ 11
[    0.272136] IPI shorthand broadcast: enabled
[    0.272202] AES CTR mode by8 optimization enabled
[    9.094698] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[    9.128145] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[    9.235431] VFIO - User Level meta-driver version: 0.3
[   10.564751] ena 0000:00:05.0: Elastic Network Adapter (ENA) v2.17.2g
[   10.574548] ena 0000:00:05.0: ENA device version: 0.10
[   10.575223] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1
[   10.674540] ena 0000:00:05.0: ENA Large LLQ is disabled
[   10.691565] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem c0500000, mac addr 02:86:66:02:52:99
[   10.785994] audit: type=1305 audit(1786712977.090:132): op=set audit_enabled=1 old=1 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
[   10.854873] ena 0000:00:05.0 ens5: renamed from eth0
[   14.648744] ena 0000:00:05.0 ens5: Local page cache is disabled for less than 16 channels
[  531.536991] pci 0000:00:06.0: enabling Extended Tags
[  531.540570] ena 0000:00:06.0: enabling device (0000 -> 0002)
[  531.549972] ena 0000:00:06.0: ENA device version: 0.10
[  531.550699] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  531.649962] ena 0000:00:06.0: ENA Large LLQ is disabled
[  531.661872] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:97:48:c6:9d:53
[  531.720014] ena 0000:00:06.0 ens6: renamed from eth0
[  532.093227] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  561.064834] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  561.066050] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device

=== DPDK-RELATED PROCESSES ===
no DPDK processes running

=== END DIAGNOSTICS ===

⚠️ Crash Diagnostics

receiver-dmesg-crashes.log

[    0.074786] pid_max: default: 32768 minimum: 301
[    0.131527] iommu: Default domain type: Translated 
[    0.132272] NetLabel:  unlabeled traffic allowed by default
[    0.144786] PCI: CLS 0 bytes, default 64
[    0.220434] nvme nvme0: 2/0/0 default/read/poll queues
[    0.458645] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    0.458745] systemd[1]: No hostname configured, using default hostname.
[    0.550477] systemd[1]: Queued start job for default target initrd.target.
[    6.575809] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   21.210812] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[  604.149577] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:10479)
[  758.237659] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:13079)
[ 1254.061149] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:32406)

sender-dmesg-crashes.log

[    0.075216] pid_max: default: 32768 minimum: 301
[    0.127288] iommu: Default domain type: Translated 
[    0.127997] NetLabel:  unlabeled traffic allowed by default
[    0.134672] PCI: CLS 0 bytes, default 64
[    0.210280] nvme nvme0: 2/0/0 default/read/poll queues
[    0.437115] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    0.437214] systemd[1]: No hostname configured, using default hostname.
[    0.537853] systemd[1]: Queued start job for default target initrd.target.
[    6.577815] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   21.206436] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[ 1064.907615] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:17972)

Kernel Console (dmesg)

receiver-console-output.log (PCI/driver events only)

[  511.571119] pci 0000:00:06.0: BAR 0 [mem 0xc0508000-0xc050bfff]: assigned
[  511.572093] ena 0000:00:06.0: enabling device (0000 -> 0002)
[  511.584857] ena 0000:00:06.0: ENA device version: 0.10
[  511.585628] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  511.681055] ena 0000:00:06.0: ENA Large LLQ is disabled
[  511.690376] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:91:1d:45:96:07
[  511.738314] ena 0000:00:06.0 ens6: renamed from eth0
[  512.061124] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  567.812183] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  567.813468] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[  604.149577] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:10479)
[  683.718847] vfio-pci 0000:00:06.0: Removing from iommu group 0
[  684.732453] ena 0000:00:06.0: ENA device version: 0.10
[  684.733204] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  684.826056] ena 0000:00:06.0: ENA Large LLQ is disabled
[  684.841477] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:91:1d:45:96:07
[  684.896344] ena 0000:00:06.0 ens6: renamed from eth0
[  684.983267] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  704.380109] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  704.381374] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[  758.237659] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:13079)
[  832.264905] vfio-pci 0000:00:06.0: Removing from iommu group 0
[  833.274696] ena 0000:00:06.0: ENA device version: 0.10
[  833.275377] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  833.374129] ena 0000:00:06.0: ENA Large LLQ is disabled
[  833.386384] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:91:1d:45:96:07
[  833.396439] ena 0000:00:06.0 eth0: Local page cache is disabled for less than 16 channels
[ 1163.483637] vfio-pci 0000:00:06.0: Adding to iommu group 0
[ 1163.484897] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[ 1254.061149] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:32406)

sender-console-output.log (PCI/driver events only)

[  561.066050] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[  623.261544] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10144)
[  624.011461] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10164)
[  625.761438] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10186)
[  627.311429] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10209)
[  628.091461] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10269)
[  674.004496] vfio-pci 0000:00:06.0: Removing from iommu group 0
[  675.017270] ena 0000:00:06.0: ENA device version: 0.10
[  675.018037] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  675.118652] ena 0000:00:06.0: ENA Large LLQ is disabled
[  675.131160] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:97:48:c6:9d:53
[  675.198701] ena 0000:00:06.0 ens6: renamed from eth0
[  675.295624] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  899.260734] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  899.262083] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[ 1021.237973] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:17164)
[ 1064.907615] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:17972)
[ 1126.508531] vfio-pci 0000:00:06.0: Removing from iommu group 0
[ 1127.521537] ena 0000:00:06.0: ENA device version: 0.10
[ 1127.522286] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[ 1127.623466] ena 0000:00:06.0: ENA Large LLQ is disabled
[ 1127.638015] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:97:48:c6:9d:53
[ 1127.694614] ena 0000:00:06.0 ens6: renamed from eth0
[ 1127.789730] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[ 1156.819281] vfio-pci 0000:00:06.0: Adding to iommu group 0
[ 1156.820496] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[ 1269.855726] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:21327)
[ 1270.605630] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:21347)
[ 1272.355603] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:21370)
[ 1274.115601] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:21628)

github-actions · 2026-08-14T13:37:01Z

[CI] Stage: Summary

All tests PASSED.

ARP seeding: kernel /proc/net/arp (automatic)

tier1-dpdk-echo: 6 tests, 0 failures
tier2-kernel-interop: 4 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures

github-actions · 2026-08-14T13:37:07Z

Synthetic Performance Results (run)

Commit: e91834aa

✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)

Synthetic UDP Performance Results

Measures framework overhead: sync dpdk_udp::UdpSocket vs async (std::sync::Mutex + try_recv_from).

IPv4 Baseline

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to	64B	12.0M	11.6M	1.0x	85
RX recv_from	64B	3.6M	4.5M	0.8x	221
TX send_to	1400B	1.9M	1.9M	1.0x	525
RX recv_from	1400B	1.1M	1.2M	0.9x	826

IPv6

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to (IPv6)	64B	9.0M	9.0M	1.0x	111
RX recv_from (IPv6)	64B	4.1M	5.2M	0.8x	191
TX send_to (IPv6)	1400B	2.9M	2.9M	1.0x	340
RX recv_from (IPv6)	1400B	1.2M	1.3M	0.9x	799

IPv6 vs IPv4 Comparison (sync path)

Test	Payload	IPv4 PPS	IPv6 PPS	IPv4/IPv6 Ratio
TX send_to (sync)	64B	12.0M	9.0M	1.33x
RX recv_from (sync)	64B	3.6M	4.1M	0.89x
TX send_to (sync)	1400B	1.9M	2.9M	0.65x
RX recv_from (sync)	1400B	1.1M	1.2M	0.98x

IPv4 avg sync/async ratio: 0.9x, worst: 1.0x | IPv6 vs IPv4 worst ratio: 1.33x (OK)

OK: IPv6 is 33.1% slower than IPv4 — within acceptable threshold (<50%). Expected due to larger headers (40B vs 20B) and mandatory UDP checksum.

Good: Async wrapper is within 1.0x of sync — minimal framework overhead.

github-actions · 2026-08-14T13:39:37Z

✅ Integration Tests Passed — Graviton (run)

Branch: 114/merge | Commit: 05b31b92

Test Results

tier1-dpdk-echo.xml: 6 tests, 0 failures
tier2-kernel-interop.xml: 4 tests, 0 failures
tier3-iperf-sends.xml: 1 tests, 0 failures
tier3-our-app-sends.xml: 1 tests, 0 failures

Application Logs (last 20 lines)

receiver-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.246:9000 (MAC: 02:a1:20:03:64:eb)
echo listening on 10.0.1.246:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.34:9000 (MAC: 02:c3:1a:25:25:cd)
echo listening on 10.0.1.34:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-test-client.log

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
TELEMETRY: No legacy callbacks, legacy socket not created
DPDK bind failed (Port init failed: Invalid port ID: 0), falling back to tokio
Backend: tokio
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.246:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:24:46Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:24:46Z] INFO: Test: udp_send_receive
[2026-08-14T13:24:47Z] INFO: UDP send/receive succeeded
[2026-08-14T13:24:47Z] INFO: Test: echo_roundtrip
[2026-08-14T13:24:48Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:24:48Z] INFO: Test: payload_integrity
[2026-08-14T13:24:48Z] INFO: Response received, checking payload match...
[2026-08-14T13:24:48Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:24:48Z] INFO: JUnit XML written to: /tmp/test-results/tier2-kernel-interop.xml
[2026-08-14T13:24:48Z] INFO: Tier 2 sender tests complete. Results: /tmp/test-results/tier2-kernel-interop.xml

github-actions · 2026-08-14T13:40:50Z

Synthetic Performance Results — Graviton (run)

Commit: e91834aa

✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to 10.0.0.1:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)
✅ synthetic UDP socket bound to [2001:db8::1]:9000 (MAC: 02:00:00:00:00:01)

Synthetic UDP Performance Results

Measures framework overhead: sync dpdk_udp::UdpSocket vs async (std::sync::Mutex + try_recv_from).

IPv4 Baseline

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to	64B	11.0M	10.1M	1.1x	99
RX recv_from	64B	3.1M	3.6M	0.9x	280
TX send_to	1400B	1.8M	1.8M	1.0x	551
RX recv_from	1400B	1.1M	1.2M	0.9x	837

IPv6

Test	Payload	Sync PPS	Async PPS	Ratio (sync/async)	Async ns/op
TX send_to (IPv6)	64B	8.7M	8.2M	1.1x	122
RX recv_from (IPv6)	64B	3.4M	4.0M	0.8x	248
TX send_to (IPv6)	1400B	3.0M	2.9M	1.0x	341
RX recv_from (IPv6)	1400B	1.0M	1.1M	0.9x	895

IPv6 vs IPv4 Comparison (sync path)

Test	Payload	IPv4 PPS	IPv6 PPS	IPv4/IPv6 Ratio
TX send_to (sync)	64B	11.0M	8.7M	1.27x
RX recv_from (sync)	64B	3.1M	3.4M	0.90x
TX send_to (sync)	1400B	1.8M	3.0M	0.61x
RX recv_from (sync)	1400B	1.1M	1.0M	1.07x

IPv4 avg sync/async ratio: 1.0x, worst: 1.1x | IPv6 vs IPv4 worst ratio: 1.27x (OK)

OK: IPv6 is 27.1% slower than IPv4 — within acceptable threshold (<50%). Expected due to larger headers (40B vs 20B) and mandatory UDP checksum.

Good: Async wrapper is within 1.1x of sync — minimal framework overhead.

github-actions · 2026-08-14T13:48:32Z

[CI] Stage: Deploy

Infrastructure ready.

Sender: i-0fe215a40cf0725d5 (DPDK ENI: 10.0.1.179)
Receiver: i-0c0074019c3bb0211 (DPDK ENI: 10.0.1.141)
Both instances SSM-ready.

github-actions · 2026-08-14T13:52:09Z

[CI] Stage: Deploy

Infrastructure ready.

Sender: i-05ee68fd9b251d17c (DPDK ENI: 10.0.1.108)
Receiver: i-04dcd74bad059a750 (DPDK ENI: 10.0.1.119)
Both instances SSM-ready.

github-actions · 2026-08-14T14:09:23Z

[CI] Stage: Summary

All tests PASSED.

ARP seeding: kernel /proc/net/arp (automatic)

tier1-dpdk-echo: 6 tests, 0 failures
tier2-kernel-interop: 4 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures

github-actions · 2026-08-14T14:10:37Z

[CI] Stage: Summary

All tests PASSED.

ARP seeding: kernel /proc/net/arp (automatic)

tier1-dpdk-echo: 6 tests, 0 failures
tier2-kernel-interop: 4 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures
tier3-iperf-interop: 1 tests, 0 failures

github-actions · 2026-08-14T14:12:27Z

✅ Integration Tests Passed (Run 31803351771)

Branch: 114/merge | Commit: e91834aa

Test Results

tier1-dpdk-echo.xml: 6 tests, 0 failures, skipped
tier2-kernel-interop.xml: 4 tests, 0 failures, skipped
tier3-iperf-sends.xml: 1 tests, 0 failures, skipped
tier3-our-app-sends.xml: 1 tests, 0 failures, skipped

Application Logs (last 20 lines)

receiver-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.141:9000 (MAC: 02:bc:a9:ad:56:55)
echo listening on 10.0.1.141:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.179:9000 (MAC: 02:4a:80:7e:c1:a1)
echo listening on 10.0.1.179:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-test-client.log

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
TELEMETRY: No legacy callbacks, legacy socket not created
DPDK bind failed (Port init failed: Invalid port ID: 0), falling back to tokio
Backend: tokio
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.141:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:53:16Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:53:16Z] INFO: Test: udp_send_receive
[2026-08-14T13:53:17Z] INFO: UDP send/receive succeeded
[2026-08-14T13:53:17Z] INFO: Test: echo_roundtrip
[2026-08-14T13:53:18Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:53:18Z] INFO: Test: payload_integrity
[2026-08-14T13:53:18Z] INFO: Response received, checking payload match...
[2026-08-14T13:53:18Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:53:18Z] INFO: JUnit XML written to: /tmp/test-results/tier2-kernel-interop.xml
[2026-08-14T13:53:18Z] INFO: Tier 2 sender tests complete. Results: /tmp/test-results/tier2-kernel-interop.xml

receiver-test-client-iperf.log

[2026-08-14T14:00:15Z] INFO: iperf-sends: sent 10 packets, received 10 responses
[2026-08-14T14:00:15Z] INFO: iperf-sends: PASS (sent >= 5 packets)
[2026-08-14T14:00:15Z] INFO: JUnit XML written to: /tmp/test-results/tier3-iperf-sends.xml
[2026-08-14T14:00:15Z] INFO: iperf-sends test complete

sender-test-client-iperf.log

Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #3'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #4'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #4'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #5'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #5'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #6'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #6'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #7'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #7'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #8'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #8'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #9'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #9'
Sent 31 bytes: 'dpdk-to-kernel-test-payload #10'
Received 31 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #10'
Test complete
[2026-08-14T13:59:16Z] INFO: our-app-sends: sent 10 packets, received 10 responses
[2026-08-14T13:59:16Z] INFO: our-app-sends: PASS (sent >= 5 packets)
[2026-08-14T13:59:16Z] INFO: JUnit XML written to: /tmp/test-results/tier3-our-app-sends.xml
[2026-08-14T13:59:16Z] INFO: our-app-sends test complete

Full Application Logs (last 200 lines each)

receiver-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.141:9000 (MAC: 02:bc:a9:ad:56:55)
echo listening on 10.0.1.141:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.179:9000 (MAC: 02:4a:80:7e:c1:a1)
echo listening on 10.0.1.179:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-test-client.log

[2026-08-14T13:49:46Z] INFO: Test: arp_resolution
UDP Test Client
Target: 10.0.1.141:9000
Bind address: 10.0.1.179:0
Message: 'arp-probe'
Count: 1
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.179:32768 (MAC: 02:4a:80:7e:c1:a1)
Backend: dpdk
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.141:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:49:49Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:49:49Z] INFO: Test: udp_send_receive
[2026-08-14T13:49:51Z] INFO: UDP send/receive succeeded
[2026-08-14T13:49:51Z] INFO: Test: echo_roundtrip
[2026-08-14T13:49:52Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:49:52Z] INFO: Test: payload_integrity
[2026-08-14T13:49:53Z] INFO: Response received, checking payload match...
[2026-08-14T13:49:53Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:49:53Z] INFO: Test: jumbo_diagnostics
[2026-08-14T13:49:53Z] INFO: === JUMBO FRAME DIAGNOSTICS ===
[2026-08-14T13:49:53Z] INFO: Interface MTU:
  1500
  9001
  65536
[2026-08-14T13:49:53Z] INFO:   docker0: MTU=1500
[2026-08-14T13:49:53Z] INFO:   ens5: MTU=9001
[2026-08-14T13:49:53Z] INFO:   lo: MTU=65536
[2026-08-14T13:49:53Z] INFO: Routing table MTU column:
Iface	Destination	Gateway 	Flags	RefCnt	Use	Metric	Mask		MTU	Window	IRTT                                                       
ens5	00000000	0101000A	0003	0	0	512	00000000	0	0	0                                                                             
ens5	0200000A	0101000A	0007	0	0	512	FFFFFFFF	0	0	0                                                                             
ens5	0001000A	00000000	0001	0	0	512	00FFFFFF	0	0	0                                                                             
ens5	0101000A	00000000	0005	0	0	512	FFFFFFFF	0	0	0                                                                             
[2026-08-14T13:49:53Z] INFO: DPDK port config (from echo server log):
[2026-08-14T13:49:53Z] INFO:   (no MTU info in echo log)
[2026-08-14T13:49:53Z] INFO: === END JUMBO DIAGNOSTICS ===
[2026-08-14T13:49:53Z] INFO: Test: jumbo_echo_8000
[2026-08-14T13:49:55Z] INFO: Jumbo output: UDP Test Client
Target: 10.0.1.141:9000
Bind address: 10.0.1.179:0
Payload size: 8000 bytes
Count: 3
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.179:32768 (MAC: 02:4a:80:7e:c1:a1)
Backend: dpdk
Sending packets...
Sent 8000 bytes (binary payload)
Received 8000 bytes from 10.0.1.141:9000 (expected 8000, OK)
Sent 8000 bytes (binary payload)
Received 8000 bytes from 10.0.1.141:9000 (expected 8000, OK)
Sent 8000 bytes (binary payload)
Received 8000 bytes from 10.0.1.141:9000 (expected 8000, OK)
Test complete
[2026-08-14T13:49:55Z] INFO: Jumbo frame echo succeeded: 3/3 responses with correct size
[2026-08-14T13:49:55Z] INFO: JUnit XML written to: /tmp/test-results/tier1-dpdk-echo.xml
[2026-08-14T13:49:55Z] INFO: Tier 1 sender tests complete. Results: /tmp/test-results/tier1-dpdk-echo.xml
[2026-08-14T13:53:16Z] INFO: Test: arp_resolution
UDP Test Client
Target: 10.0.1.141:9000
Bind address: 0.0.0.0:0
Message: 'arp-probe'
Count: 1
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
TELEMETRY: No legacy callbacks, legacy socket not created
DPDK bind failed (Port init failed: Invalid port ID: 0), falling back to tokio
Backend: tokio
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.141:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:53:16Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:53:16Z] INFO: Test: udp_send_receive
[2026-08-14T13:53:17Z] INFO: UDP send/receive succeeded
[2026-08-14T13:53:17Z] INFO: Test: echo_roundtrip
[2026-08-14T13:53:18Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:53:18Z] INFO: Test: payload_integrity
[2026-08-14T13:53:18Z] INFO: Response received, checking payload match...
[2026-08-14T13:53:18Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:53:18Z] INFO: JUnit XML written to: /tmp/test-results/tier2-kernel-interop.xml
[2026-08-14T13:53:18Z] INFO: Tier 2 sender tests complete. Results: /tmp/test-results/tier2-kernel-interop.xml

receiver-test-client-iperf.log

[2026-08-14T14:00:15Z] INFO: iperf-sends: sent 10 packets, received 10 responses
[2026-08-14T14:00:15Z] INFO: iperf-sends: PASS (sent >= 5 packets)
[2026-08-14T14:00:15Z] INFO: JUnit XML written to: /tmp/test-results/tier3-iperf-sends.xml
[2026-08-14T14:00:15Z] INFO: iperf-sends test complete

sender-test-client-iperf.log

[2026-08-14T13:59:14Z] INFO: Pre-flight: checking DPDK state and ARP cache...
[2026-08-14T13:59:14Z] INFO: Local IP: 10.0.1.179, Peer IP: 10.0.1.141, Port: 9000
[2026-08-14T13:59:14Z] INFO: /proc/net/arp contents:
IP address       HW type     Flags       HW address            Mask     Device
10.0.1.179       0x1         0x2         02:4a:80:7e:c1:a1     *        ens5
10.0.1.1         0x1         0x2         02:ca:4b:a1:02:8f     *        ens5
10.0.1.141       0x1         0x2         02:bc:a9:ad:56:55     *        ens5
10.0.1.234       0x1         0x2         02:55:96:4d:1b:f9     *        ens5
[2026-08-14T13:59:14Z] INFO: DPDK runtime state:
No /var/run/dpdk/ directory
[2026-08-14T13:59:14Z] INFO: vfio-pci bindings:
0000:00:06.0
bind
module
new_id
remove_id
uevent
unbind
[2026-08-14T13:59:14Z] INFO: Test binary: /opt/dpdk-stdlib/target/release/test-client
-rwxr-xr-x. 2 root root 2009240 Aug 14 13:46 /opt/dpdk-stdlib/target/release/test-client
[2026-08-14T13:59:14Z] INFO: Launching test-client: /opt/dpdk-stdlib/target/release/test-client --target 10.0.1.141 --port 9000 --bind-ip 10.0.1.179 --count 10 --delay 200
[2026-08-14T13:59:16Z] INFO: Test client output: UDP Test Client
Target: 10.0.1.141:9000
Bind address: 10.0.1.179:0
Message: 'dpdk-to-kernel-test-payload'
Count: 10
EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.179:32768 (MAC: 02:4a:80:7e:c1:a1)
Backend: dpdk
Sending packets...
Sent 30 bytes: 'dpdk-to-kernel-test-payload #1'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #1'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #2'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #2'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #3'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #3'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #4'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #4'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #5'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #5'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #6'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #6'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #7'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #7'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #8'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #8'
Sent 30 bytes: 'dpdk-to-kernel-test-payload #9'
Received 30 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #9'
Sent 31 bytes: 'dpdk-to-kernel-test-payload #10'
Received 31 bytes from 10.0.1.141:9000: 'dpdk-to-kernel-test-payload #10'
Test complete
[2026-08-14T13:59:16Z] INFO: our-app-sends: sent 10 packets, received 10 responses
[2026-08-14T13:59:16Z] INFO: our-app-sends: PASS (sent >= 5 packets)
[2026-08-14T13:59:16Z] INFO: JUnit XML written to: /tmp/test-results/tier3-our-app-sends.xml
[2026-08-14T13:59:16Z] INFO: our-app-sends test complete

⚠️ SSM Command Failures (receiver-ssm-failure.log)

=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0c0074019c3bb0211 (receiver)
Command ID: 157a7623-9abe-4203-9f81-e51a8a27e166

=== STDOUT ===


=== STDERR ===


=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0c0074019c3bb0211 (receiver)
Command ID: ad27eadf-7b2b-4d7c-b49a-501bec70f1f7

=== STDOUT ===


=== STDERR ===


=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0c0074019c3bb0211 (receiver)
Command ID: 95d4a15f-8095-4f5f-9fcd-469ca6eee35e

=== STDOUT ===


=== STDERR ===


=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0c0074019c3bb0211 (receiver)
Command ID: 19b9d58e-451c-404c-8bef-bca344f9f179

=== STDOUT ===


=== STDERR ===

⚠️ SSM Command Failures (sender-ssm-failure.log)

=== Polling timeout after 30s ===
Status: InProgress
Instance: i-0fe215a40cf0725d5 (sender)
Command ID: 5672beac-4ad7-4fb3-b34d-40c5509bf862

=== STDOUT ===


=== STDERR ===

Network & PCI State

receiver-network-interfaces.log

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:02:54:40:f1:5b brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0871afae832775857
    altname device-number-0.0
    inet 10.0.1.17/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 1868sec preferred_lft 1868sec
    inet6 fe80::2:54ff:fe40:f15b/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:cc:65:83:90 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

sender-network-interfaces.log

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:e0:9e:3d:13:49 brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0dd3e128730712788
    altname device-number-0.0
    inet 10.0.1.101/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 1890sec preferred_lft 1890sec
    inet6 fe80::e0:9eff:fe3d:1349/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:50:d6:ff:02 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

receiver-networking-diag-baseline.txt

=== NETWORKING DIAGNOSTICS ===
timestamp: 2026-08-14T13:49:09Z
hostname: ip-10-0-1-17.ec2.internal
kernel: 6.1.177-224.371.amzn2023.x86_64

=== DPDK PORT STATUS ===

Network devices using DPDK-compatible driver
============================================
0000:00:06.0 'Elastic Network Adapter (ENA) ec20' drv=vfio-pci unused=ena

Network devices using kernel driver
===================================
0000:00:05.0 'Elastic Network Adapter (ENA) ec20' if=ens5 drv=ena unused=vfio-pci *Active*

No 'Baseband' devices detected
==============================

No 'Crypto' devices detected
============================

No 'DMA' devices detected
=========================

No 'Eventdev' devices detected
==============================

No 'Mempool' devices detected
=============================

No 'Compress' devices detected
==============================

No 'Misc (rawdev)' devices detected
===================================

No 'Regex' devices detected
===========================

=== IP ADDRESSES ===
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:02:54:40:f1:5b brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0871afae832775857
    altname device-number-0.0
    inet 10.0.1.17/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 3072sec preferred_lft 3072sec
    inet6 fe80::2:54ff:fe40:f15b/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:cc:65:83:90 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

=== ARP TABLE ===
10.0.1.234 dev ens5 lladdr 02:55:96:4d:1b:f9 REACHABLE 
10.0.1.1 dev ens5 lladdr 02:ca:4b:a1:02:8f REACHABLE 

=== ROUTE TABLE ===
default via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.17 metric 512 
10.0.0.2 via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.17 metric 512 
10.0.1.0/24 dev ens5 proto kernel scope link src 10.0.1.17 metric 512 
10.0.1.1 dev ens5 proto dhcp scope link src 10.0.1.17 metric 512 
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 

=== IMDS: ENI INFORMATION ===
ENI MACs found: 02:02:54:40:f1:5b/ 02:bc:a9:ad:56:55/ 

--- ENI: 02:02:54:40:f1:5b/ ---
  device-number: 0
  local-ipv4s: 10.0.1.17
  subnet-id: subnet-08b270797ee19421e
  subnet-cidr: 10.0.1.0/24

--- ENI: 02:bc:a9:ad:56:55/ ---
  device-number: 1
  local-ipv4s: 10.0.1.141
  subnet-id: subnet-08b270797ee19421e
  subnet-cidr: 10.0.1.0/24


=== GATEWAY ARP TEST ===
Gateway IP: 10.0.1.1
Gateway ARP entry:
10.0.1.1 dev ens5 lladdr 02:ca:4b:a1:02:8f REACHABLE 

arping result:
ARPING 10.0.1.1 from 10.0.1.17 ens5
Unicast reply from 10.0.1.1 [02:CA:4B:A1:02:8F]  0.548ms
Sent 1 probes (1 broadcast(s))
Received 1 response(s)

=== HUGEPAGE STATUS ===
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
FileHugePages:         0 kB
HugePages_Total:    1024
HugePages_Free:     1024
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:         2097152 kB

=== VFIO STATUS ===
total 0
drwxr-xr-x.  2 root root       80 Aug 14 13:48 .
drwxr-xr-x. 14 root root     3100 Aug 14 13:48 ..
crw-------.  1 root root 243,   0 Aug 14 13:48 noiommu-0
crw-rw-rw-.  1 root root  10, 196 Aug 14 13:40 vfio

noiommu mode:
Y

=== DPDK SHARED MEMORY ===
no /var/run/dpdk/ directory (clean state)

=== DPDK-RELATED DMESG (last 30 lines) ===
[    0.066551] x86/fpu: Enabled xstate features 0x2ff, context size is 2568 bytes, using 'compacted' format.
[    0.073261] audit: type=2000 audit(1786714810.994:1): state=initialized audit_enabled=0 res=1
[    0.075693] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.099190] ACPI: Interpreter enabled
[    0.099190] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.124105] pci 0000:00:05.0: enabling Extended Tags
[    0.154963] SGI XFS with ACLs, security attributes, quota, no debug enabled
[    0.216829] ACPI: \_SB_.LNKD: Enabled at IRQ 11
[    0.268293] IPI shorthand broadcast: enabled
[    0.268353] AES CTR mode by8 optimization enabled
[    4.934806] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[    4.981323] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[    5.035303] VFIO - User Level meta-driver version: 0.3
[    6.407478] ena 0000:00:05.0: Elastic Network Adapter (ENA) v2.17.2g
[    6.424696] ena 0000:00:05.0: ENA device version: 0.10
[    6.425402] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1
[    6.534622] ena 0000:00:05.0: ENA Large LLQ is disabled
[    6.554344] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem c0500000, mac addr 02:02:54:40:f1:5b
[    6.714752] ena 0000:00:05.0 ens5: renamed from eth0
[    9.215509] ena 0000:00:05.0 ens5: Local page cache is disabled for less than 16 channels
[  491.615944] pci 0000:00:06.0: enabling Extended Tags
[  491.619530] ena 0000:00:06.0: enabling device (0000 -> 0002)
[  491.627502] ena 0000:00:06.0: ENA device version: 0.10
[  491.628208] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  491.727182] ena 0000:00:06.0: ENA Large LLQ is disabled
[  491.739275] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:bc:a9:ad:56:55
[  491.807198] ena 0000:00:06.0 ens6: renamed from eth0
[  492.106185] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  525.571890] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  525.573353] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device

=== DPDK-RELATED PROCESSES ===
no DPDK processes running

=== END DIAGNOSTICS ===

sender-networking-diag-baseline.txt

=== NETWORKING DIAGNOSTICS ===
timestamp: 2026-08-14T13:49:01Z
hostname: ip-10-0-1-101.ec2.internal
kernel: 6.1.177-224.371.amzn2023.x86_64

=== DPDK PORT STATUS ===

Network devices using DPDK-compatible driver
============================================
0000:00:06.0 'Elastic Network Adapter (ENA) ec20' drv=vfio-pci unused=ena

Network devices using kernel driver
===================================
0000:00:05.0 'Elastic Network Adapter (ENA) ec20' if=ens5 drv=ena unused=vfio-pci *Active*

No 'Baseband' devices detected
==============================

No 'Crypto' devices detected
============================

No 'DMA' devices detected
=========================

No 'Eventdev' devices detected
==============================

No 'Mempool' devices detected
=============================

No 'Compress' devices detected
==============================

No 'Misc (rawdev)' devices detected
===================================

No 'Regex' devices detected
===========================

=== IP ADDRESSES ===
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc mq state UP group default qlen 1000
    link/ether 02:e0:9e:3d:13:49 brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    altname eni-0dd3e128730712788
    altname device-number-0.0
    inet 10.0.1.101/24 metric 512 brd 10.0.1.255 scope global dynamic ens5
       valid_lft 3079sec preferred_lft 3079sec
    inet6 fe80::e0:9eff:fe3d:1349/64 scope link proto kernel_ll 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:50:d6:ff:02 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
       valid_lft forever preferred_lft forever

=== ARP TABLE ===
10.0.1.1 dev ens5 lladdr 02:ca:4b:a1:02:8f REACHABLE 
10.0.1.234 dev ens5 lladdr 02:55:96:4d:1b:f9 REACHABLE 

=== ROUTE TABLE ===
default via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.101 metric 512 
10.0.0.2 via 10.0.1.1 dev ens5 proto dhcp src 10.0.1.101 metric 512 
10.0.1.0/24 dev ens5 proto kernel scope link src 10.0.1.101 metric 512 
10.0.1.1 dev ens5 proto dhcp scope link src 10.0.1.101 metric 512 
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 

=== IMDS: ENI INFORMATION ===
ENI MACs found: 02:4a:80:7e:c1:a1/ 02:e0:9e:3d:13:49/ 

--- ENI: 02:4a:80:7e:c1:a1/ ---
  device-number: 1
  local-ipv4s: 10.0.1.179
  subnet-id: subnet-08b270797ee19421e
  subnet-cidr: 10.0.1.0/24

--- ENI: 02:e0:9e:3d:13:49/ ---
  device-number: 0
  local-ipv4s: 10.0.1.101
  subnet-id: subnet-08b270797ee19421e
  subnet-cidr: 10.0.1.0/24


=== GATEWAY ARP TEST ===
Gateway IP: 10.0.1.1
Gateway ARP entry:
10.0.1.1 dev ens5 lladdr 02:ca:4b:a1:02:8f REACHABLE 

arping result:
ARPING 10.0.1.1 from 10.0.1.101 ens5
Unicast reply from 10.0.1.1 [02:CA:4B:A1:02:8F]  0.541ms
Sent 1 probes (1 broadcast(s))
Received 1 response(s)

=== HUGEPAGE STATUS ===
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
FileHugePages:         0 kB
HugePages_Total:    1024
HugePages_Free:     1024
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:         2097152 kB

=== VFIO STATUS ===
total 0
drwxr-xr-x.  2 root root       80 Aug 14 13:48 .
drwxr-xr-x. 14 root root     3100 Aug 14 13:47 ..
crw-------.  1 root root 243,   0 Aug 14 13:48 noiommu-0
crw-rw-rw-.  1 root root  10, 196 Aug 14 13:40 vfio

noiommu mode:
Y

=== DPDK SHARED MEMORY ===
no /var/run/dpdk/ directory (clean state)

=== DPDK-RELATED DMESG (last 30 lines) ===
[    0.068387] x86/fpu: Enabled xstate features 0x2ff, context size is 2568 bytes, using 'compacted' format.
[    0.074859] audit: type=2000 audit(1786714810.867:1): state=initialized audit_enabled=0 res=1
[    0.077331] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.100991] ACPI: Interpreter enabled
[    0.100991] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.128368] pci 0000:00:05.0: enabling Extended Tags
[    0.166053] SGI XFS with ACLs, security attributes, quota, no debug enabled
[    0.196485] ACPI: \_SB_.LNKD: Enabled at IRQ 11
[    0.289161] IPI shorthand broadcast: enabled
[    0.289223] AES CTR mode by8 optimization enabled
[    5.524874] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[    5.564587] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[    5.669397] VFIO - User Level meta-driver version: 0.3
[    6.988248] ena 0000:00:05.0: Elastic Network Adapter (ENA) v2.17.2g
[    7.003546] ena 0000:00:05.0: ENA device version: 0.10
[    7.004311] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1
[    7.104654] ena 0000:00:05.0: ENA Large LLQ is disabled
[    7.116850] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem c0500000, mac addr 02:e0:9e:3d:13:49
[    7.294731] ena 0000:00:05.0 ens5: renamed from eth0
[    9.503517] ena 0000:00:05.0 ens5: Local page cache is disabled for less than 16 channels
[  451.687219] pci 0000:00:06.0: enabling Extended Tags
[  451.692328] ena 0000:00:06.0: enabling device (0000 -> 0002)
[  451.701954] ena 0000:00:06.0: ENA device version: 0.10
[  451.702672] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  451.795865] ena 0000:00:06.0: ENA Large LLQ is disabled
[  451.808203] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:4a:80:7e:c1:a1
[  451.866022] ena 0000:00:06.0 ens6: renamed from eth0
[  452.189040] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  519.270532] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  519.271838] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device

=== DPDK-RELATED PROCESSES ===
no DPDK processes running

=== END DIAGNOSTICS ===

⚠️ Crash Diagnostics

receiver-dmesg-crashes.log

[    0.073261] pid_max: default: 32768 minimum: 301
[    0.126195] iommu: Default domain type: Translated 
[    0.126909] NetLabel:  unlabeled traffic allowed by default
[    0.133261] PCI: CLS 0 bytes, default 64
[    0.235869] nvme nvme0: 2/0/0 default/read/poll queues
[    0.433247] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    0.433343] systemd[1]: No hostname configured, using default hostname.
[    0.518949] systemd[1]: Queued start job for default target initrd.target.
[    3.475226] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   15.131085] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[  564.308684] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:10052)
[  769.755615] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:13411)
[ 1608.632635] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:27585)

sender-dmesg-crashes.log

[    0.074837] pid_max: default: 32768 minimum: 301
[    0.130516] iommu: Default domain type: Translated 
[    0.131259] NetLabel:  unlabeled traffic allowed by default
[    0.144433] PCI: CLS 0 bytes, default 64
[    0.218943] nvme nvme0: 2/0/0 default/read/poll queues
[    0.455319] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    0.455413] systemd[1]: No hostname configured, using default hostname.
[    0.558036] systemd[1]: Queued start job for default target initrd.target.
[    3.661672] systemd[1]: systemd 252.23-12.amzn2023 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 -BZIP2 -LZ4 +XZ +ZLIB -ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   15.374952] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[ 1186.858099] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:21194)

Kernel Console (dmesg)

receiver-console-output.log (PCI/driver events only)

[  491.619530] ena 0000:00:06.0: enabling device (0000 -> 0002)
[  491.627502] ena 0000:00:06.0: ENA device version: 0.10
[  491.628208] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  491.727182] ena 0000:00:06.0: ENA Large LLQ is disabled
[  491.739275] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:bc:a9:ad:56:55
[  491.807198] ena 0000:00:06.0 ens6: renamed from eth0
[  492.106185] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  525.571890] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  525.573353] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[  564.308684] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:10052)
[  638.921777] vfio-pci 0000:00:06.0: Removing from iommu group 0
[  639.934992] ena 0000:00:06.0: ENA device version: 0.10
[  639.935737] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  640.035063] ena 0000:00:06.0: ENA Large LLQ is disabled
[  640.047664] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:bc:a9:ad:56:55
[  640.105102] ena 0000:00:06.0 ens6: renamed from eth0
[  640.146984] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  659.482863] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  659.484123] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[  769.755615] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:13411)
[  842.513223] vfio-pci 0000:00:06.0: Removing from iommu group 0
[  843.528451] ena 0000:00:06.0: ENA device version: 0.10
[  843.529158] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  843.630263] ena 0000:00:06.0: ENA Large LLQ is disabled
[  843.643674] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:bc:a9:ad:56:55
[  843.711962] ena 0000:00:06.0 ens6: renamed from eth0
[  843.773773] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[ 1473.076115] vfio-pci 0000:00:06.0: Adding to iommu group 0
[ 1473.077433] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[ 1608.632635] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:27585)

sender-console-output.log (PCI/driver events only)

[  519.270532] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  519.271838] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[  578.036625] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10894)
[  578.806534] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10914)
[  580.566506] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10936)
[  582.126480] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:10959)
[  582.916461] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:11019)
[  629.582383] vfio-pci 0000:00:06.0: Removing from iommu group 0
[  630.593365] ena 0000:00:06.0: ENA device version: 0.10
[  630.594141] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[  630.693343] ena 0000:00:06.0: ENA Large LLQ is disabled
[  630.706761] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:4a:80:7e:c1:a1
[  630.743509] ena 0000:00:06.0 ens6: renamed from eth0
[  630.785423] ena 0000:00:06.0 ens6: Local page cache is disabled for less than 16 channels
[  863.344283] vfio-pci 0000:00:06.0: Adding to iommu group 0
[  863.345689] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[ 1143.708671] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:20443)
[ 1186.858099] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (echo:21194)
[ 1247.439348] vfio-pci 0000:00:06.0: Removing from iommu group 0
[ 1248.452324] ena 0000:00:06.0: ENA device version: 0.10
[ 1248.453089] ena 0000:00:06.0: ENA controller version: 0.0.1 implementation version 1
[ 1248.549732] ena 0000:00:06.0: ENA Large LLQ is disabled
[ 1248.563471] ena 0000:00:06.0: Elastic Network Adapter (ENA) found at mem c0508000, mac addr 02:4a:80:7e:c1:a1
[ 1248.573498] ena 0000:00:06.0 eth0: Local page cache is disabled for less than 16 channels
[ 1380.566419] vfio-pci 0000:00:06.0: Adding to iommu group 0
[ 1380.567727] vfio-pci 0000:00:06.0: Adding kernel taint for vfio-noiommu group on device
[ 1624.491959] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:38456)
[ 1625.251835] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:38496)
[ 1627.021839] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:38803)
[ 1628.781860] vfio-pci 0000:00:06.0: vfio-noiommu device opened by user (tokio-rt-worker:38876)

github-actions · 2026-08-14T14:13:03Z

✅ Integration Tests Passed — Graviton (run)

Branch: 114/merge | Commit: e91834aa

Test Results

tier1-dpdk-echo.xml: 6 tests, 0 failures
tier2-kernel-interop.xml: 4 tests, 0 failures
tier3-iperf-sends.xml: 1 tests, 0 failures
tier3-our-app-sends.xml: 1 tests, 0 failures

Application Logs (last 20 lines)

receiver-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.119:9000 (MAC: 02:92:63:06:03:97)
echo listening on 10.0.1.119:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-echo-server.log

EAL: Detected CPU lcores: 2
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
EAL: Using IOMMU type 8 (No-IOMMU)
EAL: Probe PCI driver: net_ena (1d0f:ec20) device: 0000:00:06.0 (socket -1)
TELEMETRY: No legacy callbacks, legacy socket not created
Warning: Some RX offloads not supported by device (flags: 0x1)
Warning: Some TX offloads not supported by device (flags: 0x1)
✅ DPDK UDP socket bound to 10.0.1.108:9000 (MAC: 02:3b:a8:a1:77:71)
echo listening on 10.0.1.108:9000 (MTU=9001, max_udp_payload=8973)
Shutting down gracefully...

sender-test-client.log

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: VFIO support initialized
TELEMETRY: No legacy callbacks, legacy socket not created
DPDK bind failed (Port init failed: Invalid port ID: 0), falling back to tokio
Backend: tokio
Sending packets...
Sent 12 bytes: 'arp-probe #1'
Received 12 bytes from 10.0.1.119:9000: 'arp-probe #1'
Test complete
[2026-08-14T13:59:03Z] INFO: ARP resolution succeeded (got response from peer)
[2026-08-14T13:59:03Z] INFO: Test: udp_send_receive
[2026-08-14T13:59:04Z] INFO: UDP send/receive succeeded
[2026-08-14T13:59:04Z] INFO: Test: echo_roundtrip
[2026-08-14T13:59:05Z] INFO: Echo roundtrip succeeded: 5/5 responses received
[2026-08-14T13:59:05Z] INFO: Test: payload_integrity
[2026-08-14T13:59:05Z] INFO: Response received, checking payload match...
[2026-08-14T13:59:05Z] INFO: Payload integrity verified (found in response)
[2026-08-14T13:59:05Z] INFO: JUnit XML written to: /tmp/test-results/tier2-kernel-interop.xml
[2026-08-14T13:59:05Z] INFO: Tier 2 sender tests complete. Results: /tmp/test-results/tier2-kernel-interop.xml

docs: mark ROADMAP item #33 complete (PR #114)

244e4f9

gspivey merged commit 16c6647 into development Aug 14, 2026
1 check passed

Conversation

gspivey commented Aug 14, 2026

Summary

Spec Reference

Features

Tests

Tradeoffs

Uh oh!

github-actions Bot commented Aug 14, 2026

Synthetic Performance Results (run)

Synthetic UDP Performance Results

IPv4 Baseline

IPv6

IPv6 vs IPv4 Comparison (sync path)

Uh oh!

github-actions Bot commented Aug 14, 2026

Synthetic Performance Results — Graviton (run)

Synthetic UDP Performance Results

IPv4 Baseline

IPv6

IPv6 vs IPv4 Comparison (sync path)

Uh oh!

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Deploy

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Deploy

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Summary

Uh oh!

github-actions Bot commented Aug 14, 2026

✅ Integration Tests Passed (Run 31803122296)

Test Results

Application Logs (last 20 lines)

receiver-echo-server.log

sender-echo-server.log

sender-test-client.log

receiver-test-client-iperf.log

sender-test-client-iperf.log

receiver-network-interfaces.log

sender-network-interfaces.log

receiver-networking-diag-baseline.txt

sender-networking-diag-baseline.txt

receiver-dmesg-crashes.log

sender-dmesg-crashes.log

receiver-console-output.log (PCI/driver events only)

sender-console-output.log (PCI/driver events only)

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Summary

Uh oh!

github-actions Bot commented Aug 14, 2026

Synthetic Performance Results (run)

Synthetic UDP Performance Results

IPv4 Baseline

IPv6

IPv6 vs IPv4 Comparison (sync path)

Uh oh!

github-actions Bot commented Aug 14, 2026

✅ Integration Tests Passed — Graviton (run)

Test Results

Application Logs (last 20 lines)

Uh oh!

github-actions Bot commented Aug 14, 2026

Synthetic Performance Results — Graviton (run)

Synthetic UDP Performance Results

IPv4 Baseline

IPv6

IPv6 vs IPv4 Comparison (sync path)

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Deploy

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Deploy

Uh oh!

github-actions Bot commented Aug 14, 2026

[CI] Stage: Summary