Skip to content

Benchmarks for dotnet/runtime#134783 (for @EgorBo) #623

Description

@EgorBot

Processing benchmark request from PR dotnet/runtime#134783.

Targets: windows_azure_emeraldrapids, ubuntu24_azure_turin, macos15_helix_arm64, ubuntu24_azure_cobalt100
Commits: main;PR_134783

Results will be posted here once they are ready.

Activity

  1. EgorBot commented on Sep 28, 2026

    @EgorBot
    OwnerAuthor

    Results for macos15_helix_arm64

    @EgorBo

    BenchmarkDotNet v0.16.0-preview.1, macOS Sequoia 15.7.5 (24G624) [Darwin 24.6.0]
    Apple M4, 1 CPU, 10 logical and 10 physical cores
    Memory: 16 GB Total, 2.94 GB Available
    .NET SDK 11.0.100-rtm.26473.115
      [Host]     : .NET 11.0.0 (11.0.0-rtm.26473.115, 11.0.26.47415), Arm64 RyuJIT armv8.0-a
    
    Method Toolchain Mean Error Ratio
    Lookup main 3.558 ns 0.0609 ns 1.23
    Lookup PR #134783 2.886 ns 0.0021 ns 1.00
    Profiling artifacts

    Bench.Lookup:

    main PR_134783
    asm link link
    speedscope link link

    Full logs

  2. EgorBot commented on Sep 28, 2026

    @EgorBot
    OwnerAuthor

    ubuntu24_azure_cobalt100 — Failed

    @EgorBo

    Agent failed with exit code 1

    Job | Full logs

  3. EgorBot commented on Sep 29, 2026

    @EgorBot
    OwnerAuthor

    Results for ubuntu24_azure_turin

    @EgorBo

    BenchmarkDotNet v0.16.0-preview.1, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
    AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
    Memory: 31.34 GB Total, 8.36 GB Available
    .NET SDK 11.0.100-rtm.26473.115
      [Host]     : .NET 11.0.0 (11.0.0-rtm.26473.115, 11.0.26.47415), X64 RyuJIT x86-64-v4
    
    Method Toolchain Mean Error Ratio
    Lookup main 3.918 ns 0.0224 ns 1.25
    Lookup PR #134783 3.144 ns 0.0062 ns 1.00
    Profiling artifacts

    Supported perf events on this machine: perf_events.txt

    Bench.Lookup:

    main PR_134783
    flamegraph link link
    functions link link
    asm link link
    stats link link
    speedscope link link

    Full logs

  4. EgorBo commented on Sep 29, 2026

    @EgorBo

    Ugh. not sure why Cobalt-100 failed to build, it's something new

    2026-09-28 23:52:54.316  /home/egorbot_work/.dotnet/NUGET_PACKAGES/microsoft.net.compilers.toolset/5.12.0-1.26471.108/tasks/netcore/Microsoft.CSharp.Core.targets(97,5): error MSB3883: Unexpected exception:  [/home/egorbot_work/runtime/src/libraries/System.Reflection.DispatchProxy/ref/System.Reflection.DispatchProxy.csproj]
    2026-09-28 23:52:54.316  /home/egorbot_work/.dotnet/NUGET_PACKAGES/microsoft.net.compilers.toolset/5.12.0-1.26471.108/tasks/netcore/Microsoft.CSharp.Core.targets(97,5): error : Cannot release a lock that is not owned by the current thread. [/home/egorbot_work/runtime/src/libraries/System.Reflection.DispatchProxy/ref/System.Reflection.DispatchProxy.csproj]
    2026-09-28 23:52:54.316  /home/egorbot_work/.dotnet/NUGET_PACKAGES/microsoft.net.compilers.toolset/5.12.0-1.26471.108/tasks/netcore/Microsoft.CSharp.Core.targets(97,5): error MSB3883: Unexpected exception:  [/home/egorbot_work/runtime/src/libraries/shims/System.Security.Cryptography.Encoding/src/System.Security.Cryptography.Encoding.csproj]
    2026-09-28 23:52:54.316  /home/egorbot_work/.dotnet/NUGET_PACKAGES/microsoft.net.compilers.toolset/5.12.0-1.26471.108/tasks/netcore/Microsoft.CSharp.Core.targets(97,5): error : Cannot release a lock that is not owned by the current thread. [/home/egorbot_work/runtime/src/libraries/shims/System.Security.Cryptography.Encoding/src/System.Security.Cryptography.Encoding.csproj]
    

    dotnet.sh build-server shutdown was supposed to kill everything before 2nd build.

  5. EgorBot commented on Sep 29, 2026

    @EgorBot
    OwnerAuthor

    Results for windows_azure_emeraldrapids

    @EgorBo

    
    BenchmarkDotNet v0.16.0-preview.1, Windows 11 (10.0.26100.33438/24H2/2024Update/HudsonValley) (Hyper-V)
    INTEL XEON PLATINUM 8573C 2.30GHz, 1 CPU, 8 logical and 4 physical cores
    Memory: 31.99 GB Total, 25.14 GB Available
    .NET SDK 11.0.100-rtm.26473.115
      [Host]     : .NET 11.0.0 (11.0.0-rtm.26473.115, 11.0.26.47415), X64 RyuJIT x86-64-v4
    
    
    
    Method Toolchain Mean Error Ratio
    Lookup main 6.711 ns 0.0454 ns 1.34
    Lookup PR #134783 5.005 ns 0.0658 ns 1.00
    BDN profiler traces (speedscope)

    Full logs

  6. EgorBo commented on Sep 29, 2026

    @EgorBo

    @EgorBot -windows_intel -osx_arm

    using System;
    using System.Collections.Generic;
    using BenchmarkDotNet.Attributes;
    using BenchmarkDotNet.Running;
    
    BenchmarkSwitcher.FromAssembly(typeof(Bench).Assembly).Run(args);
    
    public class Bench {
        private readonly Dictionary<Type, int> _dictionary = new() { [typeof(string)] = 42 };
    
        [Benchmark]
        public int Lookup() => _dictionary[typeof(string)];
    }
  7. EgorBot commented on Sep 29, 2026

    @EgorBot
    OwnerAuthor

    Benchmark job submitted. The results will be posted here once they are ready.

  8. EgorBot commented on Sep 29, 2026

    @EgorBot
    OwnerAuthor

    Results for macos15_helix_arm64

    @EgorBo

    BenchmarkDotNet v0.16.0-preview.1, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
    Apple M4, 1 CPU, 10 logical and 10 physical cores
    Memory: 16 GB Total, 2.7 GB Available
    .NET SDK 11.0.100-rtm.26473.115
      [Host]     : .NET 11.0.0 (11.0.0-rtm.26473.115, 11.0.26.47415), Arm64 RyuJIT armv8.0-a
    
    Method Toolchain Mean Error Ratio
    Lookup main 3.647 ns 0.0717 ns 1.27
    Lookup PR #134783 2.881 ns 0.0009 ns 1.00

    Full logs

  9. EgorBot commented on Sep 29, 2026

    @EgorBot
    OwnerAuthor

    Results for windows_azure_emeraldrapids

    @EgorBo

    
    BenchmarkDotNet v0.16.0-preview.1, Windows 11 (10.0.26100.33438/24H2/2024Update/HudsonValley) (Hyper-V)
    INTEL XEON PLATINUM 8573C 2.30GHz, 1 CPU, 8 logical and 4 physical cores
    Memory: 31.99 GB Total, 25.17 GB Available
    .NET SDK 11.0.100-rtm.26473.115
      [Host]     : .NET 11.0.0 (11.0.0-rtm.26473.115, 11.0.26.47415), X64 RyuJIT x86-64-v4
    
    
    
    Method Toolchain Mean Error Ratio
    Lookup main 5.961 ns 0.0108 ns 1.38
    Lookup PR #134783 4.323 ns 0.0078 ns 1.00

    Full logs

  10. added a commit that references this issue on Sep 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions