Regressions in System.Text.Tests.Perf_StringBuilder

### Run Information

Name | Value
-- | --
Architecture | arm64
OS | Windows 10.0.19041
Queue | SurfaceWindows
Baseline | [90d0d5ce4e4fdf17209d6a4e4a96d62865e2b88f](https://github.com/dotnet/runtime/commit/90d0d5ce4e4fdf17209d6a4e4a96d62865e2b88f)
Compare | [171cc096368e463aae061188f4b17063b6577f3c](https://github.com/dotnet/runtime/commit/171cc096368e463aae061188f4b17063b6577f3c)
Diff | [Diff](https://github.com/dotnet/runtime/compare/90d0d5ce4e4fdf17209d6a4e4a96d62865e2b88f...171cc096368e463aae061188f4b17063b6577f3c)
Configs | CompilationMode:tiered, RunKind:micro


### Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Append_Char - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Text.Tests.Perf_StringBuilder.Append_Char(length%3a%20100000).html>) | 348.51 μs | 376.31 μs | 1.08 | 0.00 | False | | |
[Append_Char_Capacity - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length%3a%20100).html>) | 336.66 ns | 375.68 ns | 1.12 | 0.15 | False | | |
[Append_Char - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Text.Tests.Perf_StringBuilder.Append_Char(length%3a%20100).html>) | 423.54 ns | 454.63 ns | 1.07 | 0.03 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/04_20_2023/refs/heads/main_arm64_Windows%2010.0.19041_Regression/System.Text.Tests.Perf_StringBuilder_1.png>)
![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/04_20_2023/refs/heads/main_arm64_Windows%2010.0.19041_Regression/System.Text.Tests.Perf_StringBuilder_2.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/04_20_2023/refs/heads/main_arm64_Windows%2010.0.19041_Regression/System.Text.Tests.Perf_StringBuilder.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-472aa64c-75b8-46f2-aca6-4f8e2210437d0ecb7b7f5344ea998/affb495f-cebf-4b81-b664-823632a8ec5e.zip?sv=2021-08-06&se=2023-05-18T09%3A21%3A42Z&sr=c&sp=rl&sig=8ZJH6DZXG%2B6uR8dAvgNIek%2F96f%2FsaqDSrD9HIFQBaHE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-627d0274-37c7-427a-9d49-431707794651d1ab06dbee8428e97/7d39c81b-2f01-4e8a-871d-0c9f1d16cb83.zip?sv=2021-08-06&se=2023-05-19T05%3A08%3A17Z&sr=c&sp=rl&sig=DVLH1Ot6CWiH8x3jwBXJjVbyoX%2FsH3tdARnZgZYgItw%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-472aa64c-75b8-46f2-aca6-4f8e2210437d0ecb7b7f5344ea998/affb495f-cebf-4b81-b664-823632a8ec5e.zip?sv=2021-08-06&se=2023-05-18T09%3A21%3A42Z&sr=c&sp=rl&sig=8ZJH6DZXG%2B6uR8dAvgNIek%2F96f%2FsaqDSrD9HIFQBaHE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-627d0274-37c7-427a-9d49-431707794651d1ab06dbee8428e97/7d39c81b-2f01-4e8a-871d-0c9f1d16cb83.zip?sv=2021-08-06&se=2023-05-19T05%3A08%3A17Z&sr=c&sp=rl&sig=DVLH1Ot6CWiH8x3jwBXJjVbyoX%2FsH3tdARnZgZYgItw%3D>)
### Histogram

#### System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100000)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 376.3114158163266 > 365.82595961174246.
IsChangePoint: Marked as a change because one of 1/13/2023 9:23:19 AM, 4/18/2023 4:36:42 PM, 4/20/2023 12:14:19 AM falls between 4/11/2023 5:52:15 AM and 4/20/2023 12:14:19 AM.
IsRegressionStdDev: Marked as regression because -16.551131157452918 (T) = (0 -377693.31864449196) / Math.Sqrt((420184.3680689702 / (22)) + (9432253.788784707 / (3))) is less than -2.0686576104106944 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (3) - 2, .025) and -0.08452605241462319 = (348256.5659013756 - 377693.31864449196) / 348256.5659013756 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 375.6761378301643 > 360.32857008143276.
IsChangePoint: Marked as a change because one of 1/6/2023 8:14:14 AM, 1/9/2023 8:29:54 AM, 4/11/2023 8:14:56 PM, 4/12/2023 8:39:35 PM, 4/20/2023 12:14:19 AM falls between 4/11/2023 5:52:15 AM and 4/20/2023 12:14:19 AM.
IsRegressionStdDev: Marked as regression because -3.5226259599846825 (T) = (0 -365.00712988468325) / Math.Sqrt((2526.8485910935938 / (16)) + (180.17720232503117 / (9))) is less than -2.0686576104106944 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (9) - 2, .025) and -0.1477621898329491 = (318.0163392015973 - 365.00712988468325) / 318.0163392015973 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 454.6304877215586 > 444.57494659549667.
IsChangePoint: Marked as a change because one of 1/13/2023 9:23:19 AM, 4/18/2023 4:36:42 PM, 4/20/2023 12:14:19 AM falls between 4/11/2023 5:52:15 AM and 4/20/2023 12:14:19 AM.
IsRegressionStdDev: Marked as regression because -12.119675762173632 (T) = (0 -456.60182330002726) / Math.Sqrt((2.0634675639586324 / (22)) + (21.97562454622443 / (3))) is less than -2.0686576104106944 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (3) - 2, .025) and -0.0779323194845729 = (423.59043795843996 - 456.60182330002726) / 423.59043795843996 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```


### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | arm64
OS | Windows 10.0.19041
Queue | SurfaceWindows
Baseline | [90d0d5ce4e4fdf17209d6a4e4a96d62865e2b88f](https://github.com/dotnet/runtime/commit/90d0d5ce4e4fdf17209d6a4e4a96d62865e2b88f)
Compare | [171cc096368e463aae061188f4b17063b6577f3c](https://github.com/dotnet/runtime/commit/171cc096368e463aae061188f4b17063b6577f3c)
Diff | [Diff](https://github.com/dotnet/runtime/compare/90d0d5ce4e4fdf17209d6a4e4a96d62865e2b88f...171cc096368e463aae061188f4b17063b6577f3c)
Configs | CompilationMode:tiered, RunKind:micro


### Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[ToStringD - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_Windows 10.0.19041/System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString%3a%20123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678.html>) | 1.08 μs | 1.23 μs | 1.14 | 0.01 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/04_20_2023/refs/heads/main_arm64_Windows%2010.0.19041_Regression/System.Numerics.Tests.Perf_BigInteger_1.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/04_20_2023/refs/heads/main_arm64_Windows%2010.0.19041_Regression/System.Numerics.Tests.Perf_BigInteger.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-472aa64c-75b8-46f2-aca6-4f8e2210437d0ecb7b7f5344ea998/affb495f-cebf-4b81-b664-823632a8ec5e.zip?sv=2021-08-06&se=2023-05-18T09%3A21%3A42Z&sr=c&sp=rl&sig=8ZJH6DZXG%2B6uR8dAvgNIek%2F96f%2FsaqDSrD9HIFQBaHE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-627d0274-37c7-427a-9d49-431707794651d1ab06dbee8428e97/7d39c81b-2f01-4e8a-871d-0c9f1d16cb83.zip?sv=2021-08-06&se=2023-05-19T05%3A08%3A17Z&sr=c&sp=rl&sig=DVLH1Ot6CWiH8x3jwBXJjVbyoX%2FsH3tdARnZgZYgItw%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-472aa64c-75b8-46f2-aca6-4f8e2210437d0ecb7b7f5344ea998/affb495f-cebf-4b81-b664-823632a8ec5e.zip?sv=2021-08-06&se=2023-05-18T09%3A21%3A42Z&sr=c&sp=rl&sig=8ZJH6DZXG%2B6uR8dAvgNIek%2F96f%2FsaqDSrD9HIFQBaHE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-627d0274-37c7-427a-9d49-431707794651d1ab06dbee8428e97/7d39c81b-2f01-4e8a-871d-0c9f1d16cb83.zip?sv=2021-08-06&se=2023-05-19T05%3A08%3A17Z&sr=c&sp=rl&sig=DVLH1Ot6CWiH8x3jwBXJjVbyoX%2FsH3tdARnZgZYgItw%3D>)
### Histogram

#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2269396890987798 > 1.1300912314584055.
IsChangePoint: Marked as a change because one of 3/16/2023 8:14:39 PM, 4/12/2023 8:39:35 PM, 4/17/2023 8:43:19 PM, 4/18/2023 4:36:42 PM, 4/20/2023 12:14:19 AM falls between 4/11/2023 5:52:15 AM and 4/20/2023 12:14:19 AM.
IsRegressionStdDev: Marked as regression because -4.23118481917327 (T) = (0 -1181.9682606397707) / Math.Sqrt((474.9401479837475 / (22)) + (1516.982266277931 / (3))) is less than -2.0686576104106944 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (3) - 2, .025) and -0.08956024864432494 = (1084.812209430753 - 1181.9682606397707) / 1084.812209430753 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```


### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Navigation Menu

Repository navigation

Regressions in System.Text.Tests.Perf_StringBuilder #92073

Run Information