Skip to content
Unverified Commit 3ee63a84 authored by Russell Cohen's avatar Russell Cohen Committed by GitHub
Browse files

Fix the middleware benchmark and rerun (#2840)

## Motivation and Context
Rerun the middleware benchmark.

Results:
```
    Finished bench [optimized + debuginfo] target(s) in 3.77s
     Running benches/middleware_vs_orchestrator.rs (/Users/rcoh/code/smithy-rs/target/release/deps/middleware_vs_orchestrator-eec2a5ed375836b0)
compare/middleware (HEAD)/S3 ListObjectsV2
                        time:   [27.887 µs 27.956 µs 28.030 µs]
                        change: [+22.004% +22.457% +22.923%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe
compare/middleware (last_release)/S3 ListObjectsV2
                        time:   [22.076 µs 22.122 µs 22.176 µs]
                        change: [-3.1947% -2.7875% -2.4454%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  5 (5.00%) high mild
  2 (2.00%) high severe
compare/orchestrator/S3 ListObjectsV2
                        time:   [27.711 µs 27.764 µs 27.821 µs]
                        change: [-11.548% -11.313% -11.097%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
  6 (6.00%) high mild
  3 (3.00%) high severe
```

## Description
- The fixup plugin is not required anymore.
- Added a readme with instructions
## Testing
- ran the benchmark


----

_By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice._
parent abd01157
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment