mirror of
https://github.com/sharkdp/hyperfine.git
synced 2026-11-20 11:21:39 +00:00
Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
9cc442567a | ||
|
|
352c504d3f |
No files matched your search
+6
-15
@@ -4,23 +4,14 @@ This folder contains scripts that can be used in combination with hyperfines `--
|
|||||||
|
|
||||||
```bash
|
```bash
|
||||||
hyperfine 'sleep 0.020' 'sleep 0.021' 'sleep 0.022' --export-json sleep.json
|
hyperfine 'sleep 0.020' 'sleep 0.021' 'sleep 0.022' --export-json sleep.json
|
||||||
./plot_whisker.py sleep.json
|
uv run plot_whisker.py sleep.json
|
||||||
```
|
```
|
||||||
|
|
||||||
### Pre-requisites
|
### Pre-requisites
|
||||||
|
|
||||||
To make these scripts work, you will need `numpy`, `matplotlib` and `scipy`.
|
Install [`uv`](https://docs.astral.sh/uv/getting-started/installation/) and run the
|
||||||
|
commands above from this directory.
|
||||||
|
|
||||||
If you have a Python package manager that understands [PEP-723](https://peps.python.org/pep-0723/)
|
The scripts declare their dependencies using [PEP 723](https://peps.python.org/pep-0723/)
|
||||||
inline script requirements like [`uv`](https://github.com/astral-sh/uv) or [`pipx`](https://github.com/pypa/pipx),
|
inline script metadata. `uv run` automatically installs these dependencies in an
|
||||||
you can directly run the scripts using
|
isolated environment before running the script.
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run plot_whisker.py sleep.json
|
|
||||||
```
|
|
||||||
|
|
||||||
Otherwise, install the dependencies via your system package manager or using `pip`:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
pip install numpy matplotlib scipy # pip3, if you are using python3
|
|
||||||
```
|
|
||||||
@@ -7,7 +7,8 @@
|
|||||||
# ///
|
# ///
|
||||||
|
|
||||||
"""This script performs Welch's t-test on a JSON export file with two
|
"""This script performs Welch's t-test on a JSON export file with two
|
||||||
benchmark results to test for a difference in their population mean runtimes."""
|
benchmark results to test whether or not the two distributions are
|
||||||
|
the same."""
|
||||||
|
|
||||||
import argparse
|
import argparse
|
||||||
import json
|
import json
|
||||||
@@ -39,10 +40,6 @@ print(f"t = {t:.3}, p = {p:.3}")
|
|||||||
print()
|
print()
|
||||||
|
|
||||||
if dispose:
|
if dispose:
|
||||||
print(
|
print(f"There is a difference between the two benchmarks (p < {th}).")
|
||||||
f"A statistically significant difference in mean runtime was detected (p < {th})."
|
|
||||||
)
|
|
||||||
else:
|
else:
|
||||||
print(
|
print(f"The two benchmarks are almost the same (p >= {th}).")
|
||||||
f"No statistically significant difference in mean runtime was detected (p >= {th})."
|
|
||||||
)
|
|
||||||
Reference in new issue
Block a user