mirrors
/
pulumi
mirror of https://github.com/pulumi/pulumi.git
0
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
pulumi/tests/performance
History
Julien 814aea30ff
Switch to pyproject.toml + uv (#18081) 
Switch from setup.py to pyproject.toml, and from pip+venv to uv.

This gets rid of "build" folder `env` for the Python SDK. Python does
not have to be built, and the SDK can be installed directly from
`sdk/python`, with or without the `--editable` flag. Previously having a
"build" output helped with the SDK version, but this was previously
addressed when we added the version in the source in
https://github.com/pulumi/pulumi/pull/15713.

In a follow up PR we can move ruff and mypy config into
`pyproject.toml`.
 		2024-12-27 13:53:42 +00:00
..
python Add simple performance gate to integration tests (#17364) 2024-11-04 21:26:27 +00:00
README.md Add simple performance gate to integration tests (#17364) 2024-11-04 21:26:27 +00:00
performance_test.go Switch to pyproject.toml + uv (#18081) 2024-12-27 13:53:42 +00:00

README.md

Performance Tests

This package contains basic performance tests for the Pulumi CLI. These tests are intended to run as part of pull request and prevent us from introducing major performance regressions.

The cli-performance-metrics repository contains more comprehensive performance tests that regularly run as a cron job.

Thresholds

The thresholds used to determine if a test has passed or failed are highly dependent on the GitHub Actions Runners. Initial thresholds have been set by running the tests multiple times, taking the slowest run, and adding 10% (rounded to 100ms). These thresholds are not perfect and may need to be adjusted over time.

Running the Tests

From the root of the repository, run:

make test_performance