History

bors[bot] 5562de4ced Merge #11069 11069: ci: Implement smoke tests for pkg/cmd, fix examples smoke tests r=AaronFriel a=AaronFriel Mitigate test timeouts on Windows ([recent job that timed out](https://github.com/pulumi/pulumi/actions/runs/3276024063)) and long test delays due to non-parallelizable tests on macOS. For context: integration tests run on Linux and run all tests, the smoke tests are a subset of tests that run on macOS & Windows which set the build tag "smoke", causing some test files to be skipped. These tests tend to come in pairs of files, `_test.go` and `_smoke_test.go`. This PR fixes the `examples_test.go` which had the build flags reversed, and moves one test which checks stdout behavior to the smoke tests. This PR also adds smoke test files for `pkg/cmd` to move some tests onto the Linux runners only, which we run with greater parallelism. This removes some of the slower and non-parallelizable tests from the Windows runner, which was one of the slowest jobs: ``` TestCreatingPolicyPackWithPromptedName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 1m27.23s pass TestCreatingPolicyPackWithArgsSpecifiedName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 1m21.08s pass TestCreatingStackWithArgsSpecifiedName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 29.15s pass TestCreatingProjectWithPromptedName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 25.74s pass TestCreatingProjectWithArgsSpecifiedName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 25.4s pass TestCreatingStackWithArgsSpecifiedOrgName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 25.[33](https://github.com/pulumi/pulumi/actions/runs/3275822919/jobs/5391232488#step:39:34)s pass TestCreatingProjectWithPulumiBackendURL github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 25.33s pass TestCreatingStackWithArgsSpecifiedFullNameSucceeds github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 25.06s pass TestCreatingStackWithPromptedOrgName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 25.06s pass TestCreatingStackWithPromptedName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 24.88s pass TestCreatingProjectWithDefaultName github.com/pulumi/pulumi/pkg/v3/cmd/pulumi 24.76s pass ``` Co-authored-by: Aaron Friel <mayreply@aaronfriel.com>		2022-10-21 02:23:41 +00:00
..
benchmarks/go-alias-norm	ci: Simplify test listing, update go dependencies to 1.18 compat	2022-09-21 09:51:59 -07:00
examples	ci: Implement smoke tests for pkg/cmd, fix examples	2022-10-17 22:07:47 -07:00
integration	Inherit the providers map between components	2022-10-20 15:35:50 -07:00
testprovider	ci: Simplify test listing, update go dependencies to 1.18 compat	2022-09-21 09:51:59 -07:00
.gitignore	ci: Use reduced smoke testing on Windows & macOS targets	2022-09-21 09:55:06 -07:00
README.md	Update tests and add integration test	2021-08-24 14:29:27 -07:00
about_test.go	test: fix regex used to test Go version output in about command. (#10499 )	2022-08-29 11:53:03 -07:00
config_test.go	Add array config to test that the array is marshalled/unmarshalled correctly	2022-10-06 12:33:28 +02:00
go.mod	Update dependencies	2022-10-15 01:06:02 +00:00
go.sum	Run make tidy	2022-10-04 22:00:13 +01:00
history_test.go	ci: gofmt 1.18+ clean	2022-09-21 09:48:39 -07:00
login_test.go	ci: radical idea - what if slow tests & no stdout makes GH consider runner dead?	2022-03-06 14:52:13 -08:00
main_test.go	[breaking] Changing the version of go.mod in sdk / pkg to be v3	2021-04-14 19:32:18 +01:00
stack_test.go	refactor: use `os.ReadDir` for lightweight directory reading	2022-09-24 15:20:43 +08:00

README.md

Integration Tests

This module provides integration tests for the Pulumi CLI.

The tests can be run via:

make test_all