pulumi/tests/integration
Paul C. Roberts b72399bd28
The `--expect-no-changes` flag checks for output diffs (#15903)
<!--- 
Thanks so much for your contribution! If this is your first time
contributing, please ensure that you have read the
[CONTRIBUTING](https://github.com/pulumi/pulumi/blob/master/CONTRIBUTING.md)
documentation.
-->

# Description

<!--- Please include a summary of the change and which issue is fixed.
Please also include relevant motivation and context. -->
This adds a pseudo op `OpOutputChange` to the set of changes that are
recorded in `display.ResourceChanges` to count the number of output
changes, this is then included in the check used to evaluate the
`--expect-no-changes` flag

When resource outputs are registered, they are checked against their
previous value using existing functionality, the total count of changes
is then added

The internal capability is validated with an engine test, the cli is
validated using an integration test

This will break user workflows that depend on the previous behavior

Fixes #15564

## Checklist

- [X] I have run `make tidy` to update any new dependencies
- [X] I have run `make lint` to verify my code passes the lint check
  - [ ] I have formatted my code using `gofumpt`

<!--- Please provide details if the checkbox below is to be left
unchecked. -->
- [X] I have added tests that prove my fix is effective or that my
feature works
<!--- 
User-facing changes require a CHANGELOG entry.
-->
- [X] I have run `make changelog` and committed the
`changelog/pending/<file>` documenting my change
<!--
If the change(s) in this PR is a modification of an existing call to the
Pulumi Cloud,
then the service should honor older versions of the CLI where this
change would not exist.
You must then bump the API version in
/pkg/backend/httpstate/client/api.go, as well as add
it to the service.
-->
- [ ] Yes, there are changes in this PR that warrants bumping the Pulumi
Cloud API version
<!-- @Pulumi employees: If yes, you must submit corresponding changes in
the service repo. -->

---------

Co-authored-by: Paul Roberts <proberts@pulumi.com>
2024-05-01 18:30:49 +00:00
..
about Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
aliases Remove deprecated Protobufs imports (#15158) 2024-01-17 09:35:20 +00:00
backend/diy Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
cloud_secrets_provider Enable full strict mode. (#3218) 2019-09-11 16:21:35 -07:00
component_provider_schema Add RunPlugin support for python 2023-03-06 21:35:39 +00:00
config_basic Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
config_capture_e2e/nodejs Revert package.json lookup fix. 2023-05-15 14:14:57 -04:00
config_missing Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
config_secrets_warn Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_configure_provider Changelog and go.mod updates for v3.114.0 (#16075) 2024-04-27 00:39:30 +00:00
construct_component_error_apply Update @types/node version in tests 2023-02-07 14:20:27 +00:00
construct_component_id_output [python/sdk] Allow remote components to use output property called id (#15115) 2024-01-18 13:54:09 +00:00
construct_component_methods Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_methods_errors Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_methods_provider Bump the go_modules group across 5 directories with 1 update (#16054) 2024-04-25 21:11:41 +00:00
construct_component_methods_resources Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_methods_unknown Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_output_values Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_plain Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_provider Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_provider_explicit Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_provider_propagation Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_resource_options Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
construct_component_slow Update @types/node version in tests 2023-02-07 14:20:27 +00:00
construct_component_unknown Bump the go_modules group across 5 directories with 1 update (#16054) 2024-04-25 21:11:41 +00:00
construct_nested_component/go Bump go modules (#16051) 2024-04-25 14:30:00 +00:00
custom_timeouts Rename "Smoke" test to "Acceptance" tests 2023-01-30 15:38:37 -05:00
delete_before_create Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
deleted_with Bump the go_modules group across 5 directories with 1 update (#16054) 2024-04-25 21:11:41 +00:00
dependency_steps Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
double_pending_delete Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
duplicate_urns Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
dynamic Support serialising reserved NodeJS identifiers (#15879) 2024-04-10 15:12:43 +00:00
ee_perf Use prefered `new pulumi.Config()` form 2019-01-31 16:11:57 -08:00
empty Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
enums [tests/integration] Remove `pulumi` from `requirements.txt` (#15226) 2024-01-24 14:16:40 +00:00
environments_basic [environments] Add integration tests (#14144) 2023-10-12 16:39:26 +00:00
environments_merge [environments] Add integration tests (#14144) 2023-10-12 16:39:26 +00:00
exclude_protected Implement the --exclude-protected feature (#8359) 2021-11-15 11:45:14 -08:00
explicit_provider Revert package.json lookup fix. 2023-05-15 14:14:57 -04:00
gather_plugin Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
get_created Revert package.json lookup fix. 2023-05-15 14:14:57 -04:00
get_resource Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
go Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
invalid_package_json Revert package.json lookup fix. 2023-05-15 14:14:57 -04:00
large_resource Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
nodejs Fix codepaths computation when working dir is nested relative to package.json (#15601) 2024-03-08 16:16:47 +00:00
partial_state Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
partial_values Propagate inputs to outputs during preview. (#3327) 2019-11-11 12:09:34 -08:00
policy Start policy packs in parallel (#14495) 2023-11-20 14:08:32 +00:00
printf Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
project_main Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
project_main_abs Enable absolute and relative parent paths for pulumi main (#6734) 2021-04-08 21:39:52 -07:00
project_main_parent/foo Enable absolute and relative parent paths for pulumi main (#6734) 2021-04-08 21:39:52 -07:00
protect_resources Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
provider_secret_config Enable full strict mode. (#3218) 2019-09-11 16:21:35 -07:00
python Add 'typechecker' option to python runtime (#15725) 2024-03-28 10:41:22 +00:00
python_await Cleanup output futures list as they complete (#16057) 2024-04-26 16:35:28 +00:00
query Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
read Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
recreate_resource_check Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
refresh/go Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
resource_refs_get_resource Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
rotate_passphrase Bump the go_modules group across 5 directories with 1 update (#16054) 2024-04-25 21:11:41 +00:00
secret_outputs [sdk/python] Fix secret regression (#5496) 2020-10-01 14:57:51 -07:00
single_resource Suppress JSON outputs in preview correctly (#2771) 2019-05-25 12:10:38 +02:00
stack_bad_parenting Consistent dependencies (#2517) 2019-03-05 20:34:51 -08:00
stack_dependencies Remove existing lock files 2018-11-12 15:33:58 -08:00
stack_outputs Remove dotnet 2022-12-13 16:13:53 +00:00
stack_outputs_program_error Fix: Don't delete stack outputs on failed deployments (#15754) 2024-03-25 22:37:46 +00:00
stack_outputs_resource_error Fix: Don't delete stack outputs on failed deployments (#15754) 2024-03-25 22:37:46 +00:00
stack_parenting Consistent dependencies (#2517) 2019-03-05 20:34:51 -08:00
stack_project_name Actually fix the naming test (#10554) 2022-08-31 20:52:23 +01:00
state_rename_parent Bump the go_modules group across 5 directories with 1 update (#16054) 2024-04-25 21:11:41 +00:00
steps Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
targets Allow anything in resource names (#14107) 2023-11-20 08:59:00 +00:00
transformations Bump the go_modules group across 24 directories with 1 update (#15685) 2024-03-14 07:52:34 +00:00
transforms Flip transforms to non-experimental (#16080) 2024-04-29 10:54:41 +00:00
tsconfig Add tsconfig option to specify tsconfig path (#8452) 2021-11-22 11:42:39 -08:00
types Fix remaining lint issues (#14688) 2023-12-02 17:16:09 +00:00
unsafe_snapshot_tests/bad_resource Update tests/integration/unsafe_snapshot_tests/bad_resource/resource.ts 2022-09-15 08:00:36 -07:00
valid-property-names [testing] Add integration tests for regressions in property name parsing (#14681) 2023-12-01 17:27:33 +00:00
.gitignore ci: Enable async component builds 2022-09-14 10:06:05 -07:00
appdash_test.go Reimport appdash from our mirror (#14701) 2023-11-30 14:21:35 +00:00
component_setup.sh Engine and Golang support for shimless providers 2022-11-14 11:25:41 +00:00
integration_acceptance_test.go Rename "Smoke" test to "Acceptance" tests 2023-01-30 15:38:37 -05:00
integration_go_acceptance_test.go test: Update deps (#16010) 2024-04-24 05:07:52 +00:00
integration_go_test.go upgrade to latest version of golangci-lint (#15977) 2024-04-19 06:20:33 +00:00
integration_nodejs_acceptance_test.go Reenable TestPythonTranslation and delete stack reference tests (#15933) 2024-04-15 12:36:03 +00:00
integration_nodejs_test.go upgrade to latest version of golangci-lint (#15977) 2024-04-19 06:20:33 +00:00
integration_python_acceptance_test.go upgrade to latest version of golangci-lint (#15977) 2024-04-19 06:20:33 +00:00
integration_python_test.go Cleanup output futures list as they complete (#16057) 2024-04-26 16:35:28 +00:00
integration_test.go The `--expect-no-changes` flag checks for output diffs (#15903) 2024-05-01 18:30:49 +00:00
integration_util_test.go Replace some more uses of assert.Contains(err.Error()) with assert.ErrorContains (#14863) 2023-12-15 17:45:32 +00:00