pulumi/pkg/codegen/docs
Mikhail Shilkov 9388c54be7
Resource docs: emit supporting types beyond the 200 limit (#16185)
<!--- 
Thanks so much for your contribution! If this is your first time
contributing, please ensure that you have read the
[CONTRIBUTING](https://github.com/pulumi/pulumi/blob/master/CONTRIBUTING.md)
documentation.
-->

# Description

Originally motivated by uncontrolled pseudo-recurcive type expansion in
AWS WafV2, we've limited the number of types that we should in the docs
to 200: https://github.com/pulumi/pulumi/pull/12070

Our large customer that publishes their own packages and docs came back
to us and said they have legitimate use cases with more than 200 types:
#15507

I've grabbed stats about our current packages and still found a few
offenders:

```
"aws:lex/v2modelsIntent:V2modelsIntent" 920
"aws:wafv2/ruleGroup:RuleGroup" 310
"aws:wafv2/webAcl:WebAcl" 523
"azure-native:datafactory:Dataset" 256
"azure-native:datafactory:LinkedService" 299
"azure-native:datafactory:Pipeline" 618
"azure-native:datamigration:ServiceTask" 291
"azure-native:datamigration:Task" 291
"aws-native:quicksight:Analysis" 589
"aws-native:quicksight:Dashboard" 606
"aws-native:quicksight:Template" 590
```

Therefore, I'm not entirely removing the limit in this PR, but 
a) bumping the default to 1000
b) applying 200 to the known offenders only

I don't love it's hard coded, but I haven't found a place to add simple
configuration nob. Anyway, it's slightly less hard-coded than it used to
be.

Fixes #15507

## Checklist

- [x] I have run `make tidy` to update any new dependencies
- [x] I have run `make lint` to verify my code passes the lint check
  - [ ] I have formatted my code using `gofumpt`

<!--- Please provide details if the checkbox below is to be left
unchecked. -->
- [x] I have added tests that prove my fix is effective or that my
feature works
   - Existing docs gen tests cover that I haven't broken anything
   - I re-generated the AWS docs and they had no changes
<!--- 
User-facing changes require a CHANGELOG entry.
-->
- [x] I have run `make changelog` and committed the
`changelog/pending/<file>` documenting my change
<!--
If the change(s) in this PR is a modification of an existing call to the
Pulumi Cloud,
then the service should honor older versions of the CLI where this
change would not exist.
You must then bump the API version in
/pkg/backend/httpstate/client/api.go, as well as add
it to the service.
-->
- [ ] Yes, there are changes in this PR that warrants bumping the Pulumi
Cloud API version
<!-- @Pulumi employees: If yes, you must submit corresponding changes in
the service repo. -->
2024-05-13 14:58:33 +00:00
..
templates Resource docs: emit supporting types beyond the 200 limit (#16185) 2024-05-13 14:58:33 +00:00
testdata Fix coming soon misrender (#15783) 2024-03-26 17:24:37 +00:00
README.md Replace Hugo shortcodes (#9491) 2022-04-29 15:04:15 -07:00
constructor_syntax_extractor.go upgrade to latest version of golangci-lint (#15977) 2024-04-19 06:20:33 +00:00
constructor_syntax_generator.go upgrade to latest version of golangci-lint (#15977) 2024-04-19 06:20:33 +00:00
constructor_syntax_generator_test.go Upgrade pulumi-java to v0.11.0 (#16159) 2024-05-10 22:10:01 +00:00
description.go Fix coming soon misrender (#15783) 2024-03-26 17:24:37 +00:00
description_test.go Fix coming soon misrender (#15783) 2024-03-26 17:24:37 +00:00
examples.go Add ability to process docs without dedicated Examples logic (#15475) 2024-02-23 18:06:44 +00:00
gen.go Resource docs: emit supporting types beyond the 200 limit (#16185) 2024-05-13 14:58:33 +00:00
gen_function.go Enable perfsprint linter (#14813) 2023-12-12 12:19:42 +00:00
gen_kubernetes.go sdk/go: Remove 'nolint' directives from package docs 2023-01-06 09:06:47 -08:00
gen_method.go Enable perfsprint linter (#14813) 2023-12-12 12:19:42 +00:00
gen_test.go all: Reformat with gofumpt 2023-03-03 09:00:24 -08:00
package_tree.go Use slice.Prealloc instead of make([]T, 0, ...) 2023-06-29 11:27:50 +01:00
package_tree_test.go Fix docs generator parent module computation (#15035) 2024-02-20 15:44:37 +00:00
static_schema_loader.go [docs] Emit example constructor syntax for resources in typescript, python, go and csharp (#15624) 2024-03-21 13:41:07 +00:00
utils.go Display full type names in Python references in the docs (#15784) 2024-04-01 14:59:50 +00:00
utils_test.go Display full type names in Python references in the docs (#15784) 2024-04-01 14:59:50 +00:00

README.md

Docs generator

This generator generates resource-level docs by utilizing the Pulumi schema.

Crash course on templates

The templates use Go's built-in html/template package to process templates with data. The driver for this doc generator (e.g. tfbridge for TF-based providers) then persists each file from memory onto the disk as .md files.

Although we are using the html/template package, it has the same exact interface as the text/template package, except for some HTML specific things. Therefore, all of the functions available in the text/template package are also available with the html/template package.

  • Data can be injected using {{.PropertyName}}.
  • Nested properties can be accessed using the dot notation, i.e. {{.Property1.Property2}}.
  • Templates can inject other templates using the {{template "template_name"}} directive.
    • For this to work, you will need to first define the named template using {{define "template_name"}}.
  • You can pass data to nested templates by simply passing an argument after the template's name.
  • To remove whitespace from injected values, use the - in the template tags.
    • For example, {{if .SomeBool}} some text {{- else}} some other text {{- end}}. Note the use of - to eliminate whitespace from the enclosing text.
    • Read more here.
  • To render un-encoded content use the custom global function htmlSafe.
    • Note: This should only be used if you know for sure you are not injecting any user-generated content, as it by-passes the HTML encoding.
  • To render strings to Markdown, use the custom global function markdownify.
  • To print regular strings, that share the same syntax as the Go templating engine, use the built-in global function print function.

Learn more from here: https://curtisvermeeren.github.io/2017/09/14/Golang-Templates-Cheatsheet

Modifying templates and updating tests

We run tests that validate our template-rendering output. If you need to make change that produces a set of Markdown files that differs from the set that we use in our tests (see codegen/testing/test/testdata/**/*.md), your pull-request checks will fail, and to get them to pass, you'll need to modify the test data to match the output produced by your change.

For minor diffs, you can just update the test files manually and include those updates with your PR. But for large diffs, you may want to regenerate the full set. To do that, from the root of the repo, run:

cd pkg/codegen/docs && PULUMI_ACCEPT=true go test . && cd -