parallelize helm tests; library function for collapsible folders; directly call deploy/test 'manager' scripts.
General MR
Summary
changes:
- helm test "batch of 5" logic to use
parallel helm test- this fixes a bug where first batch would be parallelized with group of 5, but all subsequent tests were executed sequentially. - deploy_bigbang() no longer used, instead directly call shell scripts from bigbang.yaml.
- logged stdout statements now use [INFO] [PASS] [FAIL] [WARN] [ERROR]
- tell users to set
DEBUG_ENABLED: 'true' - don't execute first round of helm tests for the
upgradejob.
added:
- script to parse results of cypress results.json, and fail/pass accordingly
- script in scripts/tests/test_bigbang.sh which runs the test scripts (instead of the library function calling these) so now executed scripts are localized to the directory where the pipeline points
- script in scripts/deploy/deploy_stack.sh which was previously the "deploy_bigbang()" function in the library. done for the same reasons as the test_bigbang.sh script.
Testing
- umbrella pipeline: passing: https://repo1.dso.mil/big-bang/pipeline-templates/package-validation/-/jobs/43929019 failing (cypress problems w/cluster-auditor): https://repo1.dso.mil/big-bang/pipeline-templates/package-validation/-/jobs/43928590
- tested against umbrella pipeline +/- vault enabled as well as cluster-auditor (but the cluster-auditor didn't generate a results.json).
KPI
- ~25% reduction in time to execute umbrella pipeline. lowered helm test stage script duration from ~12 minutes to ~3.5 minutes.
- improved code readability for faster tsing later.
Edited by Rob McCarthy

