SKIP UPGRADE: Helm Tests
Adds helm tests to BB CI. Not all are enabled due to issues with some tests.
Couple of notes:
- decided to go with a bash script that runs helm tests rather than the flux way of enabling tests: this gives us better control over what to do with failures, getting cypress artifacts, getting core dns modifications in place, and timing of tests running
- there are a number of tests that currently don't allow the flexibility to be run in BB CI (they only really work well in package CI) - in these cases I disabled the tests, opened issues to tackle test updates, and linked the issues in our k3d values
- Jaeger tag update is to pull the new wait script into CI
- Velero tag update to pull in new gluon so we can disable its tests
- there are still a couple finicky tests that sometimes have issues due to timing/timeouts. I allowed all tests to fail for now and we can open issues as we see them come up. Eventually we would want this to fail pipelines but I don't think our tests are robust and safe enough to trust just yet
- Logs for failed tests are dumped to stdout, all logs + cypress artifacts are saved off as artifacts
NOTE: Upgrade CI appears to be failing/erroring for a couple reasons:
- the gitrepos aren't "re-synced" with the change for gitignore so the test files are still "gitignored" for flux's clone
- some of the packages had values changes to support their tests, but the package doesn't support changing those values after an initial install (i.e. sonarqube set password)
Closes https://repo1.dso.mil/platform-one/big-bang/bigbang/-/issues/707
Edited by Micah Nagel