UNCLASSIFIED - NO CUI

Skip to content

SKIP UPGRADE: Helm Tests

Micah Nagel requested to merge helm-tests into master

Adds helm tests to BB CI. Not all are enabled due to issues with some tests.

Couple of notes:

  • decided to go with a bash script that runs helm tests rather than the flux way of enabling tests: this gives us better control over what to do with failures, getting cypress artifacts, getting core dns modifications in place, and timing of tests running
  • there are a number of tests that currently don't allow the flexibility to be run in BB CI (they only really work well in package CI) - in these cases I disabled the tests, opened issues to tackle test updates, and linked the issues in our k3d values
  • Jaeger tag update is to pull the new wait script into CI
  • Velero tag update to pull in new gluon so we can disable its tests
  • there are still a couple finicky tests that sometimes have issues due to timing/timeouts. I allowed all tests to fail for now and we can open issues as we see them come up. Eventually we would want this to fail pipelines but I don't think our tests are robust and safe enough to trust just yet
  • Logs for failed tests are dumped to stdout, all logs + cypress artifacts are saved off as artifacts

NOTE: Upgrade CI appears to be failing/erroring for a couple reasons:

  • the gitrepos aren't "re-synced" with the change for gitignore so the test files are still "gitignored" for flux's clone
  • some of the packages had values changes to support their tests, but the package doesn't support changing those values after an initial install (i.e. sonarqube set password)

Closes https://repo1.dso.mil/platform-one/big-bang/bigbang/-/issues/707

Edited by Micah Nagel

Merge request reports