1766-optimization-of-trigger-pipeline-by-combining-jobs

Description

https://repo1.dso.mil/platform-one/private/big-bang/ironbank/ironbank-bootstrap/-/issues/1766

This MR aims to optimize the trigger pipeline with the following changes:

• Combined the lint and secret scan jobs into one stage called validate-container-repository

  • Moved the stages/lint and stages/secret-scan folders into a new folder, stages/validate-container-repository/

• Combined the csv-output and the documentation job into one job called generate-documentation

  • Moved the contents of stages/csv-output/ and stages/documentation/ into one directory (`/stages/generate-documentation)
  • Deleted the base.yaml file for each of these since they are not needed anymore

• Combined the harbor and upload-to-s3 jobs into one stage called publish-artifacts

  • Moved the stages/harbor and stages/s3 folders into a new folder, stages/publish-artifacts/

• Moved the check-cves job into the post-vat stage

  • Moved the stages/check-cves folder to be nested under stages/post-vat/

• Updated all file paths to reflect these changes

• Updated READMEs to reflect these changes

Risk

Rollback Plan

Testing

• Tested with the UBI8 repo: https://code-ib-mario.staging.dso.mil/dsop/rflynn/ubi8/-/pipelines/26065 and openjdk11: https://code-ib-mario.staging.dso.mil/dsop/rflynn/openjdk11/-/pipelines/26083

• Time Comparison

  • This branch: https://code-ib-mario.staging.dso.mil/dsop/jwuebbl/ubi8/-/pipelines/26070
  • Master branch: https://code-ib-mario.staging.dso.mil/dsop/jwuebbl/ubi8/-/pipelines/26071