UNCLASSIFIED - NO CUI

Skip to content

Failure in pipeline when uploading large (39GB) image

Repo1: https://repo1.dso.mil/dsop/h2oai/driverlessai/dai-latest/-/tree/eric.gudgion-development-patch-94943 Company/Team name H2O.ai POC Name H2O.ai Driverless AI POC Email eric.gudgion@h2o.ai Description Hi I am trying to add our image to IronBank:

Company name: H2Oa.ai Project name: 13621 (driverlessai/dai-latest)

The image is 39GB and fails on the upload: $ python3 "${PIPELINE_REPO_DIR}/stages/import-artifacts/downloader.py" 38| HttpArtifact | INFO | Downloading from https://s3.amazonaws.com/artifacts.h2o.ai/releases/ai/h2o/dai/rel-1.10.5-44/x86_64/dai-1.10.5-1.x86_64.rpm 39| HttpArtifact | INFO | ea8a30ba1beff23ba9e8e5913068af18562feeb973fe2f31f6031c7f53c14679 40| HttpArtifact | INFO | Checksum validated 41| import_artifacts | INFO | 43Uploading artifacts for successful job03:40 44Uploading artifacts... 45ci-artifacts/import-artifacts/: found 4 matching artifact files and directories 46ERROR: Uploading artifacts as "archive" to coordinator... 413 Request Entity Too Large id=24914243 responseStatus=413 Request Entity Too Large status=413 token=64_ryCrt 47FATAL: too large

What would be the best way to handle large images ?

Thanks Eric

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information