UNCLASSIFIED - NO CUI

Fix clamav archive issue

This template is ONLY used for reporting bugs. New feature request or pipeline enhancement issues should use the other template options for issue submission.

Current Behavior

When running the scan-artifacts stage, if there is a large tar or tar.gz archive (>8GB) imported from import-artifacts, clamav will attempt to load the artifact into memory and then throw a LibClamAV Error: CRITICAL: fmap() failed error.

Live Example

https://repo1.dso.mil/dsop/mathworks/matlab/matlab-with-desktop/-/jobs/2307623

Expected Behavior

The pipeline should not fail when scanning large tar or tar.gz archives. It should either skip them or scan them without failing.

Possible Solution

If the tar or tar.gz is larger than 3.5GB, untar the file, delete the tar archive, and scan the decompressed/extracted directory.

Edited by Kenneth Maguire