Help VAT team resolve "request entity too large" errors

This template is ONLY used for reporting bugs. New feature request or pipeline enhancement issues should use the other template options for issue submission.

Current Behavior

When using the vat import api, we noticed that when pushing a large number of findings, the vat stage would fail. While checking the logs, we noticed that when this happened request entity too large was being output after the job failed. The VAT team did some inverstigating and discovered that the post limit for that api was hard coded to 1MB. We were able to confirm that the json body sent that caused "request entity too large" was 1.14MB.

Live Example

https://repo1.dso.mil/dsop/opensource/spark-operator/spark/-/jobs/4090914

Expected Behavior

The VAT stage shouldn't fail for any number of findings attempted to be imported.

Possible Solution

• Roll back VAT import api changes
• VAT deployment for 50MB POST size change
• Split up POST data.