Flux CPU limits cause deployments to take longer than they should

Flux CPU limits are very low and I frequently see multiple flux pods pegged to their CPU limits. Especially in large deployments. This isn't necessarily an issue in and of itself, however this substantially increases the time a deployment takes.

I'd like to see some way of configuring this while still using the bb flavor of flux. Maybe a kustomization isn't the way to go and it should be a helm chart with values? Not sure what the solution is but I'd like a way to be able to set the limits/requests above their current very small values