UNCLASSIFIED - NO CUI

Skip to content

Monitoring HelmRelease stuck in rollback state after upgrade from 1.8.0 > 1.9.0

In release 1.8.0 the monitoring packages' grafana.testFramework.enabled boolean got removed leading to templates for this testFramework being created.

In 1.9.0 this was disabled again and the prom-operator is unable to reconcile the state leading to the HelmRelease being stuck in the following state:

✗ HelmRelease reconciliation failed: Helm rollback failed: an error occurred while cleaning up resources. original rollback error: no PodSecurityPolicy with the name "monitoring-monitoring-grafana-test" found: unable to cleanup resources: object not found,
 skipping delete

Last Helm logs:

creating rolled back release for monitoring-monitoring
performing rollback of monitoring-monitoring
checking 134 resources for changes
warning: Rollback "monitoring-monitoring" failed: no PodSecurityPolicy with the name "monitoring-monitoring-grafana-test" found
Cleanup on fail set, cleaning up 0 resources

Re-enabling grafana.testFramework.enabled or removing the false definition to match 1.8.0 monitoring package values will allow for smooth upgrades.