Create Prometheus Rule Resources for Fluentbit Issues

See related velero issue where we added Prometheus Rules within the package. We should add a handful of alerts for common issues. See comment below for 2 Rule templates from CNAP which we should incorporate.

          - alert: FluentdLowNumberOfPods
            expr: |-
              avg without (instance) (up{job="fluentbit"}) < .20
            for: 10m
            annotations:
            labels:
              severity: critical
          - alert: LogsNotFlowing
            expr: |-
              sum(rate(fluentd_output_status_num_records_total{}[4h])) by (tag) < .001
            for: 30m
            annotations:
            labels:
              severity: critical

set weight to 2

added fluentbit kindenhancement monitoring priority6 teamXForce labels

changed iteration to Big Bang Iterations Nov 29, 2022 - Dec 12, 2022

changed milestone to %1.49.0

changed the description

added 1 deleted label

removed 1 deleted label

added 1 deleted label

removed 1 deleted label

assigned to @jfoster

added statusdoing label

created branch 55-create-prometheus-rule-resources-for-fluentbit-issues to address this issue

mentioned in merge request !93 (merged)

added 1 deleted label

removed 1 deleted label

added 1 deleted label

removed 1 deleted label

added 1 deleted label

removed 1 deleted label

added 1 deleted label

removed 1 deleted label

set weight to 1

removed iteration Big Bang Iterations Nov 29, 2022 - Dec 12, 2022

changed iteration to Big Bang Iterations Dec 13, 2022 - Dec 26, 2022

changed milestone to %1.50.0

added statusreview label and removed statusdoing label

closed with merge request big-bang/bigbang!2326 (merged)