Istio sidecar mem PrometheusRule Alert Template Addition
1 unresolved thread
1 unresolved thread
Adding PrometheusRule template to chart/templates/bigbang which conditionally create an monitoring-istio-sidecar-heap-memory alert group with two alerts:
- Warning at 50MB heap memory usage for sidecar pod
- Critical alert at 100MB of memory usage for sidecar pod
went with heap portion since that is what is actively requested on the system and pod rather than what is in use, and was generally a few MBs lower.
Relates https://repo1.dso.mil/platform-one/big-bang/apps/core/istio-controlplane/-/issues/6
Merge request reports
Activity
added monitoring statusdoing teamXForce labels
assigned to @ryan.j.garcia
added priority5 label
added statusreview label and removed statusdoing label
added 22 commits
-
ebfecae6...3b306cd3 - 19 commits from branch
main - 68409fa8 - Adding conditional Istio PrometheusRule template
- 02af9e55 - Reworking Rule conditional
- 4ad27f0f - Rebase off main
Toggle commit list-
ebfecae6...3b306cd3 - 19 commits from branch
requested review from @LynnStill and @BrandenCobb
1 {{- if and .Values.istio.enabled (.Capabilities.APIVersions.Has "monitoring.coreos.com/v1") }} 2 apiVersion: monitoring.coreos.com/v1 3 kind: PrometheusRule 4 metadata: 5 name: istio-sidecar-heap-memory 6 namespace: {{ .Release.Namespace }} 7 spec: 8 groups: 9 - name: istio.rules 10 rules: 11 - alert: IstioSidecarMemModerate 12 annotations: 13 description: Istio Sidecar Memory is above 50MB for {{`{{`}} $labels.pod_name {{`}}`}} 14 summary: Istio Sidecar Memory usage is above average 15 expr: istio_agent_go_memstats_heap_sys_bytes{} * 0.00000095357432 > 50 changed milestone to %1.35.0
enabled an automatic merge when the pipeline for 6570fb0b succeeds
mentioned in commit 318070d1
Please register or sign in to reply