Monitor ElasticSearch

In order to monitor the health of our elastic search indexes, we would need to add an prometheus metrics exporter to the umbrella deployment. Check out https://hub.docker.com/r/bitnami/elasticsearch-exporter/

Would be a nice feature to have for sure! Looks like image will need to be requested of the IronBank team, since it's not in any of their repos and not in harbor, before this can be pushed through to BigBang.

Filled out p1.dso.mil request for elasticsearch-exporter image.

added logging statusblocked + 1 deleted label

marked this issue as related to dsop/bitnami/elasticsearch-exporter#1 (closed)

added 1 deleted label and removed statusblocked label

removed 1 deleted label

added kindenhancement label

changed milestone to %1.11.0

changed iteration to Big Bang Iterations Jun 15, 2021 - Jun 28, 2021

elasticsearch-exporter image is available in IronBank now.

We can move forward with adding flags and templates to deploy a single (unless multiple are needed) exporter pod (s) per install of this package.

registry1.dso.mil/ironbank/opensource/bitnami/elasticsearch-exporter:v1.1.0

removed 1 deleted label

added Big Bang Core monitoring labels

set weight to 3

removed milestone %1.11.0

removed iteration Big Bang Iterations Jun 15, 2021 - Jun 28, 2021

assigned to @ryan.j.garcia

marked this issue as related to dsop/bitnami/elasticsearch-exporter#54 (closed)

Opened linked issue 54 for the elasticsearch-exporter container. Attempting to test that image and configuration works with our setup.

Following the docs I cannot find a way to feed in auth to elasticsearch to be able to grab metrics from BigBang ECK stacks.

The image from IB is based off of this upstream image and the only argument mentioning auth is status unreleased:

es.apiKey	unreleased	API Key to use for authenticating against Elasticsearch.

Looks like API Key authentication can be set via environment variable as of image release 1.4.0

The API key used to connect can be set with the ES_API_KEY environment variable.

@ryan.j.garcia I'm requesting that IB update the exporter container from v1.3 to v1.5 so that I can utilize this API key. Seems like a container update may block this issue.

added statusblocked label

unassigned @ryan.j.garcia

added teamcore/security label

added priority5 label

added stale label

changed iteration to Big Bang Iterations Aug 9, 2022 - Aug 22, 2022

removed statusblocked label

removed stale label

added teamXForce label and removed teamcore/security label

changed iteration to Big Bang Iterations Jul 26, 2022 - Aug 8, 2022

removed iteration Big Bang Iterations Jul 26, 2022 - Aug 8, 2022

changed iteration to Big Bang Iterations Aug 9, 2022 - Aug 22, 2022

changed milestone to %1.42.0

changed iteration to Big Bang Iterations Aug 23, 2022 - Sep 5, 2022

assigned to @gmiernicki

added statusdoing label

created branch 3-monitor-elasticsearch to address this issue

mentioned in merge request !115 (merged)

removed iteration Big Bang Iterations Aug 23, 2022 - Sep 5, 2022

changed iteration to Big Bang Iterations Sep 6, 2022 - Sep 19, 2022

changed milestone to %1.43.0

added statusblocked label and removed statusdoing label

added statusdoing label and removed statusblocked label

mentioned in issue #62 (closed)

marked this issue as related to #62 (closed)

added statusreview label and removed statusdoing label

added Demo Candidate label

In this coming sprint 38 we'll have a doc in the EK package talking about the exporter and utilizing the above option ES_API_KEY over the built in authentication or elastic user, until that doc and info is present we will be leaving the toggle for metrics.enabled in BigBang alone.