FluentD container is giving Permission Errors
Since using the upstream image equivalent in Iron Bank image: registry1.dso.mil/ironbank/opensource/fluentd/fluentd-kubernetes-daemonset:1.18.0, the pods are in a CrashLoopBackOff error
│ 2025-04-09 18:03:23 +0000 [error]: #0 unexpected error error_class=Errno::EACCES error="Permission denied @ rb_sysopen - /var/log/fluentd-containers.log.pos" │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/plugin/in_tail.rb:254:in `initialize' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/plugin/in_tail.rb:254:in `open' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/plugin/in_tail.rb:254:in `start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:262:in `block in start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:251:in `block (2 levels) in lifecycle' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:247:in `each' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:247:in `block in lifecycle' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:234:in `each' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:234:in `lifecycle' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:261:in `start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:264:in `start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:158:in `block in run' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:157:in `synchronize' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:157:in `run' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/supervisor.rb:769:in `block in run_worker' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/supervisor.rb:1135:in `main_process' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/supervisor.rb:760:in `run_worker' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/command/fluentd.rb:378:in `<top (required)>' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 <internal:/usr/local/lib/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:136:in `require' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 <internal:/usr/local/lib/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:136:in `require' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/bin/fluentd:15:in `<top (required)>' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/bin/fluentd:25:in `load' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/bin/fluentd:25:in `<main>' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 unexpected error error_class=Errno::EACCES error="Permission denied @ rb_sysopen - /var/log/fluentd-containers.log.pos" │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/plugin/in_tail.rb:254:in `initialize' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/plugin/in_tail.rb:254:in `open' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/plugin/in_tail.rb:254:in `start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:262:in `block in start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:251:in `block (2 levels) in lifecycle' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:247:in `each' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:247:in `block in lifecycle' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:234:in `each' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:234:in `lifecycle' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/root_agent.rb:261:in `start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:264:in `start' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:158:in `block in run' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:157:in `synchronize' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/engine.rb:157:in `run' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/supervisor.rb:769:in `block in run_worker' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/supervisor.rb:1135:in `main_process' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/supervisor.rb:760:in `run_worker' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/lib/fluent/command/fluentd.rb:378:in `<top (required)>' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 <internal:/usr/local/lib/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:136:in `require' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 <internal:/usr/local/lib/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:136:in `require' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/gems/fluentd-1.18.0/bin/fluentd:15:in `<top (required)>' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/bin/fluentd:25:in `load' │
│ 2025-04-09 18:03:23 +0000 [error]: #0 /usr/local/bundle/bin/fluentd:25:in `<main>' │
│ 2025-04-09 18:03:23 +0000 [info]: Received graceful stop │
│ 2025-04-09 18:03:23 +0000 [info]: Worker 0 finished with status 1 Edited by Kirby Liu