UNCLASSIFIED - NO CUI

Does not run in CPU ONLY environments

Summary

The program does not start without a GPU.

Steps to reproduce

Just run the container without a GPU.

What is the current bug behavior?

When the program is started in a CPU ONLY environment it fails and prints an error stating it is looking for libnvidia-ml.so. Does not start.

What is the expected correct behavior?

Triton should load and print out its loaded settings.

Relevant logs and/or screenshots

(Paste any relevant logs - please use code blocks (```) to format console output, logs, and code as it's very hard to read otherwise.)

Possible fixes

The entrypoint needed to be updated with the corresponding nvidia_entrypoint.sh to check for CPU vs GPU and handle correctly, and new files needed to be introduced to support this.

Defintion of Done

  • Bug has been identified and corrected within the container
Edited by Andrew Simonetta