Does not run in CPU ONLY environments
Summary
The program does not start without a GPU.
Steps to reproduce
Just run the container without a GPU.
What is the current bug behavior?
When the program is started in a CPU ONLY environment it fails and prints an error stating it is looking for libnvidia-ml.so. Does not start.
What is the expected correct behavior?
Triton should load and print out its loaded settings.
Relevant logs and/or screenshots
(Paste any relevant logs - please use code blocks (```) to format console output, logs, and code as it's very hard to read otherwise.)
Possible fixes
The entrypoint needed to be updated with the corresponding nvidia_entrypoint.sh to check for CPU vs GPU and handle correctly, and new files needed to be introduced to support this.
Defintion of Done
-
Bug has been identified and corrected within the container
Edited by Andrew Simonetta