Running with gitlab-runner 13.8.0 (775dd39d)  on global-shared-gitlab-runner-5c8545f999-t4242 jJMcCa_q section_start:1615410600:resolve_secrets Resolving secrets section_end:1615410600:resolve_secrets section_start:1615410600:prepare_executor Preparing the "kubernetes" executor Using Kubernetes namespace: gitlab-runner-isolated WARNING: Pulling GitLab Runner helper image from Docker Hub. Helper image is migrating to registry.gitlab.com, for more information see https://docs.gitlab.com/runner/configuration/advanced-configuration.html#migrating-helper-image-to-registrygitlabcom Using Kubernetes executor with image registry1.dso.mil/ironbank/ironbank-pipelines/rootless-podman:0.1 ... section_end:1615410600:prepare_executor section_start:1615410600:prepare_script Preparing environment Waiting for pod gitlab-runner-isolated/runner-jjmccaq-project-4716-concurrent-1ckhnp to be running, status is Pending Running on runner-jjmccaq-project-4716-concurrent-1ckhnp via global-shared-gitlab-runner-5c8545f999-t4242... section_end:1615410603:prepare_script section_start:1615410603:get_sources Getting source from Git repository Fetching changes with git depth set to 50... Initialized empty Git repository in /builds/dsop/opensource/triton-inference-server/server/.git/ Created fresh repository. Checking out a8fc8e96 as andrew.simonetta-development-branch-031820... Skipping Git submodules setup section_end:1615410604:get_sources section_start:1615410604:download_artifacts Downloading artifacts Downloading artifacts for hardening_manifest (2317951)... Downloading artifacts from coordinator... ok  id=2317951 responseStatus=200 OK token=-T69BQH6 Downloading artifacts for import artifacts (2318128)... Downloading artifacts from coordinator... ok  id=2318128 responseStatus=200 OK token=YvdVB1zL Downloading artifacts for load scripts (2317949)... Downloading artifacts from coordinator... ok  id=2317949 responseStatus=200 OK token=yDq4vu8E Downloading artifacts for wl compare lint (2317952)... Downloading artifacts from coordinator... ok  id=2317952 responseStatus=200 OK token=JMzb9DAZ section_end:1615410700:download_artifacts section_start:1615410700:step_script Executing "step_script" stage of the job script $ "${PIPELINE_REPO_DIR}/stages/build/build-run.sh" Determine source registry based on branch Load any images used in Dockerfile build Load HTTP and S3 external resources 'ci-artifacts/import-artifacts/external-resources/OCV.tar' -> './OCV.tar' 'ci-artifacts/import-artifacts/external-resources/libtensorflow_cc.so.1.tar.gz' -> './libtensorflow_cc.so.1.tar.gz' 'ci-artifacts/import-artifacts/external-resources/libtensorflow_cc.so.tar.gz' -> './libtensorflow_cc.so.tar.gz' 'ci-artifacts/import-artifacts/external-resources/libtensorflow_framework.so.1.tar.gz' -> './libtensorflow_framework.so.1.tar.gz' 'ci-artifacts/import-artifacts/external-resources/libtensorflow_framework.so.tar.gz' -> './libtensorflow_framework.so.tar.gz' 'ci-artifacts/import-artifacts/external-resources/libtensorflow_triton.so.1.tar.gz' -> './libtensorflow_triton.so.1.tar.gz' 'ci-artifacts/import-artifacts/external-resources/libtensorflow_triton.so.tar.gz' -> './libtensorflow_triton.so.tar.gz' 'ci-artifacts/import-artifacts/external-resources/libtriton_tensorflow1.so.tar.gz' -> './libtriton_tensorflow1.so.tar.gz' 'ci-artifacts/import-artifacts/external-resources/nvidia1.tar.gz' -> './nvidia1.tar.gz' 'ci-artifacts/import-artifacts/external-resources/nvidia2.tar.gz' -> './nvidia2.tar.gz' 'ci-artifacts/import-artifacts/external-resources/nvidia3.tar.gz' -> './nvidia3.tar.gz' 'ci-artifacts/import-artifacts/external-resources/nvidia4.tar.gz' -> './nvidia4.tar.gz' 'ci-artifacts/import-artifacts/external-resources/rpms.tar.gz' -> './rpms.tar.gz' 'ci-artifacts/import-artifacts/external-resources/tritonserverwobe.tar.gz' -> './tritonserverwobe.tar.gz' Converting labels from hardening manifest into command line args Converting build args from hardening manifest into command line args Build the image STEP 1: FROM registry1.dsop.io/ironbank/redhat/ubi/ubi8:8.3 Getting image source signatures Copying blob sha256:f720926dba598ae1547a96ef3d2b84242c7b3e4b6489f052aede3e3c7a089261 Copying blob sha256:88afac75a7738cf4e403f8c2234207477781e19950ae6b21f1fee762a0c2c2bd Copying blob sha256:d2320253299952d6acf67a183191a320661feeec9a7c4f1cb5107ab23cef7d8e Copying config sha256:dbec4dd5d33194f52ed6838b1a268ced4998cdd8b2d52ee8f1989ef5deaa4faa Writing manifest to image destination Storing signatures STEP 2: ARG VERSION=23.03 STEP 3: RUN useradd -u 1818 triton STEP 4: ENV CUDA_VERSION 11.2.1 STEP 5: RUN dnf upgrade Red Hat Universal Base Image 8 (RPMs) - BaseOS 77 kB/s | 774 kB 00:10 Red Hat Universal Base Image 8 (RPMs) - AppStre 525 kB/s | 5.1 MB 00:10 Red Hat Universal Base Image 8 (RPMs) - CodeRea 1.3 kB/s | 13 kB 00:10 Dependencies resolved. Nothing to do. Complete! STEP 6: RUN dnf -y install pkg-config libgomp libpng python38 Last metadata expiration check: 0:00:02 ago on Wed Mar 10 21:13:01 2021. Dependencies resolved. ================================================================================================= Package Arch Version Repository Size ================================================================================================= Installing: libgomp x86_64 8.3.1-5.1.el8 ubi-8-baseos 204 k libpng x86_64 2:1.6.34-5.el8 ubi-8-baseos 126 k pkgconf-pkg-config x86_64 1.4.2-1.el8 ubi-8-baseos 15 k python38 x86_64 3.8.3-3.module+el8.3.0+7680+79e7e61a ubi-8-appstream 78 k Installing dependencies: libpkgconf x86_64 1.4.2-1.el8 ubi-8-baseos 35 k pkgconf x86_64 1.4.2-1.el8 ubi-8-baseos 38 k pkgconf-m4 noarch 1.4.2-1.el8 ubi-8-baseos 17 k python38-libs x86_64 3.8.3-3.module+el8.3.0+7680+79e7e61a ubi-8-appstream 8.3 M python38-pip-wheel noarch 19.3.1-1.module+el8.3.0+7187+a27ec44b ubi-8-appstream 1.2 M python38-setuptools-wheel noarch 41.6.0-4.module+el8.3.0+7187+a27ec44b ubi-8-appstream 304 k Installing weak dependencies: python38-pip noarch 19.3.1-1.module+el8.3.0+7187+a27ec44b ubi-8-appstream 1.9 M python38-setuptools noarch 41.6.0-4.module+el8.3.0+7187+a27ec44b ubi-8-appstream 667 k Enabling module streams: python38 3.8 Transaction Summary ================================================================================================= Install 12 Packages Total download size: 13 M Installed size: 46 M Downloading Packages: [MIRROR] libgomp-8.3.1-5.1.el8.x86_64.rpm: Curl error (28): Timeout was reached for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/x86_64/baseos/os/Packages/l/libgomp-8.3.1-5.1.el8.x86_64.rpm [Connection timed out after 5000 milliseconds] [MIRROR] libpng-1.6.34-5.el8.x86_64.rpm: Curl error (28): Timeout was reached for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/x86_64/baseos/os/Packages/l/libpng-1.6.34-5.el8.x86_64.rpm [Connection timed out after 5000 milliseconds] [MIRROR] pkgconf-pkg-config-1.4.2-1.el8.x86_64.rpm: Curl error (28): Timeout was reached for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/x86_64/baseos/os/Packages/p/pkgconf-pkg-config-1.4.2-1.el8.x86_64.rpm [Connection timed out after 5000 milliseconds] (1/12): pkgconf-pkg-config-1.4.2-1.el8.x86_64.r 3.1 kB/s | 15 kB 00:05 (2/12): libpng-1.6.34-5.el8.x86_64.rpm 25 kB/s | 126 kB 00:05 (3/12): libpkgconf-1.4.2-1.el8.x86_64.rpm 15 MB/s | 35 kB 00:00 (4/12): libgomp-8.3.1-5.1.el8.x86_64.rpm 41 kB/s | 204 kB 00:05 (5/12): pkgconf-1.4.2-1.el8.x86_64.rpm 16 MB/s | 38 kB 00:00 (6/12): pkgconf-m4-1.4.2-1.el8.noarch.rpm 7.7 MB/s | 17 kB 00:00 [MIRROR] python38-libs-3.8.3-3.module+el8.3.0+7680+79e7e61a.x86_64.rpm: Curl error (28): Timeout was reached for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/x86_64/appstream/os/Packages/p/python38-libs-3.8.3-3.module%2bel8.3.0%2b7680%2b79e7e61a.x86_64.rpm [Connection timed out after 5000 milliseconds] [MIRROR] python38-setuptools-wheel-41.6.0-4.module+el8.3.0+7187+a27ec44b.noarch.rpm: Curl error (28): Timeout was reached for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/x86_64/appstream/os/Packages/p/python38-setuptools-wheel-41.6.0-4.module%2bel8.3.0%2b7187%2ba27ec44b.noarch.rpm [Connection timed out after 5000 milliseconds] [MIRROR] python38-pip-19.3.1-1.module+el8.3.0+7187+a27ec44b.noarch.rpm: Curl error (28): Timeout was reached for https://cdn-ubi.redhat.com/content/public/ubi/dist/ubi8/8/x86_64/appstream/os/Packages/p/python38-pip-19.3.1-1.module%2bel8.3.0%2b7187%2ba27ec44b.noarch.rpm [Connection timed out after 5000 milliseconds] (7/12): python38-setuptools-wheel-41.6.0-4.modu 61 kB/s | 304 kB 00:05 (8/12): python38-setuptools-41.6.0-4.module+el8 63 MB/s | 667 kB 00:00 (9/12): python38-pip-19.3.1-1.module+el8.3.0+71 379 kB/s | 1.9 MB 00:05 (10/12): python38-3.8.3-3.module+el8.3.0+7680+7 30 MB/s | 78 kB 00:00 (11/12): python38-pip-wheel-19.3.1-1.module+el8 57 MB/s | 1.2 MB 00:00 (12/12): python38-libs-3.8.3-3.module+el8.3.0+7 1.6 MB/s | 8.3 MB 00:05 -------------------------------------------------------------------------------- Total 1.3 MB/s | 13 MB 00:10 Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Installing : python38-pip-wheel-19.3.1-1.module+el8.3.0+7187+a2 1/12 Installing : python38-setuptools-wheel-41.6.0-4.module+el8.3.0+ 2/12 Installing : python38-libs-3.8.3-3.module+el8.3.0+7680+79e7e61a 3/12 Installing : python38-3.8.3-3.module+el8.3.0+7680+79e7e61a.x86_ 4/12 Running scriptlet: python38-3.8.3-3.module+el8.3.0+7680+79e7e61a.x86_ 4/12 Installing : python38-setuptools-41.6.0-4.module+el8.3.0+7187+a 5/12 Running scriptlet: python38-setuptools-41.6.0-4.module+el8.3.0+7187+a 5/12 Installing : python38-pip-19.3.1-1.module+el8.3.0+7187+a27ec44b 6/12 Running scriptlet: python38-pip-19.3.1-1.module+el8.3.0+7187+a27ec44b 6/12 Installing : pkgconf-m4-1.4.2-1.el8.noarch 7/12 Installing : libpkgconf-1.4.2-1.el8.x86_64 8/12 Installing : pkgconf-1.4.2-1.el8.x86_64 9/12 Installing : pkgconf-pkg-config-1.4.2-1.el8.x86_64 10/12 Installing : libpng-2:1.6.34-5.el8.x86_64 11/12 Installing : libgomp-8.3.1-5.1.el8.x86_64 12/12 Running scriptlet: libgomp-8.3.1-5.1.el8.x86_64 12/12 Verifying : libgomp-8.3.1-5.1.el8.x86_64 1/12 Verifying : libpng-2:1.6.34-5.el8.x86_64 2/12 Verifying : pkgconf-pkg-config-1.4.2-1.el8.x86_64 3/12 Verifying : libpkgconf-1.4.2-1.el8.x86_64 4/12 Verifying : pkgconf-1.4.2-1.el8.x86_64 5/12 Verifying : pkgconf-m4-1.4.2-1.el8.noarch 6/12 Verifying : python38-libs-3.8.3-3.module+el8.3.0+7680+79e7e61a 7/12 Verifying : python38-setuptools-wheel-41.6.0-4.module+el8.3.0+ 8/12 Verifying : python38-pip-19.3.1-1.module+el8.3.0+7187+a27ec44b 9/12 Verifying : python38-setuptools-41.6.0-4.module+el8.3.0+7187+a 10/12 Verifying : python38-pip-wheel-19.3.1-1.module+el8.3.0+7187+a2 11/12 Verifying : python38-3.8.3-3.module+el8.3.0+7680+79e7e61a.x86_ 12/12 Installed products updated. Installed: libgomp-8.3.1-5.1.el8.x86_64 libpkgconf-1.4.2-1.el8.x86_64 libpng-2:1.6.34-5.el8.x86_64 pkgconf-1.4.2-1.el8.x86_64 pkgconf-m4-1.4.2-1.el8.noarch pkgconf-pkg-config-1.4.2-1.el8.x86_64 python38-3.8.3-3.module+el8.3.0+7680+79e7e61a.x86_64 python38-libs-3.8.3-3.module+el8.3.0+7680+79e7e61a.x86_64 python38-pip-19.3.1-1.module+el8.3.0+7187+a27ec44b.noarch python38-pip-wheel-19.3.1-1.module+el8.3.0+7187+a27ec44b.noarch python38-setuptools-41.6.0-4.module+el8.3.0+7187+a27ec44b.noarch python38-setuptools-wheel-41.6.0-4.module+el8.3.0+7187+a27ec44b.noarch Complete! STEP 7: RUN dnf clean all 25 files removed STEP 8: RUN echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf STEP 9: ENV PATH /usr/local/nvidia/bin:/usr/local/cuda/bin:${PATH} STEP 10: ENV LD_LIBRARY_PATH /usr/local/nvidia/lib:/usr/local/nvidia/lib64:/opt/tritonserver/lib STEP 11: RUN ln -s cuda-11.2 /usr/local/cuda STEP 12: ENV NVIDIA_VISIBLE_DEVICES all STEP 13: ENV NVIDIA_DRIVER_CAPABILITIES compute,utility STEP 14: ENV NVIDIA_REQUIRE_CUDA "cuda>=11.2 brand=tesla,driver>=418,driver<419 brand=tesla,driver>=440,driver<441 driver>=450,driver<451" STEP 15: ARG TARBALL1=OCV.tar STEP 16: ARG TARBALL2=rpms.tar.gz STEP 17: ARG TARBALL6=libtensorflow_cc.so.1.tar.gz STEP 18: ARG TARBALL7=libtensorflow_cc.so.tar.gz STEP 19: ARG TARBALL8=libtensorflow_framework.so.1.tar.gz STEP 20: ARG TARBALL9=libtensorflow_framework.so.tar.gz STEP 21: ARG TARBALL10=libtensorflow_triton.so.1.tar.gz STEP 22: ARG TARBALL11=libtensorflow_triton.so.tar.gz STEP 23: ARG TARBALL12=libtriton_tensorflow1.so.tar.gz STEP 24: ARG TARBALL13=tritonserverwobe.tar.gz STEP 25: ARG TARBALLN1=nvidia1.tar.gz STEP 26: ARG TARBALLN2=nvidia2.tar.gz STEP 27: ARG TARBALLN3=nvidia3.tar.gz STEP 28: ARG TARBALLN4=nvidia4.tar.gz STEP 29: COPY ["${TARBALL1}", "/"] STEP 30: COPY ["${TARBALLN1}", "${TARBALLN2}", "${TARBALLN3}", "${TARBALLN4}", "${TARBALL6}", "${TARBALL7}", "${TARBALL8}", "${TARBALL9}", "${TARBALL10}", "${TARBALL11}", "${TARBALL12}", "${TARBALL13}", "${TARBALL2}","/opt/"] STEP 31: WORKDIR / STEP 32: RUN tar -xvf ./${TARBALL1} && rm -fv ./${TARBALL1} usr/local/lib64/ usr/local/lib64/bpf/ usr/local/lib64/cmake/ usr/local/lib64/cmake/AWSSDK/ usr/local/lib64/cmake/AWSSDK/AWSSDKConfigVersion.cmake usr/local/lib64/cmake/AWSSDK/platformDeps.cmake usr/local/lib64/cmake/AWSSDK/AWSSDKConfig.cmake usr/local/lib64/cmake/AWSSDK/build_external.cmake usr/local/lib64/cmake/AWSSDK/compiler_settings.cmake usr/local/lib64/cmake/AWSSDK/dependencies.cmake usr/local/lib64/cmake/AWSSDK/external_dependencies.cmake usr/local/lib64/cmake/AWSSDK/initialize_project_version.cmake usr/local/lib64/cmake/AWSSDK/make_uninstall.cmake usr/local/lib64/cmake/AWSSDK/platform/ usr/local/lib64/cmake/AWSSDK/platform/android.cmake usr/local/lib64/cmake/AWSSDK/platform/apple.cmake usr/local/lib64/cmake/AWSSDK/platform/custom.cmake usr/local/lib64/cmake/AWSSDK/platform/linux.cmake usr/local/lib64/cmake/AWSSDK/platform/unix.cmake usr/local/lib64/cmake/AWSSDK/platform/windows.cmake usr/local/lib64/cmake/AWSSDK/resolve_platform.cmake usr/local/lib64/cmake/AWSSDK/sdks.cmake usr/local/lib64/cmake/AWSSDK/sdksCommon.cmake usr/local/lib64/cmake/AWSSDK/setup_cmake_find_module.cmake usr/local/lib64/cmake/AWSSDK/utilities.cmake usr/local/lib64/cmake/AwsCFlags.cmake usr/local/lib64/cmake/AwsCheckHeaders.cmake usr/local/lib64/cmake/AwsSharedLibSetup.cmake usr/local/lib64/cmake/AwsTestHarness.cmake usr/local/lib64/cmake/AwsLibFuzzer.cmake usr/local/lib64/cmake/AwsSanitizers.cmake usr/local/lib64/cmake/AwsSIMD.cmake usr/local/lib64/cmake/AwsFindPackage.cmake usr/local/lib64/cmake/aws-cpp-sdk-s3/ usr/local/lib64/cmake/aws-cpp-sdk-s3/aws-cpp-sdk-s3-targets.cmake usr/local/lib64/cmake/aws-cpp-sdk-s3/aws-cpp-sdk-s3-targets-release.cmake usr/local/lib64/cmake/aws-cpp-sdk-s3/aws-cpp-sdk-s3-config.cmake usr/local/lib64/cmake/aws-cpp-sdk-s3/aws-cpp-sdk-s3-config-version.cmake usr/local/lib64/cmake/aws-cpp-sdk-core/ usr/local/lib64/cmake/aws-cpp-sdk-core/aws-cpp-sdk-core-targets.cmake usr/local/lib64/cmake/aws-cpp-sdk-core/aws-cpp-sdk-core-targets-release.cmake usr/local/lib64/cmake/aws-cpp-sdk-core/aws-cpp-sdk-core-config.cmake usr/local/lib64/cmake/aws-cpp-sdk-core/aws-cpp-sdk-core-config-version.cmake usr/local/lib64/cmake/testing-resources/ usr/local/lib64/cmake/testing-resources/testing-resources-targets.cmake usr/local/lib64/cmake/testing-resources/testing-resources-targets-release.cmake usr/local/lib64/cmake/testing-resources/testing-resources-config.cmake usr/local/lib64/cmake/testing-resources/testing-resources-config-version.cmake usr/local/lib64/cmake/opencv4/ usr/local/lib64/cmake/opencv4/OpenCVModules.cmake usr/local/lib64/cmake/opencv4/OpenCVModules-release.cmake usr/local/lib64/cmake/opencv4/OpenCVConfig-version.cmake usr/local/lib64/cmake/opencv4/OpenCVConfig.cmake usr/local/lib64/libaws-checksums.a usr/local/lib64/aws-checksums/ usr/local/lib64/aws-checksums/cmake/ usr/local/lib64/aws-checksums/cmake/static/ usr/local/lib64/aws-checksums/cmake/static/aws-checksums-targets.cmake usr/local/lib64/aws-checksums/cmake/static/aws-checksums-targets-release.cmake usr/local/lib64/aws-checksums/cmake/aws-checksums-config.cmake usr/local/lib64/libaws-c-common.a usr/local/lib64/aws-c-common/ usr/local/lib64/aws-c-common/cmake/ usr/local/lib64/aws-c-common/cmake/static/ usr/local/lib64/aws-c-common/cmake/static/aws-c-common-targets.cmake usr/local/lib64/aws-c-common/cmake/static/aws-c-common-targets-release.cmake usr/local/lib64/aws-c-common/cmake/aws-c-common-config.cmake usr/local/lib64/libaws-c-event-stream.a usr/local/lib64/aws-c-event-stream/ usr/local/lib64/aws-c-event-stream/cmake/ usr/local/lib64/aws-c-event-stream/cmake/static/ usr/local/lib64/aws-c-event-stream/cmake/static/aws-c-event-stream-targets.cmake usr/local/lib64/aws-c-event-stream/cmake/static/aws-c-event-stream-targets-release.cmake usr/local/lib64/aws-c-event-stream/cmake/aws-c-event-stream-config.cmake usr/local/lib64/libaws-cpp-sdk-s3.a usr/local/lib64/libaws-cpp-sdk-core.a usr/local/lib64/libtesting-resources.a usr/local/lib64/pkgconfig/ usr/local/lib64/pkgconfig/opencv4.pc usr/local/lib64/libopencv_core.so.4.5.2 usr/local/lib64/libopencv_core.so.4.5 usr/local/lib64/libopencv_core.so usr/local/lib64/libopencv_flann.so.4.5.2 usr/local/lib64/libopencv_flann.so.4.5 usr/local/lib64/libopencv_flann.so usr/local/lib64/libopencv_hdf.so.4.5.2 usr/local/lib64/libopencv_hdf.so.4.5 usr/local/lib64/libopencv_hdf.so usr/local/lib64/libopencv_imgproc.so.4.5.2 usr/local/lib64/libopencv_imgproc.so.4.5 usr/local/lib64/libopencv_imgproc.so usr/local/lib64/libopencv_intensity_transform.so.4.5.2 usr/local/lib64/libopencv_intensity_transform.so.4.5 usr/local/lib64/libopencv_intensity_transform.so usr/local/lib64/libopencv_ml.so.4.5.2 usr/local/lib64/libopencv_ml.so.4.5 usr/local/lib64/libopencv_ml.so usr/local/lib64/libopencv_phase_unwrapping.so.4.5.2 usr/local/lib64/libopencv_phase_unwrapping.so.4.5 usr/local/lib64/libopencv_phase_unwrapping.so usr/local/lib64/libopencv_photo.so.4.5.2 usr/local/lib64/libopencv_photo.so.4.5 usr/local/lib64/libopencv_photo.so usr/local/lib64/libopencv_plot.so.4.5.2 usr/local/lib64/libopencv_plot.so.4.5 usr/local/lib64/libopencv_plot.so usr/local/lib64/libopencv_quality.so.4.5.2 usr/local/lib64/libopencv_quality.so.4.5 usr/local/lib64/libopencv_quality.so usr/local/lib64/libopencv_reg.so.4.5.2 usr/local/lib64/libopencv_reg.so.4.5 usr/local/lib64/libopencv_reg.so usr/local/lib64/libopencv_surface_matching.so.4.5.2 usr/local/lib64/libopencv_surface_matching.so.4.5 usr/local/lib64/libopencv_surface_matching.so usr/local/lib64/libopencv_xphoto.so.4.5.2 usr/local/lib64/libopencv_xphoto.so.4.5 usr/local/lib64/libopencv_xphoto.so usr/local/lib64/libopencv_dnn.so.4.5.2 usr/local/lib64/libopencv_dnn.so.4.5 usr/local/lib64/libopencv_dnn.so usr/local/lib64/libopencv_dnn_superres.so.4.5.2 usr/local/lib64/libopencv_dnn_superres.so.4.5 usr/local/lib64/libopencv_dnn_superres.so usr/local/lib64/libopencv_features2d.so.4.5.2 usr/local/lib64/libopencv_features2d.so.4.5 usr/local/lib64/libopencv_features2d.so usr/local/lib64/libopencv_fuzzy.so.4.5.2 usr/local/lib64/libopencv_fuzzy.so.4.5 usr/local/lib64/libopencv_fuzzy.so usr/local/lib64/libopencv_hfs.so.4.5.2 usr/local/lib64/libopencv_hfs.so.4.5 usr/local/lib64/libopencv_hfs.so usr/local/lib64/libopencv_img_hash.so.4.5.2 usr/local/lib64/libopencv_img_hash.so.4.5 usr/local/lib64/libopencv_img_hash.so usr/local/lib64/libopencv_imgcodecs.so.4.5.2 usr/local/lib64/libopencv_imgcodecs.so.4.5 usr/local/lib64/libopencv_imgcodecs.so usr/local/lib64/libopencv_line_descriptor.so.4.5.2 usr/local/lib64/libopencv_line_descriptor.so.4.5 usr/local/lib64/libopencv_line_descriptor.so usr/local/lib64/libopencv_saliency.so.4.5.2 usr/local/lib64/libopencv_saliency.so.4.5 usr/local/lib64/libopencv_saliency.so usr/local/lib64/libopencv_text.so.4.5.2 usr/local/lib64/libopencv_text.so.4.5 usr/local/lib64/libopencv_text.so usr/local/lib64/libopencv_videoio.so.4.5.2 usr/local/lib64/libopencv_videoio.so.4.5 usr/local/lib64/libopencv_videoio.so usr/local/lib64/libopencv_wechat_qrcode.so.4.5.2 usr/local/lib64/libopencv_wechat_qrcode.so.4.5 usr/local/lib64/libopencv_wechat_qrcode.so usr/local/lib64/libopencv_calib3d.so.4.5.2 usr/local/lib64/libopencv_calib3d.so.4.5 usr/local/lib64/libopencv_calib3d.so usr/local/lib64/libopencv_datasets.so.4.5.2 usr/local/lib64/libopencv_datasets.so.4.5 usr/local/lib64/libopencv_datasets.so usr/local/lib64/libopencv_highgui.so.4.5.2 usr/local/lib64/libopencv_highgui.so.4.5 usr/local/lib64/libopencv_highgui.so usr/local/lib64/libopencv_mcc.so.4.5.2 usr/local/lib64/libopencv_mcc.so.4.5 usr/local/lib64/libopencv_mcc.so usr/local/lib64/libopencv_objdetect.so.4.5.2 usr/local/lib64/libopencv_objdetect.so.4.5 usr/local/lib64/libopencv_objdetect.so usr/local/lib64/libopencv_rapid.so.4.5.2 usr/local/lib64/libopencv_rapid.so.4.5 usr/local/lib64/libopencv_rapid.so usr/local/lib64/libopencv_rgbd.so.4.5.2 usr/local/lib64/libopencv_rgbd.so.4.5 usr/local/lib64/libopencv_rgbd.so usr/local/lib64/libopencv_shape.so.4.5.2 usr/local/lib64/libopencv_shape.so.4.5 usr/local/lib64/libopencv_shape.so usr/local/lib64/libopencv_structured_light.so.4.5.2 usr/local/lib64/libopencv_structured_light.so.4.5 usr/local/lib64/libopencv_structured_light.so usr/local/lib64/libopencv_video.so.4.5.2 usr/local/lib64/libopencv_video.so.4.5 usr/local/lib64/libopencv_video.so usr/local/lib64/libopencv_videostab.so.4.5.2 usr/local/lib64/libopencv_videostab.so.4.5 usr/local/lib64/libopencv_videostab.so usr/local/lib64/libopencv_xfeatures2d.so.4.5.2 usr/local/lib64/libopencv_xfeatures2d.so.4.5 usr/local/lib64/libopencv_xfeatures2d.so usr/local/lib64/libopencv_ximgproc.so.4.5.2 usr/local/lib64/libopencv_ximgproc.so.4.5 usr/local/lib64/libopencv_ximgproc.so usr/local/lib64/libopencv_xobjdetect.so.4.5.2 usr/local/lib64/libopencv_xobjdetect.so.4.5 usr/local/lib64/libopencv_xobjdetect.so usr/local/lib64/libopencv_aruco.so.4.5.2 usr/local/lib64/libopencv_aruco.so.4.5 usr/local/lib64/libopencv_aruco.so usr/local/lib64/libopencv_bgsegm.so.4.5.2 usr/local/lib64/libopencv_bgsegm.so.4.5 usr/local/lib64/libopencv_bgsegm.so usr/local/lib64/libopencv_bioinspired.so.4.5.2 usr/local/lib64/libopencv_bioinspired.so.4.5 usr/local/lib64/libopencv_bioinspired.so usr/local/lib64/libopencv_ccalib.so.4.5.2 usr/local/lib64/libopencv_ccalib.so.4.5 usr/local/lib64/libopencv_ccalib.so usr/local/lib64/libopencv_dnn_objdetect.so.4.5.2 usr/local/lib64/libopencv_dnn_objdetect.so.4.5 usr/local/lib64/libopencv_dnn_objdetect.so usr/local/lib64/libopencv_dpm.so.4.5.2 usr/local/lib64/libopencv_dpm.so.4.5 usr/local/lib64/libopencv_dpm.so usr/local/lib64/libopencv_face.so.4.5.2 usr/local/lib64/libopencv_face.so.4.5 usr/local/lib64/libopencv_face.so usr/local/lib64/libopencv_gapi.so.4.5.2 usr/local/lib64/libopencv_gapi.so.4.5 usr/local/lib64/libopencv_gapi.so usr/local/lib64/libopencv_optflow.so.4.5.2 usr/local/lib64/libopencv_optflow.so.4.5 usr/local/lib64/libopencv_optflow.so usr/local/lib64/libopencv_stitching.so.4.5.2 usr/local/lib64/libopencv_stitching.so.4.5 usr/local/lib64/libopencv_stitching.so usr/local/lib64/libopencv_superres.so.4.5.2 usr/local/lib64/libopencv_superres.so.4.5 usr/local/lib64/libopencv_superres.so usr/local/lib64/libopencv_tracking.so.4.5.2 usr/local/lib64/libopencv_tracking.so.4.5 usr/local/lib64/libopencv_tracking.so usr/local/lib64/libopencv_stereo.so.4.5.2 usr/local/lib64/libopencv_stereo.so.4.5 usr/local/lib64/libopencv_stereo.so usr/local/lib64/libtorchvision.so removed './OCV.tar' STEP 33: WORKDIR /opt STEP 34: RUN tar -xvf ./${TARBALLN1} && rm -fv ./${TARBALLN1} nvidia1/ nvidia1/cuda-compat-11-2-460.32.03-1.x86_64.rpm nvidia1/cuda-cudart-11-2-11.2.146-1.x86_64.rpm removed './nvidia1.tar.gz' STEP 35: RUN tar -xvf ./${TARBALLN2} && rm -fv ./${TARBALLN2} nvidia2/ nvidia2/libcusparse-11-2-11.4.0.135-1.x86_64.rpm nvidia2/libcurand-11-2-10.2.3.135-1.x86_64.rpm nvidia2/cuda-nvtx-11-2-11.2.67-1.x86_64.rpm nvidia2/libcusolver-11-2-11.1.0.135-1.x86_64.rpm nvidia2/libnccl-2.8.4-1+cuda11.2.x86_64.rpm nvidia2/libcufft-11-2-10.4.0.135-1.x86_64.rpm nvidia2/libcublas-11-2-11.4.1.1026-1.x86_64.rpm nvidia2/cuda-nvrtc-11-2-11.2.142-1.x86_64.rpm nvidia2/cuda-libraries-11-2-11.2.1-1.x86_64.rpm nvidia2/libnvjpeg-11-2-11.4.0.135-1.x86_64.rpm nvidia2/libnpp-11-2-11.3.2.139-1.x86_64.rpm removed './nvidia2.tar.gz' STEP 36: RUN tar -xvf ./${TARBALLN3} && rm -fv ./${TARBALLN3} nvidia3/ nvidia3/libnvjpeg-devel-11-2-11.4.0.135-1.x86_64.rpm nvidia3/libnccl-devel-2.8.4-1+cuda11.2.x86_64.rpm nvidia3/libcufft-devel-11-2-10.4.0.135-1.x86_64.rpm nvidia3/cuda-cudart-devel-11-2-11.2.146-1.x86_64.rpm nvidia3/cuda-nvcc-11-2-11.2.142-1.x86_64.rpm nvidia3/cuda-memcheck-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-cupti-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-nvrtc-devel-11-2-11.2.142-1.x86_64.rpm nvidia3/cuda-minimal-build-11-2-11.2.1-1.x86_64.rpm nvidia3/cuda-compiler-11-2-11.2.1-1.x86_64.rpm nvidia3/cuda-nvml-devel-11-2-11.2.67-1.x86_64.rpm nvidia3/cuda-sanitizer-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-nvdisasm-11-2-11.2.135-1.x86_64.rpm nvidia3/libcurand-devel-11-2-10.2.3.135-1.x86_64.rpm nvidia3/libcusolver-devel-11-2-11.1.0.135-1.x86_64.rpm nvidia3/cuda-nvprune-11-2-11.2.135-1.x86_64.rpm nvidia3/libcublas-devel-11-2-11.4.1.1026-1.x86_64.rpm nvidia3/cuda-nvprof-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-gdb-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-cuxxfilt-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-cuobjdump-11-2-11.2.135-1.x86_64.rpm nvidia3/cuda-libraries-devel-11-2-11.2.1-1.x86_64.rpm nvidia3/cuda-command-line-tools-11-2-11.2.1-1.x86_64.rpm nvidia3/cuda-driver-devel-11-2-11.2.146-1.x86_64.rpm nvidia3/libcusparse-devel-11-2-11.4.0.135-1.x86_64.rpm removed './nvidia3.tar.gz' STEP 37: RUN tar -xvf ./${TARBALLN4} && rm -fv ./${TARBALLN4} nvidia4/ nvidia4/libcudnn8-devel-8.1.0.77-1.cuda11.2.x86_64.rpm nvidia4/libcudnn8-8.1.0.77-1.cuda11.2.x86_64.rpm removed './nvidia4.tar.gz' STEP 38: RUN tar -zxf ./${TARBALL2} && rm -fv ./${TARBALL2} removed './rpms.tar.gz' STEP 39: RUN tar -zxf ./${TARBALL6} && rm -fv ./${TARBALL6} removed './libtensorflow_cc.so.1.tar.gz' STEP 40: RUN tar -zxf ./${TARBALL7} && rm -fv ./${TARBALL7} removed './libtensorflow_cc.so.tar.gz' STEP 41: RUN tar -zxf ./${TARBALL8} && rm -fv ./${TARBALL8} removed './libtensorflow_framework.so.1.tar.gz' STEP 42: RUN tar -zxf ./${TARBALL9} && rm -fv ./${TARBALL9} removed './libtensorflow_framework.so.tar.gz' STEP 43: RUN tar -zxf ./${TARBALL10} && rm -fv ./${TARBALL10} removed './libtensorflow_triton.so.1.tar.gz' STEP 44: RUN tar -zxf ./${TARBALL11} && rm -fv ./${TARBALL11} removed './libtensorflow_triton.so.tar.gz' STEP 45: RUN tar -zxf ./${TARBALL12} && rm -fv ./${TARBALL12} removed './libtriton_tensorflow1.so.tar.gz' STEP 46: RUN tar -xvf ./${TARBALL13} && rm -fv ./${TARBALL13} tritonserver/ tritonserver/include/ tritonserver/include/triton/ tritonserver/include/triton/core/ tritonserver/include/triton/core/tritonserver.h tritonserver/include/triton/core/tritonbackend.h tritonserver/include/triton/backend/ tritonserver/include/triton/backend/backend_input_collector.h tritonserver/include/triton/backend/backend_memory.h tritonserver/include/triton/backend/backend_common.h tritonserver/include/triton/backend/backend_model.h tritonserver/include/triton/backend/backend_output_responder.h tritonserver/include/triton/backend/backend_model_instance.h tritonserver/include/triton/common/ tritonserver/include/triton/common/triton_json.h tritonserver/include/triton/common/table_printer.h tritonserver/backends/ tritonserver/backends/tensorflow1/ tritonserver/backends/pytorch/ tritonserver/backends/pytorch/libmkl_intel_thread.so tritonserver/backends/pytorch/libtorch.so tritonserver/backends/pytorch/libmkl_def.so tritonserver/backends/pytorch/libmkl_gnu_thread.so tritonserver/backends/pytorch/libc10_cuda.so tritonserver/backends/pytorch/libtorchvision.so tritonserver/backends/pytorch/libc10.so tritonserver/backends/pytorch/libtriton_pytorch.so tritonserver/backends/pytorch/libjpeg.so.9 tritonserver/backends/pytorch/libtorch_cpu.so tritonserver/backends/pytorch/libjpeg.so.9.2.0 tritonserver/backends/pytorch/libmkl_core.so tritonserver/backends/pytorch/libmkl_avx2.so tritonserver/backends/pytorch/libtorch_cuda.so tritonserver/backends/pytorch/libjpeg.so tritonserver/backends/pytorch/libmkl_intel_lp64.so tritonserver/backends/pytorch/libiomp5.so tritonserver/backends/onnxruntime/ tritonserver/backends/onnxruntime/libonnxruntime.so.1.7.0 tritonserver/backends/onnxruntime/libtriton_onnxruntime.so tritonserver/lib64/ tritonserver/lib64/libtritontableprinter.a tritonserver/lib64/libtritonbackendutils.a tritonserver/lib64/cmake/ tritonserver/lib64/cmake/TritonBackend/ tritonserver/lib64/cmake/TritonBackend/TritonBackendTargets-release.cmake tritonserver/lib64/cmake/TritonBackend/TritonBackendConfig.cmake tritonserver/lib64/cmake/TritonBackend/TritonBackendTargets.cmake tritonserver/lib64/cmake/TritonCore/ tritonserver/lib64/cmake/TritonCore/TritonCoreTargets.cmake tritonserver/lib64/cmake/TritonCore/TritonCoreConfig.cmake tritonserver/lib64/cmake/TritonCore/TritonCoreTargets-release.cmake tritonserver/lib64/cmake/TritonCommon/ tritonserver/lib64/cmake/TritonCommon/TritonCommonTargets.cmake tritonserver/lib64/cmake/TritonCommon/TritonCommonConfig.cmake tritonserver/lib64/cmake/TritonCommon/TritonCommonTargets-release.cmake tritonserver/lib64/libtritonserver_stub.so tritonserver/lib/ tritonserver/lib/libtritonserver.so tritonserver/bin/ tritonserver/bin/memory_alloc tritonserver/bin/tritonserver tritonserver/bin/multi_server tritonserver/bin/simple removed './tritonserverwobe.tar.gz' STEP 47: RUN mv libtensorflow_cc.so.1 libtensorflow_cc.so libtensorflow_framework.so.1 libtensorflow_framework.so libtensorflow_triton.so.1 libtensorflow_triton.so libtriton_tensorflow1.so LICENSE.tensorflow tritonserver/backends/tensorflow1/ STEP 48: WORKDIR /opt/baserpms STEP 49: RUN rpm -i re2-20190801-1.el8.x86_64.rpm warning: re2-20190801-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY STEP 50: ENV NCCL_VERSION 2.8.4 STEP 51: ENV LIBRARY_PATH /usr/local/cuda/lib64/stubs STEP 52: ENV CUDNN_VERSION 8.1.0.77 STEP 53: WORKDIR /opt/nvidia1 STEP 54: RUN rpm --nodeps -i *.rpm warning: cuda-compat-11-2-460.32.03-1.x86_64.rpm: Header V4 RSA/SHA512 Signature, key ID 7fa2af80: NOKEY STEP 55: WORKDIR /opt/nvidia2 STEP 56: RUN rpm --nodeps -i *.rpm warning: cuda-libraries-11-2-11.2.1-1.x86_64.rpm: Header V3 RSA/SHA512 Signature, key ID 7fa2af80: NOKEY STEP 57: WORKDIR /opt/nvidia3 STEP 58: RUN rpm --nodeps -i *.rpm warning: cuda-command-line-tools-11-2-11.2.1-1.x86_64.rpm: Header V3 RSA/SHA512 Signature, key ID 7fa2af80: NOKEY STEP 59: WORKDIR /opt/nvidia4 STEP 60: RUN rpm --nodeps -i *.rpm warning: libcudnn8-8.1.0.77-1.cuda11.2.x86_64.rpm: Header V3 RSA/SHA512 Signature, key ID 7fa2af80: NOKEY STEP 61: WORKDIR / STEP 62: RUN mkdir /models STEP 63: RUN ln -s /usr/local/cuda-11.2/targets/x86_64-linux/lib/stubs/libnvidia-ml.so /usr/local/cuda-11.2/targets/x86_64-linux/lib/stubs/libnvidia-ml.so.1 STEP 64: USER triton STEP 65: EXPOSE 8000 STEP 66: EXPOSE 8001 STEP 67: EXPOSE 8002 STEP 68: ENTRYPOINT ["/opt/tritonserver/bin/tritonserver", "--strict-model-config=false", "--model-repository", "/models"] STEP 69: HEALTHCHECK --timeout=30s CMD curl -fs http://localhost:8000/v2 || exit 1 STEP 70: COMMIT registry1.dsop.io/ironbank-staging/opensource/triton-inference-server/server Getting image source signatures Copying blob sha256:72e7d306c279696257fb1796dac29d887127c53479403f8687d3aa4c560edff2 Copying blob sha256:9624be4353eb5540a948608d314a5690c6a0b841aa04979810b61fd190e04769 Copying blob sha256:39a6015adbe44ead150397789e2745105cb6a17155a7c06b3417ddded3860099 Copying blob sha256:6e2af2abc4d76c14a2c81c5e386276fe693b7e4c8dbc7ce7c8b7af6928370f25 Copying config sha256:68da81ead58430d4ce5dfb48f4ca93cf8797ffc5be1d53ea8f8b4a1e05811ae6 Writing manifest to image destination Storing signatures --> 68da81ead58 68da81ead58430d4ce5dfb48f4ca93cf8797ffc5be1d53ea8f8b4a1e05811ae6 + buildah tag --storage-driver=vfs registry1.dsop.io/ironbank-staging/opensource/triton-inference-server/server registry1.dsop.io/ironbank-staging/opensource/triton-inference-server/server:188083 + buildah push --storage-driver=vfs --authfile staging_auth.json --digestfile=ci-artifacts/build/digest registry1.dsop.io/ironbank-staging/opensource/triton-inference-server/server:188083 Getting image source signatures Copying blob sha256:6e2af2abc4d76c14a2c81c5e386276fe693b7e4c8dbc7ce7c8b7af6928370f25 Copying blob sha256:39a6015adbe44ead150397789e2745105cb6a17155a7c06b3417ddded3860099 Copying blob sha256:9624be4353eb5540a948608d314a5690c6a0b841aa04979810b61fd190e04769 Copying blob sha256:72e7d306c279696257fb1796dac29d887127c53479403f8687d3aa4c560edff2 error copying layers and metadata from "containers-storage:[vfs@/home/rootless-podman/.local/share/containers/storage+/var/tmp/containers-user-1000/containers]registry1.dsop.io/ironbank-staging/opensource/triton-inference-server/server:188083" to "docker://registry1.dsop.io/ironbank-staging/opensource/triton-inference-server/server:188083": Error writing blob: Error uploading layer to https://registry1.dsop.io/v2/ironbank-staging/opensource/triton-inference-server/server/blobs/uploads/287b09b3-9c29-4793-9afa-423237b49e79?_state=1VXZRwpwrEH6fey8wPGJTDhv5C3wSNU7GuiptMiIbdJ7Ik5hbWUiOiJpcm9uYmFuay1zdGFnaW5nL29wZW5zb3VyY2UvdHJpdG9uLWluZmVyZW5jZS1zZXJ2ZXIvc2VydmVyIiwiVVVJRCI6IjI4N2IwOWIzLTljMjktNDc5My05YWZhLTQyMzIzN2I0OWU3OSIsIk9mZnNldCI6MTA2NDMyMjQ5NzMsIlN0YXJ0ZWRBdCI6IjIwMjEtMDMtMTBUMjE6NDI6MzVaIn0%3D&digest=sha256%3A93bf2f6afbd59e49e26614a0a854d7029cbbe830266dc7309ee74f9be8dc3ba6: blob upload invalid level=error msg="exit status 125" section_end:1615413051:step_script section_start:1615413051:upload_artifacts_on_failure Uploading artifacts for failed job Uploading artifacts... ci-artifacts/build/: found 1 matching files and directories Uploading artifacts as "archive" to coordinator... ok id=2318621 responseStatus=201 Created token=P3oLY3Xe Uploading artifacts... WARNING: build.env: no matching files  ERROR: No files to upload  section_end:1615413052:upload_artifacts_on_failure section_start:1615413052:cleanup_file_variables Cleaning up file based variables section_end:1615413052:cleanup_file_variables ERROR: Job failed: command terminated with exit code 1