Docker with GPU
The nvidia/cuda:10.2-base will only get you nvidia-smi. If you need cuDNN or nvcc --version you can pull from other NVIDIA Docker base images, namely: nvidia/cuda:10.2-devel-ubuntu18.0. (gets you nvcc cuda toolkit) andnvidia/cuda:10.2-cudnn7-devel-ubuntu18.04. (gets you cuDNN).
TRT under AI-LAB: https://github.com/amineHY/AI-LAB/blob/master/Dockerfile
conda list, make sure it is
cudatoolkit 10.0.130 0
cudnn 7.6.4 cuda10.0_0
then I removed all cudas from /usr/local/cuda and installed sudo sh cuda_10.1.105_418.39_linux.run to install cuda 10 and the driver
reference:
https://towardsdatascience.com/how-to-properly-use-the-gpu-within-a-docker-container-4c699c78c6d1
Last updated