Created
February 10, 2024 19:58
-
-
Save perryism/6c8c8c4ed44670eda96397e9f0dc2435 to your computer and use it in GitHub Desktop.
cuda dockerfile for llm
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
FROM nvidia/cuda:11.2.2-runtime-ubuntu20.04 | |
RUN apt-get update --yes --quiet | |
RUN apt install software-properties-common -y && add-apt-repository ppa:deadsnakes/ppa -y && \ | |
apt-get install -y python3.10 \ | |
pip \ | |
python3.10-distutils \ | |
curl | |
RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.10 | |
RUN python3.10 -m pip install -U pip |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
docker run --gpus all nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -gpu -benchmark
to use it in wsl, check this out. https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#installing-the-nvidia-container-toolkit