Skip to content

Instantly share code, notes, and snippets.

@perryism
Created February 10, 2024 19:58
Show Gist options
  • Save perryism/6c8c8c4ed44670eda96397e9f0dc2435 to your computer and use it in GitHub Desktop.
Save perryism/6c8c8c4ed44670eda96397e9f0dc2435 to your computer and use it in GitHub Desktop.
cuda dockerfile for llm
FROM nvidia/cuda:11.2.2-runtime-ubuntu20.04
RUN apt-get update --yes --quiet
RUN apt install software-properties-common -y && add-apt-repository ppa:deadsnakes/ppa -y && \
apt-get install -y python3.10 \
pip \
python3.10-distutils \
curl
RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.10
RUN python3.10 -m pip install -U pip
@perryism
Copy link
Author

docker run --gpus all nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -gpu -benchmark

to use it in wsl, check this out. https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#installing-the-nvidia-container-toolkit

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment