Skip to content

Instantly share code, notes, and snippets.

@nasirus

nasirus/docker.cmd

Created February 1, 2025 15:01
Show Gist options
  • Save nasirus/acf0d2d3fbdeb803ba85ada7ee28feee to your computer and use it in GitHub Desktop.
Save nasirus/acf0d2d3fbdeb803ba85ada7ee28feee to your computer and use it in GitHub Desktop.
Download ZIP
DeepSeekR1 - llama.cpp - Docker - cmd
Raw
docker.cmd
docker run -d --name deepseek-r1-server -p 8000:8000 --network llama_network -e LLAMA_ARG_HF_REPO=bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF -e LLAMA_ARG_HF_FILE=DeepSeek-R1-Distill-Qwen-32B-IQ2_M.gguf -e LLAMA_ARG_HOST=0.0.0.0 -e LLAMA_ARG_PORT=8000 -e LLAMA_ARG_N_PREDICT=4000 -e LLAMA_ARG_N_PARALLEL=2 ghcr.io/ggerganov/llama.cpp:server
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment