Skip to content

Instantly share code, notes, and snippets.

@moracabanas
Created March 28, 2025 09:58
Show Gist options
  • Save moracabanas/274c07f2b917b41efd6e6efa094e0b79 to your computer and use it in GitHub Desktop.
Save moracabanas/274c07f2b917b41efd6e6efa094e0b79 to your computer and use it in GitHub Desktop.
Ollama simple deployment
services:
open-webui:
image: ghcr.io/open-webui/open-webui:ollama
restart: unless-stopped
volumes:
- open-webui:/app/backend/data
ports:
- "8080:8080"
environment:
- OLLAMA_BASE_URL=http://ollama:11434
ollama:
image: ollama/ollama:latest
restart: unless-stopped
volumes:
- ollama:/root/.ollama
ports:
- "11434:11434"
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: 1
capabilities: [gpu]
environment:
- NVIDIA_DRIVER_CAPABILITIES=all
- NVIDIA_VISIBLE_DEVICES=1
- OLLAMA_DEBUG=1
volumes:
ollama:
open-webui:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment