Skip to content

Instantly share code, notes, and snippets.

@nogajun
Created September 6, 2024 07:41
Show Gist options
  • Save nogajun/51d16dedfc981309d6cbd1f4f978e8ce to your computer and use it in GitHub Desktop.
Save nogajun/51d16dedfc981309d6cbd1f4f978e8ce to your computer and use it in GitHub Desktop.
docker compose file to use ollama and Open WebUI with APU rocm.
services:
ollama:
image: ollama/ollama:rocm
container_name: ollama
devices:
- /dev/kfd
- /dev/dri
volumes:
- ollama:/root/.ollama
environment:
- HSA_OVERRIDE_GFX_VERSION=9.0.0
- DEVICE=hip
ports:
- 11434:11434
restart: always
open-webui:
image: ghcr.io/open-webui/open-webui:main
container_name: open-webui
volumes:
- open-webui:/app/backend/data
environment:
- OLLAMA_BASE_URL=http://127.0.0.1:11434
restart: always
network_mode: host
volumes:
ollama:
open-webui:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment