msaroufim/llm-setup-gist.md

Created September 25, 2025 23:31

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/msaroufim/d330c459bca71d234b40a91d17d8ba51.js"></script>
Save msaroufim/d330c459bca71d234b40a91d17d8ba51 to your computer and use it in GitHub Desktop.

Download ZIP

Local LLM Service Setup with Qwen3, Ollama, Open WebUI, and Tailscale

Raw

llm-setup-gist.md

Local LLM Service Setup

1. Install Ollama

curl -fsSL https://ollama.com/install.sh | sh

2. Download Model

ollama pull qwen3:32b

3. Install Open WebUI

docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main

4. Expose via Tailscale

sudo tailscale serve --bg 8080

Access

From Tailscale network: http://YOUR_MACHINE_NAME:8080
Chat interface like ChatGPT, no API calls needed

msaroufim/llm-setup-gist.md

Select an option

No results found

Select an option

No results found

Local LLM Service Setup

1. Install Ollama

2. Download Model

3. Install Open WebUI

4. Expose via Tailscale

Access