Skip to content

Instantly share code, notes, and snippets.

@ssghost

ssghost/llama-server.sh

Created April 6, 2025 08:13
Show Gist options
  • Save ssghost/6c55f939011d0ad3c834dada1d7d4de0 to your computer and use it in GitHub Desktop.
Save ssghost/6c55f939011d0ad3c834dada1d7d4de0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
llama-server.sh
on run {input, parameters}
do shell script "nohup /usr/local/bin/llama-server -m '/Volumes/TOSHIBA EXT/GGUF/gemma-3-4b-it-q4_0.gguf' --port 11234 >/dev/null 2>&1 &"
return input
end run
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment