Skip to content

Instantly share code, notes, and snippets.

@ntropy83
Created April 13, 2024 20:19
Show Gist options
  • Save ntropy83/c039de897f3fd69b69c193eed687e13f to your computer and use it in GitHub Desktop.
Save ntropy83/c039de897f3fd69b69c193eed687e13f to your computer and use it in GitHub Desktop.
ollama_LLM
#!/bin/sh
# Install the container
# docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
cleanup()
{
echo "Caught Signal ... cleaning up."
docker container stop ollama
exit 1
}
## Main Script
echo "Launching LLM: Mistral-Openorca."
docker container start ollama
docker exec -it ollama ollama run mistral-openorca
trap cleanup 1 2 3 6 EXIT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment