Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save mmdeniz/b01aab539eac86b0bb3a311a5f01e824 to your computer and use it in GitHub Desktop.
Save mmdeniz/b01aab539eac86b0bb3a311a5f01e824 to your computer and use it in GitHub Desktop.
MemGPT + Open-Source Models
# spin up a runpod GPU with TextGen WebUI, no need to use openai flag
# you can also use TextGen WebUI on your local computer
git clone https://github.com/cpacker/MemGPT.git
cd MemGPT
export OPENAI_API_BASE=https://some-stuff-5000.proxy.runpod.net # using runpod
# export OPENAI_API_BASE=localhost:5000 # using local computer
BACKEND_TYPE=webui
python3 main.py --no_verify
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment