Even though the RX 480 is not a very recent GPU, the 8 GB VRAM are quite decent and make it possible to run LLMs much faster than with the CPU.
To make it running, three steps are necessary: Installing vulkan, building shaderc and finally building lama.cpp including the vulkan backend (assuming git, a c compiler, cmake, ninja, etc. are installed on a sufficiently recent Ubuntu).
Run sudo apt install libvulkan-dev vulkan-tools glslang-tools.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # This script will install AMDGPU-PRO OpenCL and Vulkan support. | |
| # | |
| # For Ubuntu and it's flavor, just install the package using this command | |
| # in extracted driver directory instread. | |
| # | |
| # ./amdgpu-pro-install --opencl=legacy,pal --headless --no-dkms | |
| # | |
| # For Arch Linux or Manjaro, use the opencl-amd or rocm-opencl-runtime on AUR instread. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # sync mysql tables from dev server to production server quickly via command line | |
| # specify the list of tables to sync below | |
| dev_host="127.0.0.1" | |
| dev_user="root" | |
| dev_pass="K#oDAk6AF@GumR7" | |
| dev_db_name="local_dev" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """QA Chatbot streaming using FastAPI, LangChain Expression Language , OpenAI, and Chroma. | |
| Features | |
| -------- | |
| - Persistent Chat Memory: | |
| Stores chat history in a local file. | |
| - Persistent Vector Store: | |
| Stores document embeddings in a local vector store. | |
| - Standalone Question Generation: | |
| Rephrases follow-up questions to standalone questions in their original language. |
Updated 2018-03-23 Version 1802 (Build 16.0.9029.2167)
==========================================
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| set -e | |
| ## Script to rip VCD with VLC and then transcode with ffmpeg | |
| if [ "${BASH_VERSINFO}" -lt 4 ]; then | |
| echo "Require bash 4 or higher" | |
| exit 1 | |
| fi |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| set -e -o errexit -o pipefail -o nounset | |
| ################################### | |
| # This script can be used by itself, but it's recommended that you read | |
| # a tutorial on Proxmox forum first: https://forum.proxmox.com/threads/hey-proxmox-community-lets-talk-about-resources-isolation.124256/ | |
| ################################### | |
| # Do not modify these variables (set by Proxmox when calling the script) | |
| vmId="$1" |
Find the proper driver at the NVidia website.
Note: Make sure to select "Linux 64-bit" as your OS
Hit the "Search" button.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| set $cursor_size 54 | |
| ``` | |
| # GTK | |
| # This is the only place where you must set GTK scaling | |
| set $gnome-schema org.gnome.desktop.interface | |
| exec_always { | |
| gsettings set $gnome-schema gtk-theme 'Matcha-dark-sea' | |
| gsettings set $gnome-schema icon-theme 'Numix-Square' | |
| gsettings set org.gnome.desktop.interface text-scaling-factor 2.73 |
NewerOlder
