The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.
There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.
| # Bazarr downloads subtitles | |
| version: "3.4" | |
| services: | |
| bazarr: | |
| image: linuxserver/bazarr:1.0.5-development | |
| container_name: bazarr | |
| restart: unless-stopped | |
| environment: | |
| - TZ=Europe/London |
| import random | |
| from hashlib import sha256 | |
| def coprime(a, b): | |
| while b != 0: | |
| a, b = b, a % b | |
| return a | |
Ventura docs for M2 Macs in this comment: https://gist.github.com/henrik242/65d26a7deca30bdb9828e183809690bd?permalink_comment_id=4555340#gistcomment-4555340
Old Monterey docs in this old revision: https://gist.github.com/henrik242/65d26a7deca30bdb9828e183809690bd/32c410e3a1de73539c76fa13ea5486569c4e0c5d
Solution for Sonoma: https://gist.github.com/sghiassy/a3927405cf4ffe81242f4ecb01c382ac
macOS has ncurses version 5.7 which does not ship the terminfo description for tmux. There're two ways that can help you to solve this problem.
Instead of tmux-256color, use screen-256color which comes with system. Place this command into ~/.tmux.conf or ~/.config/tmux/tmux.conf(for version 3.1 and later):
| ; Ender 3 Custom Start G-code | |
| M140 S{material_bed_temperature_layer_0} ; Set Heat Bed temperature | |
| M190 S{material_bed_temperature_layer_0} ; Wait for Heat Bed temperature | |
| M104 S160; start warming extruder to 160 | |
| G28 ; Home all axes | |
| G29 ; Auto bed-level (BL-Touch) | |
| G92 E0 ; Reset Extruder | |
| M104 S{material_print_temperature_layer_0} ; Set Extruder temperature | |
| G1 X0.1 Y20 Z0.3 F5000.0 ; Move to start position | |
| M109 S{material_print_temperature_layer_0} ; Wait for Extruder temperature |
My setup:
GRE Tunnel using 10.42.1.0/24 for IPv4 and fd00:42::/48 for IPv6.
Host 1 (colo2) will announce: 2a07:1c42:10::/48 using AS208717.
Host 2 (vps1) will announce: 192.168.5.5/32 using AS65000.
First create the GRE tunnels:
Most modern HDMI connected devices support Consumer Electronics Control (CEC). It allows devices to send commands to each other, typically to get the TV to switch input and control volume. If you have ever turned on a Game Console and had your TV automatically change input to that device you have seen CEC in action. It is very convenient and useful, sort of a universal remote that works.
Every manufacturer seems to have it’s own branding of CEC (e.g. Samsung Anynet+, LG SimpLink, Sharp Aquos Link) but it may need to be enabled. Check your manual for details.
Using a Raspberry Pi connected to a TV that supports CEC, you can use the command line cec-client application to control the inputs and the TV itself. These are notes on how to use cec-client and understand the different options.
sudo useradd --system --shell /bin/false node_exporter
curl -fsSL https://github.com/prometheus/node_exporter/releases/download/v1.3.1/node_exporter-1.3.1.linux-amd64.tar.gz \
| sudo tar -zxvf - -C /usr/local/bin --strip-components=1 node_exporter-1.3.1.linux-amd64/node_exporter \
&& sudo chown node_exporter:node_exporter /usr/local/bin/node_exporter
