Skip to content

Instantly share code, notes, and snippets.

@mbijon

mbijon/local-llm-prefs.md

Last active April 14, 2026 12:59
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save mbijon/5be0dd60132370ebfc497201b4fb3878 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save mbijon/5be0dd60132370ebfc497201b4fb3878 to your computer and use it in GitHub Desktop.
Download ZIP
Swyx 2026-04 local LLM pref list
Raw
local-llm-prefs.md

https://www.latent.space/p/ainews-top-local-models-list-april

Small / fast

ollama pull hf.co/KatyTestHistorical/SultrySilicon-7B-V2-GGUF:latest ollama pull hf.co/huihui-ai/Huihui-GLM-4.6V-Flash-abliterated-GGUF:latest

9B

ollama pull hf.co/bartowski/Gemma-2-Ataraxy-9B-GGUF:latest

13B

ollama pull hf.co/TheBloke/MythoMax-L2-13B-GGUF:latest

24B

ollama pull hf.co/bartowski/PocketDoc_Dans-PersonalityEngine-V1.3.0-24b-GGUF:latest

26B multimodal

ollama pull hf.co/Jiunsong/supergemma4-26b-abliterated-multimodal-gguf-8bit:latest

27B

ollama pull hf.co/KnutJaegersberg/gemma-3-27b-it-abliterated-Q8_0-GGUF:latest ollama pull hf.co/mradermacher/BlackSheep-Large-GGUF:latest

31B

ollama pull hf.co/paperscarecrow/Gemma-4-31B-it-abliterated:latest ollama pull hf.co/groxaxo/Huihui-gemma-4-31B-it-abliterated-v2-GGUF:latest

35B MoE

ollama pull hf.co/mradermacher/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-i1-GGUF:latest

70B

ollama pull hf.co/Artefact2/Midnight-Rose-70B-v2.0.3-GGUF:latest ollama pull hf.co/mradermacher/Midnight-Miqu-70B-v1.5-GGUF:latest

MoE (E2B / E4B)

ollama pull hf.co/mradermacher/Huihui-gemma-4-E2B-it-abliterated-GGUF:latest ollama pull hf.co/mradermacher/Huihui-gemma-4-E4B-it-abliterated-GGUF:latest

123B (heavy)

ollama pull hf.co/TheDrummer/Behemoth-123B-v1-GGUF:latest ollama pull hf.co/MarsupialAI/Monstral-123B_iMat_GGUF:latest

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment