Skip to content

Instantly share code, notes, and snippets.

@thuwarakeshm

thuwarakeshm/gpu_requiements.csv

Last active February 7, 2025 10:28
Show Gist options
  • Save thuwarakeshm/539e3af522aebad80ac6ad89353377d6 to your computer and use it in GitHub Desktop.
Save thuwarakeshm/539e3af522aebad80ac6ad89353377d6 to your computer and use it in GitHub Desktop.
Download ZIP
GPU List
Raw
gpu_requiements.csv
We can make this file beautiful and searchable if this error is corrected: No commas found in this CSV file in line 0.
Model Parameters (B) VRAM Needed (FP32) (GB) VRAM Needed (FP16) (GB) VRAM Needed (INT8) (GB)
Bert-base-uncased-0.1B 0.1 0.5 0.25 0.125
BLOOM 176 704 352 176
Bloom-176B 176 787 393.5 196.75
DeepSeek-R1 671 2482 1242 671
GPT-2-0.1B 0.1 0.56 0.28 0.14
Llama 3.1 70B 70 280 140 70
Llama-3-70B-Instruct 70 311 155.5 77.75
Llama-3-8B-Instruct 8 33 16.5 8.25
Microsoft Phi-2 2 11.8 5.9 2.95
Mistral 7B 7 28 14 7
Mistral-7B-v0.2 7 33 16.5 8.25
Mistral-8x22B-v0.1 176 631 315.5 157.75
Qwen 2.5-Max 72 288 144 72
Qwen2-72B-Instruct 72 322 161 80.5
TinyLlama-1.1B-Chat 1.1 4.6 2.3 1.15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment