Steboss/q4km_vs_q40.csv

Created July 29, 2026 10:47

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/Steboss/8e0c02a89348552f93f8867953bf724c.js"></script>
Save Steboss/8e0c02a89348552f93f8867953bf724c to your computer and use it in GitHub Desktop.

Download ZIP

Compare Q4_K_M tensors vs Q4_0

Raw

q4km_vs_q40.csv

	tensor	Q4_0 (dB)	Q4_K (dB)	improvement
	blk.0.attn_k	19.60	21.18	+1.58
	blk.1.attn_k	20.44	22.34	+1.90
	blk.2.attn_k	20.66	22.53	+1.87
	blk.30.attn_k	20.19	22.31	+2.12
	blk.31.attn_k	20.60	22.53	+1.93
	blk.0.attn_q	19.95	21.37	+1.42

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment