Skip to content

Instantly share code, notes, and snippets.

@bkocis

bkocis/llm_evaluation_results_agg__questions_spiegel_claude.csv

Created August 11, 2024 09:16
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save bkocis/726d9ab0f26bf26084325698c45fed0b to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save bkocis/726d9ab0f26bf26084325698c45fed0b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
llm_evaluation_results_agg__questions_spiegel_claude.csv
model_name answer_time token/sec adjectives_count adjectives_percentage_spacy grammar_error_percentage
Llama-3-SauerkrautLM-70b-Instruct-Q4_K_M:latest 186.643 3.012 0.397 0.053 0.878
Llama-3-SauerkrautLM-8b-Instruct-Q4_K_M:latest 4.01 124.103 0.337 0.039 1.948
Llama-3-SauerkrautLM-8b-Instruct-fp16:latest 8.589 53.913 0.349 0.042 0.826
gemma:7b-instruct 3.366 175.64 0.505 0.086 0.402
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment