Skip to content

Instantly share code, notes, and snippets.

@cobanov

cobanov/smolagents_course_notes.md

Created February 11, 2025 16:19
Show Gist options
  • Save cobanov/7cb05d4bc17c1bfa636973bc15dd560f to your computer and use it in GitHub Desktop.
Save cobanov/7cb05d4bc17c1bfa636973bc15dd560f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
smolagents_course_notes.md

to use local llm model

from smolagents import OpenAIServerModel

model = OpenAIServerModel(
    model_id="Qwen/Qwen2.5-Coder-14B-Instruct-GGUF",
    api_base="http://100.81.11.125:1234/v1",
    api_key="lm-studio",
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment