Skip to content

Instantly share code, notes, and snippets.

@iam-veeramalla
Last active April 18, 2026 00:16
Show Gist options
  • Select an option

  • Save iam-veeramalla/d0f46791619b0db348d8312060a80f2d to your computer and use it in GitHub Desktop.

Select an option

Save iam-veeramalla/d0f46791619b0db348d8312060a80f2d to your computer and use it in GitHub Desktop.
claude code integration with ollama to use local models

Run Claude with the power of Local LLMs using Ollama

Install Ollama

curl -fsSL https://ollama.com/install.sh | sh

Pull the Model

ollama pull glm-4.7-flash # or gpt-oss:20b (for better performance)

Install Claude

curl -fsSL https://claude.ai/install.sh | bash

Run Claude with Ollama

ollama launch claude --model glm-4.7-flash # or ollama launch claude --model glm-4.7-flash gpt-oss:20b

@wahab-bahi
Copy link
Copy Markdown

i have 8 gb ram in my laptop which claude model is perfect for my laptop that works fine .
if anyone knows kindly helps me @Hemanth26080

@aneeshksoft
Copy link
Copy Markdown

Hi @iam-veeramalla @ShubhmPatil @chinthakindi-saikumar - I am running Windows with PowerShell and set up Ollama with the local model qwen3.5:9b. I am not able to create or read or write the files in the project directory. After a lot of serch I found that Claude’s agent capabilities (filesystem tools, project scanning) exist only in Claude Code CLI, which requires Anthropic authentication and billing. Under Ollama-only execution, Claude behaves as a plain LLM without tool access, so automated codebase analysis is not possible. How did it work in your case?

Hi, did you find any solution for this?
I’m facing the same issue. I tested with local models like qwen3.5, and Claude Code behaves like a normal LLM (no file read/write, no tool usage).
But when I switched to a cloud model (qwen3.5:cloud), it worked properly and was able to create files using Claude Code.
Just wanted to check if you managed to get local models working with file operations, or if cloud is the only way right now.

@kamols
Copy link
Copy Markdown

kamols commented Apr 5, 2026

https://www.youtube.com/watch?v=AKKx1PoNtnM

This was spot on - thanks for this Abhishek

@Hemanth26080
Copy link
Copy Markdown

i have 8 gb ram in my laptop which claude model is perfect for my laptop that works fine . if anyone knows kindly helps me @Hemanth26080

What I did was I just installed Claude code, and I configured the OpenRoute API key without any installation. I started using all the free model in openroute for free. I hope this information will helpful. @iam-veeramalla @aneeshksoft @ShubhmPatil @chinthakindi-saikumar @Kalyani-192006

@AnshumanBharatiya
Copy link
Copy Markdown

i have 8 gb ram in my laptop which claude model is perfect for my laptop that works fine . if anyone knows kindly helps me @Hemanth26080

What I did was I just installed Claude code, and I configured the OpenRoute API key without any installation. I started using all the free model in openroute for free. I hope this information will helpful. @iam-veeramalla @aneeshksoft @ShubhmPatil @chinthakindi-saikumar @Kalyani-192006

Which Is Bettter Open Router or Ollama?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment