claude code integration with ollama to use local models

claude_with_ollama.md

Run Claude with the power of Local LLMs using Ollama

Install Ollama

curl -fsSL https://ollama.com/install.sh | sh

Pull the Model

ollama pull glm-4.7-flash # or gpt-oss:20b (for better performance)

Install Claude

curl -fsSL https://claude.ai/install.sh | bash

Run Claude with Ollama

ollama launch claude --model glm-4.7-flash # or ollama launch claude --model glm-4.7-flash gpt-oss:20b

Hi @iam-veeramalla @ShubhmPatil @chinthakindi-saikumar - I am running Windows with PowerShell and set up Ollama with the local model qwen3.5:9b. I am not able to create or read or write the files in the project directory. After a lot of serch I found that Claude’s agent capabilities (filesystem tools, project scanning) exist only in Claude Code CLI, which requires Anthropic authentication and billing. Under Ollama-only execution, Claude behaves as a plain LLM without tool access, so automated codebase analysis is not possible. How did it work in your case?

Hi, did you find any solution for this?
I’m facing the same issue. I tested with local models like qwen3.5, and Claude Code behaves like a normal LLM (no file read/write, no tool usage).
But when I switched to a cloud model (qwen3.5:cloud), it worked properly and was able to create files using Claude Code.
Just wanted to check if you managed to get local models working with file operations, or if cloud is the only way right now.

https://www.youtube.com/watch?v=AKKx1PoNtnM

This was spot on - thanks for this Abhishek

i have 8 gb ram in my laptop which claude model is perfect for my laptop that works fine . if anyone knows kindly helps me @Hemanth26080

What I did was I just installed Claude code, and I configured the OpenRoute API key without any installation. I started using all the free model in openroute for free. I hope this information will helpful. @iam-veeramalla @aneeshksoft @ShubhmPatil @chinthakindi-saikumar @Kalyani-192006

i have 8 gb ram in my laptop which claude model is perfect for my laptop that works fine . if anyone knows kindly helps me @Hemanth26080

What I did was I just installed Claude code, and I configured the OpenRoute API key without any installation. I started using all the free model in openroute for free. I hope this information will helpful. @iam-veeramalla @aneeshksoft @ShubhmPatil @chinthakindi-saikumar @Kalyani-192006

Which Is Bettter Open Router or Ollama?