1.5 KiB
1.5 KiB
Ollama + Claude Code — Docker Setup
Run qwen2.5-coder:32b locally via Ollama, with Claude Code wired up to use it as its backend.
Prerequisites
- Docker & Docker Compose v2
- NVIDIA Container Toolkit installed on the host
- NVIDIA GPU with 32 GB+ VRAM (or large system RAM for CPU offload)
Quick Start
# 1. Clone this repository
git clone https://forge.wilddragon.net/zgaetano/ollama-claude-code.git
cd ollama-claude-code
# 2. Build and start both services
docker compose up -d --build
# 3. Watch Ollama pull the model on first run
docker compose logs -f ollama
# 4. Shell into the Claude Code container
docker compose exec claude-code bash
# 5. Start Claude Code
claude
Environment Variables
ollama service
| Variable | Default | Description |
|---|---|---|
| OLLAMA_HOST | 0.0.0.0 | Interface Ollama listens on |
| OLLAMA_KEEP_ALIVE | 24h | How long to keep the model loaded |
| OLLAMA_MODEL | qwen2.5-coder:32b | Model to pull on startup |
claude-code service
| Variable | Default | Description |
|---|---|---|
| ANTHROPIC_BASE_URL | http://ollama:11434/v1 | Points Claude Code at local Ollama |
| ANTHROPIC_API_KEY | ollama | Dummy key (Ollama does not verify it) |
| CLAUDE_CODE_DEFAULT_MODEL | qwen2.5-coder:32b | Model Claude Code will use |
Volumes
ollama_data- persists downloaded models across restartsworkspace- shared workspace inside the claude-code container
Stopping
docker compose down
# To also remove model data:
docker compose down -v