AI Agents

Open WebUI + Ollama

Self-hosted chat UI over locally-run open models.

About

Installs Ollama (local LLM runtime) and Open WebUI in Docker, wired together so you can pull a model and chat with it entirely on your own instance. GPU flavors accelerate inference automatically if an NVIDIA driver + runtime is present; CPU-only sizes work too, just slower.

After boot, SSH in and run: docker exec -it ollama ollama pull llama3.1 (or any model) before chatting from the web UI.

Ports opened by the installer

3000/tcp · Open WebUI

Install script (runs as cloud-init user-data on first boot)

#!/bin/bash
set -e
apt-get update -y
apt-get install -y ca-certificates curl gnupg
install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
chmod a+r /etc/apt/keyrings/docker.asc
. /etc/os-release
echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu $VERSION_CODENAME stable" > /etc/apt/sources.list.d/docker.list
apt-get update -y
apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
systemctl enable --now docker
docker run -d --name ollama --restart=always -v ollama:/root/.ollama -p 11434:11434 ollama/ollama
docker run -d --name open-webui --restart=always -p 3000:8080 -e OLLAMA_BASE_URL=http://host.docker.internal:11434 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data ghcr.io/open-webui/open-webui:main

Minimum requirements

vCPU: 4
Memory: 8 GB
Disk: 40 GB
Base image: ubuntu