Nebu manages model weights and inference runtimes. Named after the Nebuchadnezzar from The Matrix.

Runtimes	llama.cpp, vLLM, SGLang, NeMo, stable-diffusion.cpp
Diffusers	image and video generation
Runtime installation	use an existing binary, download one, or build from source
Model sources	Hugging Face, GitHub, Ollama, ModelScope, Civitai, Kaggle, NGC, CSGHub, OCI registries, git, mirrors, and local directories
APIs	OpenAI, Anthropic, Ollama
Tools	Shipped with web search through SearXNG or Brave
MCP	Available at /mcp for Claude Code, Claude Desktop, and other clients
Discord	text, images, video, personas, automations, and sharding
Platforms	Linux, macOS, Windows, and FreeBSD
SSO/OIDC	Supports all OpenID Connect Providers. See compose.yaml or packaging/config.yaml
Local Auth	Local username/password enabled by default in the web ui. Token auth enabled after a token is generated in user settings.

Install

Arch Linux

yay -S nebu-bin # or nebu to build from source
systemctl --user enable --now nebu.service

Docker

docker run -d --name nebu -p 127.0.0.1:8484:8484 \
  -v nebu:/var/lib/nebu -v nebu-cache:/var/cache/nebu \
  ghcr.io/nickheyer/nebu

docker run -d --name nebu -p 127.0.0.1:8484:8484 --gpus all \
  -v nebu:/var/lib/nebu -v nebu-cache:/var/cache/nebu \
  ghcr.io/nickheyer/nebu:cuda

Docker Compose

git clone https://github.com/nickheyer/nebu && cd nebu
sudo install -d -o 10001 -g 10001 /srv/nebu /srv/nebu-cache && mkdir -p models

docker compose up -d                                         # CPU
docker compose -f compose.yaml -f compose.nvidia.yaml up -d  # NVIDIA
NEBU_VIDEO_GID=$(getent group video | cut -d: -f3) \
NEBU_RENDER_GID=$(getent group render | cut -d: -f3) \
  docker compose -f compose.yaml -f compose.rocm.yaml up -d  # AMD

Binary

Prebuilt binaries available for all platforms at GitHub Releases

curl -fsSL https://api.github.com/repos/nickheyer/nebu/releases/latest \
  | grep -o 'https://[^"]*linux_amd64.tar.gz' | xargs curl -fsSL | tar -xz nebu
./nebu serve

Build

Requires Go 1.27, Docker, and Make.

make gen
make build

See Makefile for other commands.