[Roadmap] DMI Roadmap — 2026 Q2

[Samfisheryu]

Tracking issue for the next development cycle following the public release (#32).

Near-term

• Manual model coverage — most vLLM models and mainstream HF models, using hidden_states and logits hook points only.
• Model Hook Compiler — auto-generate hooked model files from a spec. Active branch: feat/hook-compiler. Tracked in Hook Interface & Model Compiler — Auto-inject HookPoints into model files #36.
• Compiler-driven model coverage — use the compiler to expand existing models to full internal hook points (attention / MLP / residual / etc.).
• Policy Manager — unify selection, sampling, triggers, and backpressure into one declarative Policy object consumed per-run by adapters.
• Expert Parallel (EP) support. Tracked in [Core] Add Qwen-MoE dense/source-layout and routing-side hooks #48

Mid-term

• New backend adapter: SGLang
• CI/CD — pipeline [tests] Set up CI/CD pipeline (ROADMAP) #55 (prerequisite: test baseline [tests] Refactor stale tests and introduce a configurable correctness matrix #54)
• Routing hooks for MoE models
• More hooks due to parallelism, hooks before reduction != after

Long-term

• Explore online monitoring (streaming analytics on captured internals)
• Explore agentic workflows on top of DMI