#

request-scheduling

Here is 1 public repository matching this topic...

cysong2025 / flashdec

Single-GPU LLM decode research prototype: paged KV cache, Triton attention, CUDA append, scheduling, shared prefixes, and multi-layer transactions.

cuda pytorch triton gpu-kernels kv-cache llm-inference paged-attention flashinfer prefix-caching systems-research inference-runtime request-scheduling

Updated Jul 26, 2026
Python

Improve this page

Add a description, image, and links to the request-scheduling topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the request-scheduling topic, visit your repo's landing page and select "manage topics."