cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

An open-source interface to use the multiple-precision solver SDPA-GMP with YALMIP

Memory-optimized SongGeneration (v2 Large) for 16GB VRAM GPUs. Features 8-bit µ-law KV-caching, fused layers, and SDPA/Triton integration.

PyTorch implementation of YOLOv12 with Scaled Dot-Product Attention (SDPA) optimized by FlashAttention for fast and efficient object detection.

A 66M parameter decoder-only transformer language model implemented from scratch in PyTorch. Features a custom SentencePiece tokenizer, RoPE positional embeddings, SwiGLU feed-forward network, per-layer KV cache for efficient autoregressive inference, and a Svelte-based streaming chat interface.

Long-context benchmark pushing Qwen2-0.5B from 4K to 32K tokens on RTX 2070 using SDPA + chunked prefill. Shows 40x speedup at 8K, FP16 beating INT4 at long context, and that quantization is NOT a long-context solution — KV-cache is the real bottleneck.

Attention backend benchmark on Turing GPUs comparing Vanilla, SDPA Math, SDPA Efficient, and a custom Triton FlashAttention implementation. SDPA efficient achieves 130× memory reduction and 10× speedup; Triton FA achieves O(n) memory but is 64× slower than SDPA efficient on RTX 2070.