Skip to content

Repository files navigation

DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space

📖 Overview

teaser

DC-Gen delivers high-quality, high-resolution visual generation across text-to-image, text-to-video, image-to-video, and image editing tasks, achieving up to 53.8× speedup over pre-trained diffusion models.

🎬 Demo

Watch the video

🔥🔥 News

  • (🔥 New) [2026/6/18] DC-Gen is accepted by ECCV 2026! 🎉
  • (🔥 New) [2025/9/30] We released the DC-Gen technical report on arXiv.
  • (🔥 New) [2025/9/30] We released DC-AE-Lite.
  • [2025/6] DC-AE 1.5 is accepted by ICCV 2025!

💡 Introduction

DC-Gen is a new acceleration framework for diffusion models. DC-Gen works with any pre-trained diffusion model, boosting efficiency by transferring it into a deeply compressed latent space with lightweight post-training. For example, applying DC-Gen to FLUX.1-Krea takes just 31 H100 GPU days. The resulting DC-Gen-FLUX delivers the same quality as the base model while achieving dramatic gains—53.8× faster inference on H100 at 4K resolution. DC-Gen has been validated across text-to-image, text-to-video, image-to-video, and image editing tasks.

Highlight 1: DC-Gen Enables Native High-Resolution Image Generation with Exceptional Efficiency

  • FLUX and Z-Image do not support native 4K image generation due to prohibitive training and inference costs. DC-Gen-FLUX and DC-Gen-Z-Image address this limitation by reducing token redundancy with DC-AE-f64c128.

teaser_page2

  • The relative speedup of DC-Gen is more significant at higher resolutions, achieving up to 53.8× acceleration on DC-Gen-FLUX.

teaser_page3

Highlight 2: DC-Gen Maintains Base Model Quality

Modern visual diffusion models are recognized for their superior realism and text-rendering capabilities but suffer from low throughput. DC-Gen models successfully preserve these qualities while delivering a significant speedup over corresponding base models.

  • Comparison to Previous Models on 1024×1024 Resolution.

teaser_page4

  • Comparison to pre-trained Wan2.1 on 720×1280 Resolution, 81 frames.

Text-to-Video

Wan2.1-T2V-14B
(27.52 mins/video)
DC-Gen-Wan2.1-T2V-14B
(3.58 mins/video)
Wan2.1-T2V-14B
(27.52 mins/video)
DC-Gen-Wan2.1-T2V-14B
(3.58 mins/video)

Image-to-Video

Wan2.1-I2V-14B
(27.88 mins/video)
DC-Gen-Wan2.1-I2V-14B
(3.67 mins/video)
Wan2.1-I2V-14B
(27.88 mins/video)
DC-Gen-Wan2.1-I2V-14B
(3.67 mins/video)
  • Comparison to pre-trained Qwen-Image-Edit on 1K image editing tasks.

qwen_edit_comparison

Highlight 3: DC-Gen Facilitates Rapid and Stable Autoencoder Adaptation

Previously, changing the autoencoder required retraining diffusion models from scratch, which was highly inefficient. DC-Gen introduces Embedding Alignment to transfer the base model's knowledge to the new latent space. After this alignment, the model can perform visual generation with correct semantics in the new latent space without finetuning the diffusion model's weights. With only a few steps of end-to-end fine-tuning, the DC-Gen models can already achieve visual generation quality comparable to pre-trained models.

teaser_page5

Following embedding alignment, we can fully recover the quality through LoRA finetuning.

teaser_page5

Getting Started

conda create -n dc_gen python=3.10
conda activate dc_gen
pip install -U -r requirements.txt

Content

DC-Gen CLI

Run DC-Gen locally with a simple command-line interface. Supports text-to-image (1K and 4K), text-to-video, image-to-video, and instruction-based image editing.

export HF_TOKEN=<your_hf_token>
python generate.py task=<task> prompt="<text>" save_path=<path> [options]
Task Description VAE
t2i_1k Text-to-image, 1K resolution DC-AE-f32c32
t2i_4k Text-to-image, 4K resolution DC-AE-1.5-f64c128
t2v Text-to-video, 720p DC-AE-V-f32t4c32
i2v Image-to-video, 720p DC-AE-V-f32t4c32
edit Instruction-based image editing DC-AE-f32c32

Examples:

# Text-to-image 1K
python generate.py task=t2i_1k prompt="A cat lazily lying in a dog's arms in the sun" save_path=out.jpg

# Text-to-image 4K
python generate.py task=t2i_4k prompt="A mountain lake at dawn, mist rising" save_path=out.jpg width=4096 height=4096

# Text-to-video
python generate.py task=t2v prompt="A white cat wearing sunglasses surfs on a wave" save_path=out.mp4

# Image-to-video
python generate.py task=i2v input_image_path=cat.jpg prompt="The cat waves its paw" save_path=out.mp4

# Image editing
python generate.py task=edit input_image_path=photo.jpg prompt="Make the background snowy" save_path=edit.png

# Non-English prompt with auto-expand
python generate.py task=t2i_1k prompt="一只猫慵懒地躺在一只狗的怀里晒太阳。" save_path=out.jpg use_expander=yes

Model weights are downloaded automatically on first use from HuggingFace Hub into pretrained_models/.

Deep Compression Autoencoder

Contact

Han Cai

Related Projects

Reference

@article{he2025dc,
  title={DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space},
  author={He, Wenkun and Gu, Yuchao and Chen, Junyu and Zou, Dongyun and Lin, Yujun and Zhang, Zhekai and Xi, Haocheng and Li, Muyang and Zhu, Ligeng and Yu, Jincheng and others},
  journal={arXiv preprint arXiv:2509.25180},
  year={2025}
}

@article{chen2024deep,
  title={Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models},
  author={Chen, Junyu and Cai, Han and Chen, Junsong and Xie, Enze and Yang, Shang and Tang, Haotian and Li, Muyang and Lu, Yao and Han, Song},
  journal={arXiv preprint arXiv:2410.10733},
  year={2024}
}

@article{chen2025dc,
  title={DC-AE 1.5: Accelerating Diffusion Model Convergence with Structured Latent Space},
  author={Chen, Junyu and Zou, Dongyun and He, Wenkun and Chen, Junsong and Xie, Enze and Han, Song and Cai, Han},
  journal={arXiv preprint arXiv:2508.00413},
  year={2025}
}
@misc{zou2025dcaelite,
  title  = {DC-AE-Lite},
  author = {Zou, Dongyun and Chen, Junyu and He, Wenkun and Chen, Junsong and Xie, Enze and Han, Song and Cai, Han},
  url    = {https://github.com/dc-ai-projects/DC-Gen/blob/main/projects/DC-AE-Lite.md},
  month  = Sep,
  year   = {2025}
}

About

DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Space

Topics

Resources

Stars

406 stars

Watchers

22 watching

Forks

Releases

Packages

Contributors

Languages