English
Related papers

Related papers: SANA-WM: Efficient Minute-Scale World Modeling wit…

200 papers

We introduce SANA-Video, a small diffusion model that can efficiently generate videos up to 720x1280 resolution and minute-length duration. SANA-Video synthesizes high-resolution, high-quality and long videos with strong text-video…

We introduce Sana, a text-to-image framework that can efficiently generate images up to 4096$\times$4096 resolution. Sana can synthesize high-resolution, high-quality images with strong text-image alignment at a remarkably fast speed,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Enze Xie , Junsong Chen , Junyu Chen , Han Cai , Haotian Tang , Yujun Lin , Zhekai Zhang , Muyang Li , Ligeng Zhu , Yao Lu , Song Han

This paper presents SANA-1.5, a linear Diffusion Transformer for efficient scaling in text-to-image generation. Building upon SANA-1.0, we introduce three key innovations: (1) Efficient Training Scaling: A depth-growth paradigm that enables…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Enze Xie , Junsong Chen , Yuyang Zhao , Jincheng Yu , Ligeng Zhu , Chengyue Wu , Yujun Lin , Zhekai Zhang , Muyang Li , Junyu Chen , Han Cai , Bingchen Liu , Daquan Zhou , Song Han

Recent video diffusion foundation models have achieved remarkable progress in high-quality video generation, yet turning them into real-time interactive video world models remains challenging. Interactive world models require controllable,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Min Zhao , Hongzhou Zhu , Bokai Yan , Zihan Zhou , Yimin Chen , Wenqiang Sun , Kaiwen Zheng , Guande He , Xiao Yang , Chongxuan Li , Fan Bao , Jun Zhu

This paper presents SANA-Sprint, an efficient diffusion model for ultra-fast text-to-image (T2I) generation. SANA-Sprint is built on a pre-trained foundation model and augmented with hybrid distillation, dramatically reducing inference…

Graphics · Computer Science 2025-09-30 Junsong Chen , Shuchen Xue , Yuyang Zhao , Jincheng Yu , Sayak Paul , Junyu Chen , Han Cai , Song Han , Enze Xie

While Transformers have become the dominant architecture for visual generation, linear attention models, such as the state-space models (SSM), are increasingly recognized for their efficiency in processing long visual sequences. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yicong Hong , Long Mai , Yuan Yao , Feng Liu

World models have become a central paradigm for learning predictive simulators that support generation, planning, and decision-making. Yet, despite rapid progress in industry-scale interactive video generation, the broader research…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Siqiao Huang , Partha Kaushik , Michael Chen , Hengkai Pan , Kaiwen Geng , Omar Chehab , Fernando Moreno-Pino , Max Simchowitz

Video generation is a critical pathway toward world models, with efficient long video inference as a key capability. Toward this end, we introduce LongCat-Video, a foundational video generation model with 13.6B parameters, delivering strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Meituan LongCat Team , Xunliang Cai , Qilong Huang , Zhuoliang Kang , Hongyu Li , Shijun Liang , Liya Ma , Siyu Ren , Xiaoming Wei , Rixu Xie , Tong Zhang

Given the remarkable achievements in image generation through diffusion models, the research community has shown increasing interest in extending these models to video generation. Recent diffusion models for video generation have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yuta Oshima , Shohei Taniguchi , Masahiro Suzuki , Yutaka Matsuo

Recent advances in video diffusion models have shifted towards transformer-based architectures, achieving state-of-the-art video generation but at the cost of quadratic attention complexity, which severely limits scalability for longer…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Mohsen Ghafoorian , Amirhossein Habibian

This paper introduces EasyAnimate, an efficient and high quality video generation framework that leverages diffusion transformers to achieve high-quality video production, encompassing data processing, model training, and end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Jiaqi Xu , Kunzhe Huang , Xinyi Zou , Yunkuo Chen , Bo Liu , MengLi Cheng , Jun Huang , Xing Shi

Pretrained video diffusion models provide powerful spatiotemporal generative priors, making them a natural foundation for robotic world models. While recent world-action models jointly optimize future videos and actions, they predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhaoyang Yang , Yurun Jin , Lizhe Qi , Cong Huang , Kai Chen

Contemporary models for generating images show remarkable quality and versatility. Swayed by these advantages, the research community repurposes them to generate videos. Since video content is highly redundant, we argue that naively…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Willi Menapace , Aliaksandr Siarohin , Ivan Skorokhodov , Ekaterina Deyneka , Tsai-Shien Chen , Anil Kag , Yuwei Fang , Aleksei Stoliar , Elisa Ricci , Jian Ren , Sergey Tulyakov

The landscape of high-performance image generation models is currently dominated by proprietary systems, such as Nano Banana Pro and Seedream 4.0. Leading open-source alternatives, including Qwen-Image, Hunyuan-Image-3.0 and FLUX.2, are…

Video diffusion models have recently shown promise for world modeling through autoregressive frame prediction conditioned on actions. However, they struggle to maintain long-term memory due to the high computational cost associated with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ryan Po , Yotam Nitzan , Richard Zhang , Berlin Chen , Tri Dao , Eli Shechtman , Gordon Wetzstein , Xun Huang

Instruction-based image editing is among the fastest developing areas in generative AI. Over the past year, the field has reached a new level, with dozens of open-source models released alongside highly capable commercial systems. However,…

Driving world models are used to simulate futures by video generation based on the condition of the current state and actions. However, current models often suffer serious error accumulations when predicting the long-term future, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Xiaodong Wang , Zhirong Wu , Peixi Peng

We propose X-WAM, a Unified 4D World Model that unifies real-time robotic action execution and high-fidelity 4D world synthesis (video + 3D reconstruction) in a single framework, addressing the critical limitations of prior unified world…

Robotics · Computer Science 2026-05-08 Jun Guo , Qiwei Li , Peiyan Li , Zilong Chen , Nan Sun , Yifei Su , Heyun Wang , Yuan Zhang , Xinghang Li , Huaping Liu

Diffusion models have recently achieved remarkable results for video generation. Despite the encouraging performances, the generated videos are typically constrained to a small number of frames, resulting in clips lasting merely a few…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhenxiong Tan , Xingyi Yang , Songhua Liu , Xinchao Wang

Diffusion Transformers have demonstrated remarkable performance in video generation. However, their long input sequences incur substantial latency due to the quadratic complexity of full attention. Various sparse attention mechanisms have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Tongcheng Fang , Hanling Zhang , Ruiqi Xie , Zhuo Han , Xin Tao , Tianchen Zhao , Pengfei Wan , Wenbo Ding , Wanli Ouyang , Xuefei Ning , Yu Wang
‹ Prev 1 2 3 10 Next ›