中文
相关论文

相关论文: MADFormer: Mixed Autoregressive and Diffusion Tran…

200 篇论文

We introduce nested diffusion models, an efficient and powerful hierarchical generative framework that substantially enhances the generation quality of diffusion models, particularly for images of complex scenes. Our approach employs a…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Xiao Zhang , Ruoxi Jiang , Rebecca Willett , Michael Maire

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

机器学习 · 计算机科学 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

The video generation field has witnessed rapid improvements with the introduction of recent diffusion models. While these models have successfully enhanced appearance quality, they still face challenges in generating coherent and natural…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Yaosi Hu , Zhenzhong Chen , Chong Luo

Machine learning models have demonstrated remarkable efficacy and efficiency in a wide range of stock forecasting tasks. However, the inherent challenges of data scarcity, including low signal-to-noise ratio (SNR) and data homogeneity, pose…

统计金融 · 定量金融 2024-02-13 Yuan Gao , Haokun Chen , Xiang Wang , Zhicai Wang , Xue Wang , Jinyang Gao , Bolin Ding

With the rapid development of imaging sensor technology in the field of remote sensing, multi-modal remote sensing data fusion has emerged as a crucial research direction for land cover classification tasks. While diffusion models have made…

计算机视觉与模式识别 · 计算机科学 2024-01-08 DaiXun Li , Weiying Xie , ZiXuan Wang , YiBing Lu , Yunsong Li , Leyuan Fang

Diffusion-based models demonstrate impressive generation capabilities. However, they also have a massive number of parameters, resulting in enormous model sizes, thus making them unsuitable for deployment on resource-constraint devices.…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Avideep Mukherjee , Soumya Banerjee , Piyush Rai , Vinay P. Namboodiri

In the realm of image generation, the quest for realism and customization has never been more pressing. While existing methods like concept sliders have made strides, they often falter when it comes to no-AIGC images, particularly images…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Yufei Tang , Daiheng Gao , Pingyu Wu , Wenbo Zhou , Bang Zhang , Weiming Zhang

Autoregressive video diffusion models (AR-VDMs) show strong promise as scalable alternatives to bidirectional VDMs, enabling real-time and interactive applications. Yet there remains room for improvement in their sample fidelity. A…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Zhengyang Yu , Akio Hayakawa , Masato Ishii , Qingtao Yu , Takashi Shibuya , Jing Zhang , Yuki Mitsufuji

Diffusion models have emerged as powerful tools for high-quality image generation and editing, but guiding these models to produce specific outputs remains a challenge. Conventional approaches rely on conditioning mechanisms, such as text…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Nithesh Chandher Karthikeyan , Jonas Unger , Gabriel Eilertsen

We introduce DC-AR, a novel masked autoregressive (AR) text-to-image generation framework that delivers superior image generation quality with exceptional computational efficiency. Due to the tokenizers' limitations, prior masked AR models…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yecheng Wu , Junyu Chen , Zhuoyang Zhang , Enze Xie , Jincheng Yu , Junsong Chen , Jinyi Hu , Yao Lu , Song Han , Han Cai

The rapid evolution of the fashion industry increasingly intersects with technological advancements, particularly through the integration of generative AI. This study introduces a novel generative pipeline designed to transform the fashion…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Abhishek Kumar Singh , Ioannis Patras

We present MagicMirror, a framework for generating identity-preserved videos with cinematic-level quality and dynamic motion. While recent advances in video diffusion models have shown impressive capabilities in text-to-video generation,…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yuechen Zhang , Yaoyang Liu , Bin Xia , Bohao Peng , Zexin Yan , Eric Lo , Jiaya Jia

While diffusion-based generative models have made significant strides in visual content creation, conventional approaches face computational challenges, especially for high-resolution images, as they denoise the entire image from noisy…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Haohang Xu , Longyu Chen , Yichen Zhang , Shuangrui Ding , Zhipeng Zhang

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Indoor semantic segmentation is fundamental to computer vision and robotics, supporting applications such as autonomous navigation, augmented reality, and smart environments. Although RGB-D fusion leverages complementary appearance and…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Yan Gong , Jianli Lu , Yongsheng Gao , Jie Zhao , Xiaojuan Zhang , Susanto Rahardja

Current multi-modal image fusion methods typically rely on task-specific models, leading to high training costs and limited scalability. While generative methods provide a unified modeling perspective, they often suffer from slow inference…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Huayi Zhu , Xiu Shu , Youqiang Xiong , Qiao Liu , Rui Chen , Di Yuan , Xiaojun Chang , Zhenyu He

Video diffusion models have advanced rapidly in the recent years as a result of series of architectural innovations (e.g., diffusion transformers) and use of novel training objectives (e.g., flow matching). In contrast, less attention has…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Dohun Lee , Hyeonho Jeong , Jiwook Kim , Duygu Ceylan , Jong Chul Ye

Autoregressive (AR) models for image generation typically adopt a two-stage paradigm of vector quantization and raster-scan ``next-token prediction", inspired by its great success in language modeling. However, due to the huge modality gap,…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Hu Yu , Hao Luo , Hangjie Yuan , Yu Rong , Jie Huang , Feng Zhao