中文
相关论文

相关论文: JanusFlow: Harmonizing Autoregression and Rectifie…

200 篇论文

Learning matrix-valued distributions from high-dimensional and possibly incomplete training data is challenging: ambient-space generative modeling is computationally expensive and statistically fragile when the matrix dimension is large but…

机器学习 · 计算机科学 2026-04-29 Dongze Wu , Linglingzhi Zhu , Yao Xie

Modern generative modeling methods have demonstrated strong performance in learning complex data distributions from clean samples. In many scientific and imaging applications, however, clean samples are unavailable, and only noisy or…

机器学习 · 计算机科学 2026-05-29 Willem Diepeveen , Oscar Leong

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Image degradation from blur, noise, compression, and poor illumination severely undermines multimodal understanding in real-world settings. Unified multimodal models that combine understanding and generation within a single architecture are…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Xiangzhao Hao , Zefeng Zhang , Zhenyu Zhang , Linhao Yu , Yao Chen , Yiqian Zhang , Haiyun Guo , Shuohuan Wang , Yu Sun

We introduce RewardFlow, an inversion-free framework that steers pretrained diffusion and flow-matching models at inference time through multi-reward Langevin dynamics. RewardFlow unifies complementary differentiable rewards for semantic…

Diffusion models, and their generalization, flow matching, have had a remarkable impact on the field of media generation. Here, the conventional approach is to learn the complex mapping from a simple source distribution of Gaussian noise to…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Qihao Liu , Xi Yin , Alan Yuille , Andrew Brown , Mannat Singh

We present a unified formulation and model for three motion and 3D perception tasks: optical flow, rectified stereo matching and unrectified stereo depth estimation from posed images. Unlike previous specialized architectures for each…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Fisher Yu , Dacheng Tao , Andreas Geiger

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF),…

机器学习 · 计算机科学 2025-08-26 Haochen You , Baojing Liu , Hongyang He

We suggest a new multi-modal algorithm for joint inference of paired structurally aligned samples with Rectified Flow models. While some existing methods propose a codependent generation process, they do not view the problem of joint…

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Flow matching is a recent framework to train generative models that exhibits impressive empirical performance while being relatively easier to train compared with diffusion-based models. Despite its advantageous properties, prior methods…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Quan Dao , Hao Phung , Binh Nguyen , Anh Tran

Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are particularly useful when the training data appears to be…

高能物理 - 唯象学 · 物理学 2026-04-30 Zachary Bogorad , Ibrahim Elsharkawy , Yonatan Kahn , Andrew J. Larkoski , Noam Levi

We introduce UniToken, an auto-regressive generation model that encodes visual inputs through a combination of discrete and continuous representations, enabling seamless integration of unified visual understanding and image generation…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Yang Jiao , Haibo Qiu , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Unified image understanding and generation has emerged as a promising paradigm in multimodal artificial intelligence. Despite recent progress, the optimal architectural design for such unified models remains an open challenge. In this work,…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Teng Li , Quanfeng Lu , Lirui Zhao , Hao Li , Xizhou Zhu , Yu Qiao , Jun Zhang , Wenqi Shao

Unsupervised Reinforcement Learning from Internal Feedback (RLIF) has emerged as a promising paradigm for eliciting the latent capabilities of Large Language Models (LLMs) without external supervision. However, current methods rely on…

计算与语言 · 计算机科学 2026-05-26 Ruishuo Chen , Yu Chen , Zhuoran Li , Longbo Huang

Image restoration aims to recover high-quality (HQ) images from degraded low-quality (LQ) ones by reversing the effects of degradation. Existing generative models for image restoration, including diffusion and score-based models, often…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Haina Qin , Wenyang Luo , Libin Wang , Dandan Zheng , Jingdong Chen , Ming Yang , Bing Li , Weiming Hu

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent…

机器学习 · 计算机科学 2025-11-25 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

Diffusion and flow-based generative models have shown strong potential for image restoration. However, image denoising under unknown and varying noise conditions remains challenging, because the learned vector fields may become inconsistent…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Jigang Duan , Genwei Ma , Xu Jiang , Wenfeng Xu , Ping Yang , Xing Zhao

Unifying visual understanding and generation within a single multimodal framework remains a significant challenge, as the two inherently heterogeneous tasks require representations at different levels of granularity. Current approaches that…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Size Wu , Wenwei Zhang , Lumin Xu , Sheng Jin , Zhonghua Wu , Qingyi Tao , Wentao Liu , Wei Li , Chen Change Loy

Unified models aim to support both understanding and generation by encoding images into discrete tokens and processing them alongside text within a single autoregressive framework. This unified design offers architectural simplicity and…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Ziyao Wang , Chen Chen , Jingtao Li , Weiming Zhuang , Jiabo Huang , Ang Li , Lingjuan Lyu