English
Related papers

Related papers: OneFlow: Concurrent Mixed-Modal and Interleaved Ge…

200 papers

The fashion domain encompasses a variety of real-world multimodal tasks, including multimodal retrieval and multimodal generation. The rapid advancements in artificial intelligence generated content, particularly in technologies like large…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiangyu Zhao , Yuehan Zhang , Wenlong Zhang , Xiao-Ming Wu

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen

MeanFlow offers a promising framework for one-step generative modeling by directly learning a mean-velocity field, bypassing expensive numerical integration. However, we find that the highly curved generative trajectories of existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xinxi Zhang , Shiwei Tan , Quang Nguyen , Quan Dao , Ligong Han , Xiaoxiao He , Tunyu Zhang , Chengzhi Mao , Dimitris Metaxas , Vladimir Pavlovic

We introduce $\texttt{PairFlow}$, a lightweight preprocessing step for training Discrete Flow Models (DFMs) to achieve few-step sampling without requiring a pretrained teacher. DFMs have recently emerged as a new class of generative models…

Machine Learning · Computer Science 2026-05-26 Mingue Park , Jisung Hwang , Seungwoo Yoo , Kyeongmin Yeo , Minhyuk Sung

Diffusion models arise as a powerful generative tool recently. Despite the great progress, existing diffusion models mainly focus on uni-modal control, i.e., the diffusion process is driven by only one modality of condition. To further…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziqi Huang , Kelvin C. K. Chan , Yuming Jiang , Ziwei Liu

Long video generation has gained increasing attention due to its widespread applications in fields such as entertainment and simulation. Despite advances, synthesizing temporally coherent and visually compelling long sequences remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jiahao Chen , Hangjie Yuan , Yichen Qian , Jingyun Liang , Jiazheng Xing , Pengwei Liu , Weihua Chen , Fan Wang , Bing Su

We introduce VideoFlow, a novel optical flow estimation framework for videos. In contrast to previous methods that learn to estimate optical flow from two frames, VideoFlow concurrently estimates bi-directional optical flows for multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiaoyu Shi , Zhaoyang Huang , Weikang Bian , Dasong Li , Manyuan Zhang , Ka Chun Cheung , Simon See , Hongwei Qin , Jifeng Dai , Hongsheng Li

Visually-guided acoustic highlighting seeks to rebalance audio in alignment with the accompanying video, creating a coherent audio-visual experience. While visual saliency and enhancement have been widely studied, acoustic highlighting…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-05 Hugo Malard , Gael Le Lan , Daniel Wong , David Lou Alon , Yi-Chiao Wu , Sanjeel Parekh

We present PixelFlow, a family of image generation models that operate directly in the raw pixel space, in contrast to the predominant latent-space models. This approach simplifies the image generation process by eliminating the need for a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Shoufa Chen , Chongjian Ge , Shilong Zhang , Peize Sun , Ping Luo

Though Rectified Flows (ReFlows) with distillation offers a promising way for fast sampling, its fast inversion transforms images back to structured noise for recovery and following editing remains unsolved. This paper introduces FireFlow,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yingying Deng , Xiangyu He , Changwang Mei , Peisong Wang , Fan Tang

Large language models (LLMs) have demonstrated promising performance in both automatic speech recognition (ASR) and text-to-speech (TTS) systems, gradually becoming the mainstream approach. However, most current approaches address these…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-21 Wenhao Guan , Zhikang Niu , Ziyue Jiang , Kaidi Wang , Peijie Chen , Qingyang Hong , Lin Li , Xie Chen

Non-autoregressive (NAR) language models offer notable efficiency in text generation by circumventing the sequential bottleneck of autoregressive decoding. However, accurately modeling dependencies in discrete sequences remains challenging…

Computation and Language · Computer Science 2026-05-05 Egor Sevriugov , Nikita Dragunov , Anton Razzhigaev , Andrey Kuznetsov , Ivan Oseledets

One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillation-free methods, MeanFlow training is notoriously unstable, with non-decreasing loss and…

Machine Learning · Computer Science 2026-05-12 Juanwu Lu , Ziran Wang

Unified Vision-Language Models (UVLMs) aim to advance multimodal learning by supporting both understanding and generation within a single framework. However, existing approaches largely focus on architectural unification while overlooking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Shengqiong Wu , Bobo Li , Xinkai Wang , Xiangtai Li , Lei Cui , Furu Wei , Shuicheng Yan , Hao Fei , Tat-seng Chua

While text-to-video diffusion models have made significant strides, many still face challenges in generating videos with temporal consistency. Within diffusion frameworks, guidance techniques have proven effective in enhancing output…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Hyelin Nam , Jaemin Kim , Dohun Lee , Jong Chul Ye

Learning with neural networks from a continuous stream of visual information presents several challenges due to the non-i.i.d. nature of the data. However, it also offers novel opportunities to develop representations that are consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci

Diffusion-based imitation learning improves Behavioral Cloning (BC) on multi-modal decision-making, but comes at the cost of significantly slower inference due to the recursion in the diffusion process. It urges us to design efficient…

Machine Learning · Computer Science 2024-11-25 Xixi Hu , Bo Liu , Xingchao Liu , Qiang Liu

Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it requires many iterative updates. We introduce W-Flow, a framework for training a…

Machine Learning · Computer Science 2026-05-28 Jiaqi Han , Puheng Li , Qiushan Guo , Renyuan Xu , Stefano Ermon , Emmanuel J. Candès

Flow-based image generative models exhibit stable training and produce high quality samples when using multi-step sampling procedures. One-step generative models can produce high quality image samples but can be difficult to optimize as…

Machine Learning · Computer Science 2026-04-13 Chia-Hong Hsu , Frank Wood

In this paper, we introduce OneReward, a unified reinforcement learning framework that enhances the model's generative capabilities across multiple tasks under different evaluation criteria using only \textit{One Reward} model. By employing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Gong , Xionghui Wang , Jie Wu , Shiyin Wang , Yitong Wang , Xinglong Wu