English
Related papers

Related papers: Self-Supervised Flow Matching for Scalable Multi-M…

200 papers

Flow Matching (FM) is a simulation-free method for learning a continuous and invertible flow to interpolate between two distributions, and in particular to generate data from noise. Inspired by the variational nature of the diffusion…

Machine Learning · Statistics 2025-07-14 Chen Xu , Xiuyuan Cheng , Yao Xie

Flow matching has emerged as a promising framework for training generative models, demonstrating impressive empirical performance while offering relative ease of training compared to diffusion-based models. However, this method still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Quan Dao , Hao Phung , Trung Dao , Dimitris Metaxas , Anh Tran

Generating high-quality time series data has emerged as a critical research topic due to its broad utility in supporting downstream time series mining tasks. A major challenge lies in modeling the intrinsic stochasticity of temporal…

Artificial Intelligence · Computer Science 2025-11-20 He Panjing , Cheng Mingyue , Li Li , Zhang XiaoHan

Recent works have shown that optical flow can be learned by deep networks from unlabelled image pairs based on brightness constancy assumption and smoothness prior. Current approaches additionally impose an augmentation regularization term…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lingtong Kong , Jie Yang

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

Machine Learning · Computer Science 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

Simulation-free methods for training continuous-time generative models construct probability paths that go between noise distributions and individual data samples. Recent works, such as Flow Matching, derived paths that are optimal for each…

Data scarcity and weak supervision continue to limit the performance of machine learning models in many real-world applications, such as mammography, where Multiple Instance Learning (MIL) often offers the best formulation. While recent…

Machine Learning · Computer Science 2026-04-21 Nikola Jovišić , Milica Škipina , Vanja Švenda

Flow matching is a recent framework to train generative models that exhibits impressive empirical performance while being relatively easier to train compared with diffusion-based models. Despite its advantageous properties, prior methods…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Quan Dao , Hao Phung , Binh Nguyen , Anh Tran

Foundation models have demonstrated remarkable performance across modalities such as language and vision. However, model reuse across distinct modalities (e.g., text and vision) remains limited due to the difficulty of aligning internal…

Machine Learning · Computer Science 2025-05-20 Ali Gholamzadeh , Noor Sajid

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and…

Recent advancements in flow-matching have enabled high-quality text-to-image generation. However, the deterministic nature of flow-matching models makes them poorly suited for reinforcement learning, a key tool for improving image quality…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Benjamin Yu , Jackie Liu , Justin Cui

Recent progress in flow-based generative models and reinforcement learning (RL) has improved text-image alignment and visual quality. However, current RL training for flow models still has two main problems: (i) GRPO-style fixed per-prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kaijie Chen , Zhiyang Xu , Ying Shen , Zihao Lin , Yuguang Yao , Lifu Huang

The goal of this work is to train discriminative cross-modal embeddings without access to manually annotated data. Recent advances in self-supervised learning have shown that effective representations can be learnt from natural cross-modal…

Sound · Computer Science 2020-11-05 Soo-Whan Chung , Hong Goo Kang , Joon Son Chung

We introduce a novel training strategy for stereo matching and optical flow estimation that utilizes image-to-image translation between synthetic and real image domains. Our approach enables the training of models that excel in real image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zhexiao Xiong , Feng Qiao , Yu Zhang , Nathan Jacobs

Flow matching has emerged as a powerful framework for generative modeling, with recent empirical successes highlighting the effectiveness of signal-space prediction ($x$-prediction). In this work, we investigate the transfer of this…

Machine Learning · Computer Science 2026-05-05 Jiadong Hong , Lei Liu , Xinyu Bian , Wenjie Wang , Zhaoyang Zhang

This work presents DCFlow, a novel unsupervised cross-modal flow estimation framework that integrates a decoupled optimization strategy and a cross-modal consistency constraint. Unlike previous approaches that implicitly learn flow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Runmin Zhang , Jialiang Wang , Si-Yuan Cao , Zhu Yu , Junchen Yu , Guangyi Zhang , Hui-Liang Shen

Generative models have gained more and more attention in recent years for their remarkable success in tasks that required estimating and sampling data distribution to generate high-fidelity synthetic data. In speech, text-to-speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-27 Alexander H. Liu , Matt Le , Apoorv Vyas , Bowen Shi , Andros Tjandra , Wei-Ning Hsu

Representation learning is important for solving sequence-to-sequence problems in natural language processing. Representation learning transforms raw data into vector-form representations while preserving their features. However, data with…

Computation and Language · Computer Science 2023-01-12 Yunhao Yang , Zhaokun Xue , Andrew Whinston

Although diffusion models in text-to-speech have become a popular choice due to their strong generative ability, the intrinsic complexity of sampling from diffusion models harms their efficiency. Alternatively, we propose VoiceFlow, an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 Yiwei Guo , Chenpeng Du , Ziyang Ma , Xie Chen , Kai Yu

Conventional physically based rendering (PBR) pipelines generate photorealistic images through computationally intensive light transport simulations. Although recent deep learning approaches leverage diffusion model priors with geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Shenghao Zhang , Runtao Liu , Christopher Schroers , Yang Zhang