English
Related papers

Related papers: Conditional Flow Matching for Visually-Guided Acou…

200 papers

We study Bayesian inverse problems with mixed noise, modeled as a combination of additive and multiplicative Gaussian components. While traditional inference methods often assume fixed or known noise characteristics, real-world…

Machine Learning · Computer Science 2025-10-17 Paul Hagemann , Robert Gruhlke , Bernhard Stankewitz , Claudia Schillings , Gabriele Steidl

Recent diffusion and flow matching models have demonstrated strong capabilities in image generation and editing by progressively removing noise through iterative sampling. While this enables flexible inversion for semantic-preserving edits,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yasong Dai , Zeeshan Hayder , David Ahmedt-Aristizabal , Hongdong Li

Audio super-resolution aims to recover missing high-frequency details from bandwidth-limited low-resolution audio, thereby improving the naturalness and perceptual quality of the reconstructed signal. However, most existing methods directly…

Sound · Computer Science 2026-04-13 Fei Liu , Yang Ai , Hui-Peng Du , Yu-Fei Shi , Zhen-Hua Ling

The synthesis of synchronized audio-visual content is a key challenge in generative AI, with open-source models facing challenges in robust audio-video alignment. Our analysis reveals that this issue is rooted in three fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Teng Hu , Zhentao Yu , Guozhen Zhang , Zihan Su , Zhengguang Zhou , Youliang Zhang , Yuan Zhou , Qinglin Lu , Ran Yi

While text-to-video diffusion models have made significant strides, many still face challenges in generating videos with temporal consistency. Within diffusion frameworks, guidance techniques have proven effective in enhancing output…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Hyelin Nam , Jaemin Kim , Dohun Lee , Jong Chul Ye

We introduce MusicFlow, a cascaded text-to-music generation model based on flow matching. Based on self-supervised representations to bridge between text descriptions and music audios, we construct two flow matching networks to model the…

Flow matching has shown state-of-the-art performance in various generative tasks, ranging from image generation to decision-making, where generation under energy guidance (abbreviated as guidance in the following) is pivotal. However, the…

Machine Learning · Computer Science 2025-05-27 Ruiqi Feng , Chenglei Yu , Wenhao Deng , Peiyan Hu , Tailin Wu

Recent advances in generative modeling have demonstrated strong promise for high-quality point cloud upsampling. In this work, we present PUFM++, an enhanced flow-matching framework for reconstructing dense and accurate point clouds from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Zhi-Song Liu , Chenhang He , Roland Maier , Andreas Rupp

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, particularly for text-to-image generation. Despite its flexibility in allowing arbitrary source distributions, most existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Junwan Kim , Jiho Park , Seonghu Jeon , Seungryong Kim

Normalizing flow-based generative models have been widely used in applications where the exact density estimation is of major importance. Recent research proposes numerous methods to improve their expressivity. However, conditioning on a…

Machine Learning · Computer Science 2024-06-04 Denis Gudovskiy , Tomoyuki Okuno , Yohei Nakata

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

Machine Learning · Computer Science 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

Key objectives in conditional molecular generation include ensuring chemical validity, aligning generated molecules with target properties, promoting structural diversity, and enabling efficient sampling for discovery. Recent advances in…

Robust robot planning in dynamic, human-centric environments remains challenging due to multimodal uncertainty, the need for real-time adaptation, and safety requirements. Optimization-based planners enable explicit constraint handling but…

Robotics · Computer Science 2026-03-24 Kazuki Mizuta , Karen Leung

Conditional Flow Matching(CFM) represents a fast and high-quality approach to generative modelling, but in many applications it is of interest to steer the generated samples towards precise requirements. While steering approaches like…

Machine Learning · Computer Science 2025-09-03 Konstantin Mark , Leonard Galustian , Maximilian P. -P. Kovar , Esther Heid

Conditional generative modeling aims to learn a conditional data distribution from samples containing data-condition pairs. For this, diffusion and flow-based methods have attained compelling results. These methods use a learned (flow)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chen Chen , Pengsheng Guo , Liangchen Song , Jiasen Lu , Rui Qian , Xinze Wang , Tsu-Jui Fu , Wei Liu , Yinfei Yang , Alex Schwing

Achieving high-fidelity and temporally smooth 3D human motion generation remains a challenge, particularly within resource-constrained environments. We introduce FlowMotion, a novel method leveraging Conditional Flow Matching (CFM).…

Graphics · Computer Science 2025-04-28 Manolo Canales Cuba , Vinícius do Carmo Melício , João Paulo Gois

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

While methods exist for aligning flow matching models--a popular and effective class of generative models--with human preferences, existing approaches fail to achieve both adaptation efficiency and probabilistically sound prior…

Machine Learning · Computer Science 2026-03-04 Zhen Liu , Tim Z. Xiao , Carles Domingo-Enrich , Weiyang Liu , Dinghuai Zhang

Reliable medical image classification requires accurate predictions and well-calibrated uncertainty estimates, especially in high-stakes clinical settings. This work presents MedSymmFlow, a generative-discriminative hybrid model built on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Francisco Caetano , Lemar Abdi , Christiaan Viviers , Amaan Valiuddin , Fons van der Sommen

We derive a controlled generation objective within the framework of Variational Flow Matching (VFM), which casts flow matching as a variational inference problem. We demonstrate that controlled generation can be implemented two ways: (1) by…