English
Related papers

Related papers: How Do Flow Matching Models Memorize and Generaliz…

200 papers

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Nikolaus Mayer , Eddy Ilg , Philipp Fischer , Caner Hazirbas , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Recent work on dense optical flow has shown significant progress, primarily in a supervised learning manner requiring a large amount of labeled data. Due to the expensiveness of obtaining large scale real-world data, computer graphics are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Kwon Byung-Ki , Kim Sung-Bin , Tae-Hyun Oh

Dataset Condensation aims to condense a large dataset into a smaller one while maintaining its ability to train a well-performing model, thus reducing the storage cost and training effort in deep learning applications. However, conventional…

Machine Learning · Computer Science 2023-07-20 Ganlong Zhao , Guanbin Li , Yipeng Qin , Yizhou Yu

Subspace learning and matrix factorization problems have great many applications in science and engineering, and efficient algorithms are critical as dataset sizes continue to grow. Many relevant problem formulations are non-convex, and in…

Numerical Analysis · Computer Science 2022-02-22 Dejiao Zhang , Laura Balzano

Generative modelling has been a topic at the forefront of machine learning research for a substantial amount of time. With the recent success in the field of machine learning, especially in deep learning, there has been an increased…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 M. M. A. Valiuddin , C. G. A. Viviers

We propose Flow Mismatching, an unsupervised anomaly detection method that deliberately avoids reconstruction-based paradigms. Instead, we treat flow matching as geometric dynamics and leverage a key insight: anomalies occur at places where…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Shengzhe Chen , Mehrdad Moradi , Kamran Paynabar , Hao Yan

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Nikolaus Mayer , Eddy Ilg , Philip Häusser , Philipp Fischer , Daniel Cremers , Alexey Dosovitskiy , Thomas Brox

Generative Flow Networks (GFlowNets) have been introduced as a method to sample a diverse set of candidates with probabilities proportional to a given reward. However, GFlowNets can only be used with a predefined scalar reward, which can be…

Machine Learning · Computer Science 2024-02-27 Yihang Chen , Lukas Mauch

Guidance provides a simple and effective framework for posterior sampling by steering the generation process towards the desired distribution. When modeling discrete data, existing approaches mostly focus on guidance with the first-order…

Machine Learning · Computer Science 2026-04-16 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

Convolutional neural networks (CNNs) have recently been very successful in a variety of computer vision tasks, especially on those linked to recognition. Optical flow estimation has not been among the tasks where CNNs were successful. In…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Philipp Fischer , Alexey Dosovitskiy , Eddy Ilg , Philip Häusser , Caner Hazırbaş , Vladimir Golkov , Patrick van der Smagt , Daniel Cremers , Thomas Brox

Generative models have achieved remarkable progress with the emergence of flow matching (FM). It has demonstrated strong generative capabilities and attracted significant attention as a simulation-free flow-based framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Huynh Trinh Ngoc , Hoang Anh Nguyen Kim , Toan Nguyen Hai , Long Tran Quoc

Sequential probabilistic inference from streaming observations requires modeling distributions over future trajectories as new observations arrive. Although diffusion and flow-matching models are effective at capturing high-dimensional,…

Machine Learning · Computer Science 2026-05-15 Yinan Huang , Hans Hao-Hsun Hsu , Junran Wang , Bo Dai , Pan Li

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Memorization in over-parameterized neural networks could severely hurt generalization in the presence of mislabeled examples. However, mislabeled examples are hard to avoid in extremely large datasets collected with weak supervision. We…

Machine Learning · Computer Science 2020-04-10 Jiaming Song , Lunjia Hu , Michael Auli , Yann Dauphin , Tengyu Ma

Normalizing flow is a generative modeling approach with efficient sampling. However, Flow-based models suffer two issues: 1) If the target distribution is manifold, due to the unmatch between the dimensions of the latent target distribution…

Machine Learning · Computer Science 2024-04-24 Qinglong Meng , Chongkun Xia , Xueqian Wang

Machine learning is gaining growing momentum in various recent models for the dynamic analysis of information flows in data communications networks. These preliminary models often rely on off-the-shelf learning models to predict from…

Machine Learning · Computer Science 2023-04-04 Xiangle Cheng , James He , Shihan Xiao , Yingxue Zhang , Zhitang Chen , Pascal Poupart , Fenglin Li

Bayesian deep learning counts on the quality of posterior distribution estimation. However, the posterior of deep neural networks is highly multi-modal in nature, with local modes exhibiting varying generalization performance. Given a…

Machine Learning · Computer Science 2024-03-27 Bolian Li , Ruqi Zhang

Dataset condensation aims at reducing the network training effort through condensing a cumbersome training set into a compact synthetic one. State-of-the-art approaches largely rely on learning the synthetic data by matching the gradients…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Kai Wang , Bo Zhao , Xiangyu Peng , Zheng Zhu , Shuo Yang , Shuo Wang , Guan Huang , Hakan Bilen , Xinchao Wang , Yang You

Generative Flow Networks (GFlowNets) are a family of generative models that learn to sample objects from a given probability distribution, potentially known up to a normalizing constant. Instead of working in the object space, GFlowNets…

Machine Learning · Computer Science 2025-09-12 Nikita Morozov , Ian Maksimov , Daniil Tiapkin , Sergey Samsonov

In an era of ubiquitous large-scale streaming data, the availability of data far exceeds the capacity of expert human analysts. In many settings, such data is either discarded or stored unprocessed in datacenters. This paper proposes a…

Machine Learning · Statistics 2016-09-13 Xin Jiang , Rebecca Willett