English
Related papers

Related papers: Concrete Score Matching: Generalized Score Matchin…

200 papers

Invariant approaches have been remarkably successful in tackling the problem of domain generalization, where the objective is to perform inference on data distributions different from those used in training. In our work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Abhimanyu Dubey , Vignesh Ramanathan , Alex Pentland , Dhruv Mahajan

Matching promises transparent causal inferences for observational data, making it an intuitive approach for many applications. In practice, however, standard matching methods often perform poorly compared to modern approaches such as…

Methodology · Statistics 2024-11-11 Jonathan Che , Xiang Meng , Luke Miratrix

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

Machine Learning · Computer Science 2025-01-03 Gen Li , Yuling Yan

In this paper, we establish new convergence results for the quantized distributed gradient descent and suggest a novel strategy of choosing the stepsizes for the high-performance of the algorithm. Under the strongly convexity assumption on…

Optimization and Control · Mathematics 2023-07-03 Woocheol Choi , Myeong-Su Lee

The computational complexity of some depths that satisfy the projection property, such as the halfspace depth or the projection depth, is known to be high, especially for data of higher dimensionality. In such scenarios, the exact depth is…

Statistics Theory · Mathematics 2021-05-28 Stanislav Nagy , Rainer Dyckerhoff , Pavlo Mozharovskyi

Comprehensive evaluation of machine learning models is the key to make sure that they perform as robustly and consistently as desired. In order to summarize the experimental results and pick a winner, Critical Difference (CD) diagrams are…

Machine Learning · Computer Science 2026-05-25 Muhammad Rajabinasab , Afsaneh M. Nejad , Arthur Zimek

We consider the problem of generative modeling based on smoothing an unknown density of interest in $\mathbb{R}^d$ using factorial kernels with $M$ independent Gaussian channels with equal noise levels introduced by Saremi and Srivastava…

Machine Learning · Statistics 2023-03-22 Saeed Saremi , Rupesh Kumar Srivastava , Francis Bach

Generalized dimensions of multifractal measures are usually seen as static objects, related to the scaling properties of suitable partition functions, or moments of measures of cells. When these measures are invariant for the flow of a…

Dynamical Systems · Mathematics 2019-10-02 Théophile Caby , Davide Faranda , Giorgio Mantica , Sandro Vaienti , Pascal Yiou

In order to leverage and profit from unlabelled data, semi-supervised frameworks for semantic segmentation based on consistency training have been proven to be powerful tools to significantly improve the performance of purely supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Max Coenen , Tobias Schack , Dries Beyer , Christian Heipke , Michael Haist

Many existing conditional score-based data generation methods utilize Bayes' theorem to decompose the gradients of a log posterior density into a mixture of scores. These methods facilitate the training procedure of conditional score…

Machine Learning · Computer Science 2022-03-29 Chen-Hao Chao , Wei-Fang Sun , Bo-Wun Cheng , Yi-Chen Lo , Chia-Che Chang , Yu-Lun Liu , Yu-Lin Chang , Chia-Ping Chen , Chun-Yi Lee

We derive Stein approximation bounds for functionals of uniform random variables, using chaos expansions and the Clark-Ocone representation formula combined with derivation and finite difference operators. This approach covers sums and…

Probability · Mathematics 2018-02-28 Nicolas Privault , Grzegorz Serafin

Most Machine Learning (ML) methods, from clustering to classification, rely on a distance function to describe relationships between datapoints. For complex datasets it is hard to avoid making some arbitrary choices when defining a distance…

Machine Learning · Statistics 2016-07-04 Gina Gruenhage , Manfred Opper , Simon Barthelme

Spectral Clustering(SC) is a prominent data clustering technique of recent times which has attracted much attention from researchers. It is a highly data-driven method and makes no strict assumptions on the structure of the data to be…

Machine Learning · Computer Science 2019-09-18 Lalith Srikanth Chintalapati , Raghunatha Sarma Rachakonda

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

Neural networks and other machine learning models compute continuous representations, while humans communicate mostly through discrete symbols. Reconciling these two forms of communication is desirable for generating human-readable…

Machine Learning · Computer Science 2022-02-14 António Farinhas , Wilker Aziz , Vlad Niculae , André F. T. Martins

Although recovering an Euclidean distance matrix from noisy observations is a common problem in practice, how well this could be done remains largely unknown. To fill in this void, we study a simple distance matrix estimate based upon the…

Machine Learning · Statistics 2014-09-18 Luwan Zhang , Grace Wahba , Ming Yuan

Structured high-cardinality data arises in many domains, and poses a major challenge for both modeling and inference. Graphical models are a popular approach to modeling structured data but they are unsuitable for high-cardinality…

Data Structures and Algorithms · Computer Science 2016-07-19 Branislav Kveton , Hung Bui , Mohammad Ghavamzadeh , Georgios Theocharous , S. Muthukrishnan , Siqi Sun

In this paper, we elucidate the geometry of Stein's method of moments (SMoM). SMoM is a parameter estimation method based on the Stein operator, and yields a wide class of estimators that do not depend on the normalizing constant. We…

Statistics Theory · Mathematics 2026-03-16 Mitsuki Nagai , Keisuke Yano

This paper introduces a new (dis)similarity measure for 2D arrays, extending the Average Common Submatrix measure. This is accomplished by: (i) considering the frequency of matching patterns, (ii) restricting the pattern matching to a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Alessia Amelio , Darko Brodić