English
Related papers

Related papers: A Connection Between Score Matching and Local Intr…

200 papers

Deep learning has shown great potential in accelerating diffusion tensor imaging (DTI). Nevertheless, existing methods tend to suffer from Rician noise and detail loss in reconstructing the DTI-derived parametric maps especially when…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Wenxin Fan , Jian Cheng , Cheng Li , Xinrui Ma , Jing Yang , Juan Zou , Ruoyou Wu , Qiegen Liu , Shanshan Wang

We study the problem of efficiently computing the derivative of the fixed-point of a parametric nondifferentiable contraction map. This problem has wide applications in machine learning, including hyperparameter optimization, meta-learning…

Machine Learning · Statistics 2024-06-05 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

Machine Learning · Statistics 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

This paper addresses the following questions pertaining to the intrinsic dimensionality of any given image representation: (i) estimate its intrinsic dimensionality, (ii) develop a deep neural network based non-linear mapping, dubbed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Sixue Gong , Vishnu Naresh Boddeti , Anil K. Jain

Deep Metric Learning (DML) aims to learn embedding functions that map semantically similar inputs to proximate points in a metric space while separating dissimilar ones. Existing methods, such as pairwise losses, are hindered by complex…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Pedro Silva , Guilherme A. L. Silva , Pablo Coelho , Vander Freitas , Gladston Moreira , David Menotii , Eduardo Luz

Denoising Diffusion models have exhibited remarkable capabilities in image generation. However, generating high-quality samples requires a large number of iterations. Knowledge distillation for diffusion models is an effective method to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Shengzhe Zhou , Zejian Lee , Shengyuan Zhang , Lefan Hou , Changyuan Yang , Guang Yang , Zhiyuan Yang , Lingyun Sun

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai

Modern datasets are characterized by a large number of features that may conceal complex dependency structures. To deal with this type of data, dimensionality reduction techniques are essential. Numerous dimensionality reduction methods…

Methodology · Statistics 2021-06-02 Francesco Denti , Diego Doimo , Alessandro Laio , Antonietta Mira

We show how perceptual embeddings of the visual system can be constructed at inference-time with no training data or deep neural network features. Our perceptual embeddings are solutions to a weighted least squares (WLS) problem, defined at…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Daniel Severo , Lucas Theis , Johannes Ballé

Understanding causal dependencies in observational data is critical for informing decision-making. These relationships are often modeled as Bayesian Networks (BNs) and Directed Acyclic Graphs (DAGs). Existing methods, such as NOTEARS and…

Machine Learning · Computer Science 2026-04-03 Hao Zhu , Di Zhou , Donna Slonim

Recent advances have revealed that the rate of convergence of the expected test error in deep supervised learning decays as a function of the intrinsic dimension and not the dimension $d$ of the input space. Existing literature defines this…

Machine Learning · Statistics 2024-12-16 Saptarshi Chakraborty , Peter L. Bartlett

We examine theoretical properties of the denoising score matching estimate. We model the density of observations with a nonparametric Gaussian mixture. We significantly relax the standard manifold assumption allowing the samples step away…

Machine Learning · Computer Science 2026-01-01 Konstantin Yakovlev , Nikita Puchkin

The recent, impressive advances in algorithmic generation of high-fidelity image, audio, and video are largely due to great successes in score-based diffusion models. A key implementing step is score matching, that is, the estimation of the…

Machine Learning · Statistics 2024-09-12 Zehao Dou , Subhodh Kotekal , Zhehao Xu , Harrison H. Zhou

Multi-target detection (MTD) is the problem of estimating an image from a large, noisy measurement that contains randomly translated and rotated copies of the image. Motivated by the single-particle cryo-electron microscopy technology, we…

Signal Processing · Electrical Eng. & Systems 2023-12-15 Alon Zabatani , Shay Kreymer , Tamir Bendory

Most recent works focus on answering first order logical queries to explore the knowledge graph reasoning via multi-hop logic predictions. However, existing reasoning models are limited by the circumscribed logical paradigms of training…

Machine Learning · Computer Science 2023-06-07 Xiaoying Xie , Biao Gong , Yiliang Lv , Zhen Han , Guoshuai Zhao , Xueming Qian

Score diffusion methods can learn probability densities from samples. The score of the noise-corrupted density is estimated using a deep neural network, which is then used to iteratively transport a Gaussian white noise density to a target…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zahra Kadkhodaie , Stéphane Mallat , Eero P. Simoncelli

Despite the fact that DeepFake forgery detection algorithms have achieved impressive performance on known manipulations, they often face disastrous performance degradation when generalized to an unseen manipulation. Some recent works show…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Chuer Yu , Xuhong Zhang , Yuxuan Duan , Senbo Yan , Zonghui Wang , Yang Xiang , Shouling Ji , Wenzhi Chen

Convolutional neural networks have been the focus of research aiming to solve image denoising problems, but their performance remains unsatisfactory for most applications. These networks are trained with synthetic noise distributions that…

Image and Video Processing · Electrical Eng. & Systems 2020-05-06 Benoit Brummer , Christophe De Vleeschouwer

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Xuefei Zhe , Shifeng Chen , Hong Yan