English
Related papers

Related papers: Denoising Score Matching with Random Fourier Featu…

200 papers

We study large-scale kernel methods for acoustic modeling in speech recognition and compare their performance to deep neural networks (DNNs). We perform experiments on four speech recognition datasets, including the TIMIT and Broadcast News…

Separating signals from an additive mixture may be an unnecessarily hard problem when one is only interested in specific properties of a given signal. In this work, we tackle simpler "statistical component separation" problems that focus on…

Machine Learning · Statistics 2024-03-01 Bruno Régaldo-Saint Blancard , Michael Eickenberg

The advancement of imaging devices and countless images generated everyday pose an increasingly high demand on image denoising, which still remains a challenging task in terms of both effectiveness and efficiency. To improve denoising…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Zhaoming Kong , Fangxi Deng , Haomin Zhuang , Jun Yu , Lifang He , Xiaowei Yang

Consistency models possess high capabilities for image generation, advancing sampling steps to a single step through their advanced techniques. Current advancements move one step forward consistency training techniques and eliminates the…

Machine Learning · Computer Science 2024-04-10 Mahmut S. Gokmen , Cody Bumgardner , Jie Zhang , Ge Wang , Jin Chen

Learning probabilistic models that can estimate the density of a given set of samples, and generate samples from that density, is one of the fundamental challenges in unsupervised machine learning. We introduce a new generative model based…

Machine Learning · Computer Science 2020-06-11 Siavash A. Bigdeli , Geng Lin , Tiziano Portenier , L. Andrea Dunbar , Matthias Zwicker

Factorization of matrices where the rank of the two factors diverges linearly with their sizes has many applications in diverse areas such as unsupervised representation learning, dictionary learning or sparse coding. We consider a setting…

Disordered Systems and Neural Networks · Physics 2022-08-11 Antoine Maillard , Florent Krzakala , Marc Mézard , Lenka Zdeborová

Integer factorization is a famous computational problem unknown whether being solvable in the polynomial time. With the rise of deep neural networks, it is interesting whether they can facilitate faster factorization. We present an approach…

Machine Learning · Computer Science 2023-09-12 Karlis Freivalds , Emils Ozolins , Guntis Barzdins

Recently, there has been extensive research interest in training deep networks to denoise images without clean reference. However, the representative approaches such as Noise2Noise, Noise2Void, Stein's unbiased risk estimator (SURE), etc.…

Image and Video Processing · Electrical Eng. & Systems 2021-10-28 Kwanyoung Kim , Jong Chul Ye

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

Estimation of density functions supported on general domains arises when the data is naturally restricted to a proper subset of the real space. This problem is complicated by typically intractable normalizing constants. Score matching…

Methodology · Statistics 2020-09-25 Shiqing Yu , Mathias Drton , Ali Shojaie

Low dimensional nonlinear structure abounds in datasets across computer vision and machine learning. Kernelized matrix factorization techniques have recently been proposed to learn these nonlinear structures for denoising, classification,…

Machine Learning · Computer Science 2021-06-01 Jicong Fan , Chengrun Yang , Madeleine Udell

In the field of medical image analysis, deep learning models have demonstrated remarkable success in enhancing diagnostic accuracy and efficiency. However, the reliability of these models is heavily dependent on the quality of training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Maolin Li , Giacomo Tarroni

We propose a novel approach to video anomaly detection: we treat feature vectors extracted from videos as realizations of a random variable with a fixed distribution and model this distribution with a neural network. This lets us estimate…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jakub Micorek , Horst Possegger , Dominik Narnhofer , Horst Bischof , Mateusz Kozinski

Removing the shape noise from the observed weak lensing field, i.e., denoising, enhances the potential of WL by accessing information at small scales where the shape noise dominates without denoising. We utilise two machine learning (ML)…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-13 Shohei D. Aoyama , Ken Osato , Masato Shirasaki

Tensors in the form of multilinear arrays are ubiquitous in data science applications. Captured real-world data, including video, hyperspectral images, and discretized physical systems, naturally occur as tensors and often come with…

Machine Learning · Computer Science 2023-03-13 Jonathan Gryak , Kayvan Najarian , Harm Derksen

In this paper, we propose a unified framework of denoising score-based models in the context of graduated non-convex energy minimization. We show that for sufficiently large noise variance, the associated negative log density -- the energy…

Machine Learning · Computer Science 2023-02-22 Erich Kobler , Thomas Pock

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

Methodology · Statistics 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

Our objective is to calculate the derivatives of data corrupted by noise. This is a challenging task as even small amounts of noise can result in significant errors in the computation. This is mainly due to the randomness of the noise,…

Numerical Analysis · Mathematics 2023-04-13 Phuong M. Nguyen , Thuy T. Le , Loc H. Nguyen , Michael V. Klibanov

A wide variety of image denoising methods are available now. However, the performance of a denoising algorithm often depends on individual input noisy images as well as its parameter setting. In this paper, we present a no-reference image…

Image and Video Processing · Electrical Eng. & Systems 2018-10-16 Si Lu

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng