English
Related papers

Related papers: DiScoFormer: Plug-In Density and Score Estimation …

200 papers

When analyzing modern machine learning algorithms, we may need to handle kernel density estimation (KDE) with intricate kernels that are not designed by the user and might even be irregular and asymmetric. To handle this emerging challenge,…

Statistics Theory · Mathematics 2021-06-09 Hau-Tieng Wu , Nan Wu

Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation. However, the prevailing CNN-based approaches have shown limitations in building long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Mingjin Zhang , Chi Zhang , Qiming Zhang , Jie Guo , Xinbo Gao , Jing Zhang

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

Machine Learning · Computer Science 2025-01-03 Gen Li , Yuling Yan

Reversing a diffusion process by learning its score forms the heart of diffusion-based generative modeling and for estimating properties of scientific systems. The diffusion processes that are tractable center on linear processes with a…

Machine Learning · Computer Science 2024-07-12 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We consider testing statistical hypotheses about densities of signals in deconvolution models. A new approach to this problem is proposed. We constructed score tests for the deconvolution with the known noise density and efficient score…

Statistics Theory · Mathematics 2013-12-02 Mikhail Langovoy

The covariate shift is a challenging problem in supervised learning that results from the discrepancy between the training and test distributions. An effective approach which recently drew a considerable attention in the research community…

Machine Learning · Computer Science 2013-11-27 Yun-Qian Miao , Ahmed K. Farahat , Mohamed S. Kamel

In this paper, we propose a simple yet effective transformer framework for self-supervised learning called DenseDINO to learn dense visual representations. To exploit the spatial information that the dense prediction tasks require but…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yike Yuan , Xinghe Fu , Yunlong Yu , Xi Li

Attention mechanism has been crucial for image diffusion models, however, their quadratic computational complexity limits the sizes of images we can process within reasonable time and memory constraints. This paper investigates the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Ethan Smith , Nayan Saxena , Aninda Saha

Recent advances in diffusion models bring state-of-the-art performance on image generation tasks. However, empirical results from previous research in diffusion models imply an inverse correlation between density estimation and sample…

Machine Learning · Computer Science 2022-06-14 Dongjun Kim , Seungjae Shin , Kyungwoo Song , Wanmo Kang , Il-Chul Moon

Attention mechanisms take an expectation of a data representation with respect to probability weights. This creates summary statistics that focus on important features. Recently, (Martins et al. 2020, 2021) proposed continuous attention…

Machine Learning · Computer Science 2021-11-16 Alexander Moreno , Supriya Nagesh , Zhenke Wu , Walter Dempsey , James M. Rehg

Collaboration between different data centers is often challenged by heterogeneity across sites. To account for the heterogeneity, the state-of-the-art method is to re-weight the covariate distributions in each site to match the distribution…

Machine Learning · Statistics 2024-04-25 Tianyu Guo , Sai Praneeth Karimireddy , Michael I. Jordan

Kernel density estimation is a widely used nonparametric approach to estimate an unknown distribution. Recent work in Bayesian predictive inference has considered stochastic processes formed by specifying the predictive distribution for the…

Methodology · Statistics 2026-05-15 Torey Hilbert

Diagnosis-oriented dialogue system queries the patient's health condition and makes predictions about possible diseases through continuous interaction with the patient. A few studies use reinforcement learning (RL) to learn the optimal…

Computation and Language · Computer Science 2022-12-27 Wei Chen , Cheng Zhong , Jiajie Peng , Zhongyu Wei

Scene segmentation in images is a fundamental yet challenging problem in visual content understanding, which is to learn a model to assign every image pixel to a categorical label. One of the challenges for this learning task is to consider…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Litao Yu , Zhibin Li , Jian Zhang , Qiang Wu

The Normalizing Flow (NF) models a general probability density by estimating an invertible transformation applied on samples drawn from a known distribution. We introduce a new type of NF, called Deep Diffeomorphic Normalizing Flow (DDNF).…

Machine Learning · Statistics 2018-11-26 Hadi Salman , Payman Yadollahpour , Tom Fletcher , Kayhan Batmanghelich

Multivariate time series classification is a crucial task in data mining, attracting growing research interest due to its broad applications. While many existing methods focus on discovering discriminative patterns in time series,…

Machine Learning · Computer Science 2024-12-24 Wenjie Xi , Rundong Zuo , Alejandro Alvarez , Jie Zhang , Byron Choi , Jessica Lin

The problem of inhomogeneous cluster densities has been a long-standing issue for distance-based and density-based algorithms in clustering and anomaly detection. These algorithms implicitly assume that all clusters have approximately the…

Machine Learning · Computer Science 2024-01-30 Ye Zhu , Kai Ming Ting , Mark Carman , Maia Angelova

The reconstruction of smooth density fields from scattered data points is a procedure that has multiple applications in a variety of disciplines, including Lagrangian (particle-based) models of solute transport in fluids. In random walk…

Computational Physics · Physics 2019-09-04 Guillem Sole-Mari , Diogo Bolster , Daniel Fernàndez-Garcia , Xavier Sanchez-Vila

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $\Omega$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function.…

Machine Learning · Statistics 2018-03-13 Dangna Li , Kun Yang , Wing Hung Wong

The task of Stance Detection involves discerning the stance expressed in a text towards a specific subject or target. Prior works have relied on existing transformer models that lack the capability to prioritize targets effectively.…

Computation and Language · Computer Science 2024-10-10 Krishna Garg , Cornelia Caragea