中文
相关论文

相关论文: Heavy-tailed Sampling via Transformed Unadjusted L…

200 篇论文

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

统计方法学 · 统计学 2017-11-15 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

We study sampling from a target distribution ${\nu_* = e^{-f}}$ using the unadjusted Langevin Monte Carlo (LMC) algorithm. For any potential function $f$ whose tails behave like ${\|x\|^\alpha}$ for ${\alpha \in [1,2]}$, and has…

机器学习 · 统计学 2020-05-28 Murat A. Erdogdu , Rasa Hosseinzadeh

In this paper we consider the estimation problem for high quantiles of a heavy-tailed distribution from block data when only a few largest values are observed within blocks. We propose estimators for high quantiles and prove that these…

统计理论 · 数学 2023-06-27 Yongcheng Qi , Mengzi Xie , Jingping Yang

The long-tail distribution of the visual world poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balancing strategies, e.g., by loss…

计算机视觉与模式识别 · 计算机科学 2020-02-20 Bingyi Kang , Saining Xie , Marcus Rohrbach , Zhicheng Yan , Albert Gordo , Jiashi Feng , Yannis Kalantidis

The goal in extreme multi-label classification is to learn a classifier which can assign a small subset of relevant labels to an instance from an extremely large set of target labels. Datasets in extreme classification exhibit a long tail…

机器学习 · 统计学 2018-03-06 Rohit Babbar , Bernhard Schölkopf

A conditional sampling oracle for a probability distribution D returns samples from the conditional distribution of D restricted to a specified subset of the domain. A recent line of work (Chakraborty et al. 2013 and Cannone et al. 2014)…

数据结构与算法 · 计算机科学 2016-08-18 Themistoklis Gouleakis , Christos Tzamos , Manolis Zampetakis

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

Most of the medical tasks naturally exhibit a long-tailed distribution due to the complex patient-level conditions and the existence of rare diseases. Existing long-tailed learning methods usually treat each class equally to re-balance the…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Lie Ju , Yicheng Wu , Lin Wang , Zhen Yu , Xin Zhao , Xin Wang , Paul Bonnington , Zongyuan Ge

Along with the recent advances in scalable Markov Chain Monte Carlo methods, sampling techniques that are based on Langevin diffusions have started receiving increasing attention. These so called Langevin Monte Carlo (LMC) methods are based…

统计计算 · 统计学 2017-06-14 Umut Şimşekli

This paper presents a novel approach for pointwise estimation of multivariate density functions on known domains of arbitrary dimensions using nonparametric local polynomial estimators. Our method is highly flexible, as it applies to both…

统计理论 · 数学 2025-07-22 Karine Bertin , Nicolas Klutchnikoff , Frédéric Ouimet

In this paper, we consider sampling from a class of distributions with thin tails supported on $\mathbb{R}^d$ and make two primary contributions. First, we propose a new Metropolized Algorithm With Optimization Step (MAO), which is well…

机器学习 · 统计学 2021-12-02 EL Mahdi Khribch , George Deligiannidis , Daniel Paulin

This paper proposes a new pipeline for long-tail (LT) recognition. Instead of re-weighting or re-sampling, we utilize the long-tailed dataset itself to generate a balanced proxy that can be optimized through cross-entropy (CE).…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Jie Shao , Ke Zhu , Hanxiao Zhang , Jianxin Wu

We study two log-concave sampling problems: constrained sampling and composite sampling. First, we consider sampling from a target distribution with density proportional to $\exp(-f(x))$ supported on a convex set $K \subset \mathbb{R}^d$,…

机器学习 · 统计学 2026-02-17 Thanh Dang , Jiaming Liang

Modeling uncertainty in heavy-tailed time series remains a critical challenge for deep probabilistic forecasting models, which often struggle to capture abrupt, extreme events. While L\'evy stable distributions offer a natural framework for…

机器学习 · 计算机科学 2026-05-15 Yang Yang , Du Yin , Hao Xue , Flora Salim

Training on datasets with long-tailed distributions has been challenging for major recognition tasks such as classification and detection. To deal with this challenge, image resampling is typically introduced as a simple but effective…

计算机视觉与模式识别 · 计算机科学 2021-10-20 Nadine Chang , Zhiding Yu , Yu-Xiong Wang , Anima Anandkumar , Sanja Fidler , Jose M. Alvarez

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

最优化与控制 · 数学 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

A key task in Bayesian machine learning is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). One prevalent example of this is sampling posteriors in parametric distributions,…

机器学习 · 计算机科学 2020-09-10 Rong Ge , Holden Lee , Andrej Risteski

In this paper we introduce and analyse Langevin samplers that consist of perturbations of the standard underdamped Langevin dynamics. The perturbed dynamics is such that its invariant measure is the same as that of the unperturbed dynamics.…

概率论 · 数学 2017-12-06 A. B. Duncan , N. Nuesken , G. A. Pavliotis

We develop sampling methods, which consist of Gaussian invariant versions of random walk Metropolis (RWM), Metropolis adjusted Langevin algorithm (MALA) and second order Hessian or Manifold MALA. Unlike standard RWM and MALA we show that…

机器学习 · 统计学 2025-06-27 Michalis K. Titsias , Angelos Alexopoulos , Siran Liu , Petros Dellaportas