English
Related papers

Related papers: Sampling and Identity-Testing Without Approximate …

200 papers

Test-time adaptation (TTA) may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, 3) online imbalanced label distribution shifts. This is often a key obstacle…

Machine Learning · Computer Science 2025-09-08 Shuaicheng Niu , Guohao Chen , Deyu Chen , Yifan Zhang , Jiaxiang Wu , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Chunyan Miao , Mingkui Tan

In this paper we consider the problem of sampling from the low-temperature exponential random graph model (ERGM). The usual approach is via Markov chain Monte Carlo, but Bhamidi et al. showed that any local Markov chain suffers from an…

Probability · Mathematics 2022-10-05 Guy Bresler , Dheeraj Nagaraj , Eshaan Nichani

There has been considerable recent interest in distribution-tests whose run-time and sample requirements are sublinear in the domain-size $k$. We study two of the most important tests under the conditional-sampling model where each query…

Data Structures and Algorithms · Computer Science 2015-04-17 Moein Falahatgar , Ashkan Jafarpour , Alon Orlitsky , Venkatadheeraj Pichapathi , Ananda Theertha Suresh

We consider the problem of sampling a multimodal distribution with a Markov chain given a small number of samples from the stationary measure. Although mixing can be arbitrarily slow, we show that if the Markov chain has a $k$th order…

Machine Learning · Computer Science 2024-11-15 Frederic Koehler , Holden Lee , Thuy-Duong Vuong

Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while neglecting semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zhengqing Gao , Xu-Yao Zhang , Cheng-Lin Liu

We provide an algorithm for properly learning mixtures of two single-dimensional Gaussians without any separability assumptions. Given $\tilde{O}(1/\varepsilon^2)$ samples from an unknown mixture, our algorithm outputs a mixture that is…

Data Structures and Algorithms · Computer Science 2014-05-20 Constantinos Daskalakis , Gautam Kamath

We study the problem of testing discrete distributions with a focus on the high probability regime. Specifically, given samples from one or more discrete distributions, a property $\mathcal{P}$, and parameters $0< \epsilon, \delta <1$, we…

Data Structures and Algorithms · Computer Science 2020-09-15 Ilias Diakonikolas , Themis Gouleakis , Daniel M. Kane , John Peebles , Eric Price

We study classical asymmetric binary perceptron (ABP) and associated \emph{local entropy} (LE) as potential source of its algorithmic hardness. Isolation of \emph{typical} ABP solutions in SAT phase seemingly suggests a universal…

Machine Learning · Statistics 2025-06-25 Mihailo Stojnic

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Test-time adaptation (TTA) refers to adjusting the model during the testing phase to cope with changes in sample distribution and enhance the model's adaptability to new environments. In real-world scenarios, models often encounter samples…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziqiong Liu , Yushun Tang , Junyang Ji , Zhihai He

Most unsupervised anomaly detection methods based on representations of normal samples to distinguish anomalies have recently made remarkable progress. However, existing methods only learn a single decision boundary for distinguishing the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Tianwu Lei , Silin Chen , Bohan Wang , Zhengkai Jiang , Ningmu Zou

Accelerated life-testing (ALT) is a very useful technique for examining the reliability of highly reliable products. It allows testing the products at higher than usual stress conditions to induce failures more quickly and economically than…

Statistics Theory · Mathematics 2020-05-15 Aida Calviño

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

This work proposes an evidence-retrieval mechanism for uncertainty-aware decision-making that replaces a single global cutoff with an evidence-conditioned, instance-adaptive criterion. For each test instance, proximal exemplars are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Hassan Gharoun , Mohammad Sadegh Khorshidi , Kasra Ranjbarigderi , Fang Chen , Amir H. Gandomi

Sampling from a target distribution is a fundamental problem. Traditional Markov chain Monte Carlo (MCMC) algorithms, such as the unadjusted Langevin algorithm (ULA), derived from the overdamped Langevin dynamics, have been extensively…

Optimization and Control · Mathematics 2024-10-29 Xinzhe Zuo , Stanley Osher , Wuchen Li

Randomized experiments are the gold standard for estimating the average treatment effect (ATE). While covariate adjustment can reduce the asymptotic variances of the unbiased Horvitz-Thompson estimators for the ATE, it suffers from…

Methodology · Statistics 2025-08-22 Xin Lu , Lei Shi , Hanzhong Liu , Peng Ding

Given a set of discrete probability distributions, the minimum entropy coupling is the minimum entropy joint distribution that has the input distributions as its marginals. This has immediate relevance to tasks such as entropic causal…

Information Theory · Computer Science 2023-02-24 Spencer Compton , Dmitriy Katz , Benjamin Qi , Kristjan Greenewald , Murat Kocaoglu

We investigate the unsupervised node classification problem on random hypergraphs under the non-uniform Hypergraph Stochastic Block Model (HSBM) with two equal-sized communities. In this model, edges appear independently with probabilities…

Statistics Theory · Mathematics 2025-12-01 Hai-Xiao Wang

Deep generative models parametrized up to a normalizing constant (e.g. energy-based models) are difficult to train by maximizing the likelihood of the data because the likelihood and/or gradients thereof cannot be explicitly or efficiently…

Machine Learning · Computer Science 2022-12-26 Frederic Koehler , Alexander Heckett , Andrej Risteski

Dirty entity resolution (ER), which identifies records referring to the same real-world entity from a single, messy dataset, is a fundamental task in data management and mining. However, the dominant blocking-matching-clustering paradigm…

Computation and Language · Computer Science 2026-05-26 Hongtao Wang , Renchi Yang , Haoran Zheng , Xiangyu Ke