English
Related papers

Related papers: Robust Sequential Tracking via Bounded Information…

200 papers

Operator-valued concentration inequalities are foundational to the analysis of modern high-dimensional statistics and randomized algorithms. However, standard oracle bounds are frequently limited in practice: they require explicit a priori…

Statistics Theory · Mathematics 2026-05-18 Diego Martinez-Taboada , Aaditya Ramdas

We introduce the unbounded depth neural network (UDN), an infinitely deep probabilistic model that adapts its complexity to the training data. The UDN contains an infinite sequence of hidden layers and places an unbounded prior on a…

Machine Learning · Computer Science 2022-09-22 Achille Nazaret , David Blei

We analyse how simple local constraints in two dimensions lead a defect to exhibit robust, non-transient, and tunable, subdiffusion. We uncover a rich dynamical phenomenology realised in ice- and dimer-type models. On the microscopic scale…

Mesoscale and Nanoscale Physics · Physics 2025-04-02 Nilotpal Chakraborty , Markus Heyl , Roderich Moessner

Complex textual information extraction tasks are often posed as sequence labeling or \emph{shallow parsing}, where fields are extracted using local labels made consistent through probabilistic inference in a graphical model with constrained…

Machine Learning · Computer Science 2018-10-01 Dung Thai , Sree Harsha Ramesh , Shikhar Murty , Luke Vilnis , Andrew McCallum

Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are…

Machine Learning · Computer Science 2024-06-04 Vy Vo , Trung Le , Tung-Long Vuong , He Zhao , Edwin Bonilla , Dinh Phung

Empirical analysis in economics often faces the difficulty that the data is correlated and heterogeneous in some unknown form. Spatial parametric approaches have been widely used to account for dependence structures, but the problem of…

Methodology · Statistics 2017-02-09 Anna Gloria Billé , Roberto Benedetti , Paolo Postiglione

This paper presents robust inference methods for general linear hypotheses in linear panel data models with latent group structure in the coefficients. We employ a selective conditional inference approach, deriving the conditional…

Econometrics · Economics 2025-11-25 Oguzhan Akgun , Ryo Okui

Topological Data Analysis (TDA) is a recent and growing branch of statistics devoted to the study of the shape of the data. In this work we investigate the predictive power of TDA in the context of supervised learning. Since topological…

Machine Learning · Statistics 2017-09-22 Tullia Padellini , Pierpaolo Brutti

We establish a quantitative bound on the entropy jump associated to the sum of independent, identically distributed (IID) radially symmetric random vectors having dimension greater than one. Following the usual approach, we first consider…

Information Theory · Computer Science 2016-11-04 Thomas A. Courtade

In order to deal with multidimensional structure representations of real-world networks, as well as with their worst-case irreducible information content analysis, the demand for new graph abstractions increases. This article investigates…

Information Theory · Computer Science 2024-10-21 Felipe S. Abrahão , Klaus Wehmuth , Hector Zenil , Artur Ziviani

Uncertainty quantification is critical in scientific inverse problems to distinguish identifiable parameters from those that remain ambiguous given available measurements. The Conditional Diffusion Model-based Inverse Problem Solver (CDI)…

Machine Learning · Computer Science 2026-01-27 Dmitrii Torbunov , Yihui Ren , Lijun Wu , Yimei Zhu

Consider a setting with multiple units (e.g., individuals, cohorts, geographic locations) and outcomes (e.g., treatments, times, items), where the goal is to learn a multivariate distribution for each unit-outcome entry, such as the…

Machine Learning · Statistics 2025-10-21 Kyuseong Choi , Jacob Feitelberg , Caleb Chin , Anish Agarwal , Raaz Dwivedi

A nonparametric anomalous hypothesis testing problem is investigated, in which there are totally n sequences with s anomalous sequences to be detected. Each typical sequence contains m independent and identically distributed (i.i.d.)…

Machine Learning · Computer Science 2016-12-15 Shaofeng Zou , Yingbin Liang , H. Vincent Poor , Xinghua Shi

Deeper modern architectures are costly to train, making hyperparameter transfer preferable to expensive repeated tuning. Maximal Update Parametrization ($\mu$P) helps explain why many hyperparameters transfer across width. Yet depth scaling…

Machine Learning · Computer Science 2026-02-10 Shenxi Wu , Haosong Zhang , Xingjian Ma , Shirui Bian , Yichi Zhang , Xi Chen , Wei Lin

Recent studies show that transformer-based architectures emulate gradient descent during a forward pass, contributing to in-context learning capabilities - an ability where the model adapts to new tasks based on a sequence of prompt…

Statistics Theory · Mathematics 2024-05-13 Karthik Duraisamy

Estimating the structures at high or low quantiles has become an important subject and attracted increasing attention across numerous fields. However, due to data sparsity at tails, it usually is a challenging task to obtain reliable…

Methodology · Statistics 2021-11-08 Yingying Zhang , Yuefeng Si , Guodong Li , Chil-Ling Tsai

Statistical depth measures the centrality of a point with respect to a given distribution or data cloud. It provides a natural center-outward ordering of multivariate data points and yields a systematic nonparametric multivariate analysis…

Statistics Theory · Mathematics 2015-10-30 John H. J. Einmahl , Jun Li , Regina Y. Liu

The paper algorithmizes the problem of regime change point identification for data measured in a system exhibiting impulsive behaviors. This is a fundamental challenge for annotation of measurement data relevant, e.g., for designing…

Score-based diffusion models in infinite-dimensional function spaces provide a mathematically principled framework for modelling function-valued data, offering key advantages such as resolution invariance and the ability to handle irregular…

Machine Learning · Computer Science 2026-05-06 James Rowbottom , Elizabeth L. Baker , Nick Huang , Ben Adcock , Carola-Bibiane Schönlieb , Alexander Denker

We quantify the asymptotic behaviour of multidimensional drifltess diffusions in domains unbounded in a single direction, with asymptotically normal reflections from the boundary. We identify the critical growth/contraction rates of the…

Probability · Mathematics 2025-01-22 Miha Brešar , Aleksandar Mijatović , Andrew Wade