English
Related papers

Related papers: Solving Empirical Bayes via Transformers

200 papers

Transformers have demonstrated remarkable success across various applications. However, the success of transformers have not been understood in theory. In this work, we give a case study of how transformers can be trained to learn a classic…

Machine Learning · Statistics 2025-04-14 Chenyang Zhang , Xuran Meng , Yuan Cao

We investigate statistical inference across time scales. We take as toy model the estimation of the intensity of a discretely observed compound Poisson process with symmetric Bernoulli jumps. We have data at different time scales:…

Statistics Theory · Mathematics 2011-06-07 Céline Duval , Marc Hoffmann

State-of-the-art deep-learning systems use decision rules that are challenging for humans to model. Explainable AI (XAI) attempts to improve human understanding but rarely accounts for how people typically reason about unfamiliar agents. We…

Artificial Intelligence · Computer Science 2021-04-27 Scott Cheng-Hsin Yang , Wai Keen Vong , Ravi B. Sojitra , Tomas Folke , Patrick Shafto

We study a regularized variant of the Bayesian Persuasion problem, where the receiver's decision process includes a divergence-based penalty that accounts for deviations from perfect rationality. This modification smooths the underlying…

Optimization and Control · Mathematics 2025-10-03 Romain Duboscq , Frédéric de Gournay

Recent progress in Generative Artificial Intelligence (AI) relies on efficient data representations, often featuring encoder-decoder architectures. We formalize the mathematical problem of finding the optimal encoder-decoder pair and…

Machine Learning · Computer Science 2023-08-29 Semyon Malamud , Teng Andrea Xu , Antoine Didisheim

When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We develop a new hyperparameter-free ensemble model for…

Machine Learning · Statistics 2022-10-25 Matthias Feurer , Benjamin Letham , Frank Hutter , Eytan Bakshy

Bayesian statistical models allow us to formalise our knowledge about the world and reason about our uncertainty, but there is a need for better procedures to accurately encode its complexity. One way to do so is through compositional…

Computation · Statistics 2017-03-01 Maria Lomeli

We continue studies of the uncertainty quantification problem in emission tomographies such as PET or SPECT when additional multimodal data (e.g., anatomical MRI images) are available. To solve the aforementioned problem we adapt the…

Machine Learning · Statistics 2021-12-03 Fedor Goncharov , Éric Barat , Thomas Dautremer

Embedding layers in transformer-based NLP models typically account for the largest share of model parameters, scaling with vocabulary size but not yielding performance gains proportional to scale. We propose an alternative approach in which…

Computation and Language · Computer Science 2025-05-06 Henry Ndubuaku , Mouad Talhi

We consider together the retrospective and the sequential change-point detection in a general class of integer-valued time series. The conditional mean of the process depends on a parameter $\theta^*$ which may change over time. We propose…

Statistics Theory · Mathematics 2020-07-29 Mamadou Lamine Diop , William Kengne

We consider the problem of parameter estimation by observations of inhomogeneous Poisson process. It is well-known that if the regularity conditions are fulfilled then the maximum likelihood and Bayesian estimators are consistent,…

Statistics Theory · Mathematics 2009-03-27 Yury A. Kutoyants

Approximate Bayesian computation (ABC) has become an essential tool for the analysis of complex stochastic models when the likelihood function is numerically unavailable. However, the well-established statistical method of empirical…

Computation · Statistics 2015-06-05 K. L. Mengersen , P. Pudlo , C. P. Robert

Being in the era of big data, modeling and prediction of count data have become significantly important in many fields including health, finance, social, etc. Although linear Poisson regression has been widely used to model count and rate…

Applications · Statistics 2018-10-25 Hansapani Rodrigo , Chris Tsokos

To handle the complexities of real-world traffic, learning planners for self-driving from data is a promising direction. While recent approaches have shown great progress, they typically assume a setting in which the ground-truth world…

Robotics · Computer Science 2025-05-14 Niklas Hanselmann , Simon Doll , Marius Cordts , Hendrik P. A. Lensch , Andreas Geiger

When aggregating information from conflicting sources, one's goal is to find the truth. Most real-value \emph{truth discovery} (TD) algorithms try to achieve this goal by estimating the competence of each source and then aggregating the…

Machine Learning · Computer Science 2022-06-13 Tsviel Ben Shabat , Reshef Meir , David Azriel

Modern large language models (LLMs) excel at tasks that require storing and retrieving knowledge, such as factual recall and question answering. Transformers are central to this capability because they can encode information during training…

Machine Learning · Statistics 2026-03-18 Nuri Mert Vural , Alberto Bietti , Mahdi Soltanolkotabi , Denny Wu

This paper describes methods for comparative evaluation of the interpretability of models of high dimensional time series data inferred by unsupervised machine learning algorithms. The time series data used in this investigation were logs…

Artificial Intelligence · Computer Science 2020-05-05 Nicholas Hoernle , Kobi Gal , Barbara Grosz , Leilah Lyons , Ada Ren , Andee Rubin

Exchangeable random partition processes are the basis for Bayesian approaches to statistical inference in large alphabet settings. On the other hand, the notion of the pattern of a sequence provides an information-theoretic framework for…

Information Theory · Computer Science 2014-10-22 Narayana P. Santhanam , Anand D. Sarwate , Jae Oh Woo

Bayesian supervised predictive classifiers, hypothesis testing, and parametric estimation under Partition Exchangeability are implemented. The two classifiers presented are the marginal classifier (that assumes test data is i.i.d.) next to…

Computation · Statistics 2021-12-06 Ville Kinnula , Jing Tang , Ali Amiryousefi

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau