English
Related papers

Related papers: A multidimensional objective prior distribution fr…

200 papers

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

We introduce a two-step procedure, in the context of ultra-high dimensional additive models, which aims to reduce the size of covariates vector and distinguish linear and nonlinear effects among nonzero components. Our proposed screening…

Statistics Theory · Mathematics 2017-08-30 M. Kazemi , D. Shahsavani , M. Arashi

This paper introduces a framework for incorporating prior information into the design of sequential experiments. These sources may include past experiments, expert opinions, or the experimenter's intuition. We model the problem using a…

Econometrics · Economics 2024-10-01 Frederico Finan , Demian Pouzo

We consider the problem of producing fair probabilistic classifiers for multi-class classification tasks. We formulate this problem in terms of "projecting" a pre-trained (and potentially unfair) classifier onto the set of models that…

Machine Learning · Computer Science 2022-06-17 Wael Alghamdi , Hsiang Hsu , Haewon Jeong , Hao Wang , P. Winston Michalak , Shahab Asoodeh , Flavio P. Calmon

We consider the provision of an abstract service to single-dimensional agents. Our model includes position auctions, single-minded combinatorial auctions, and constrained matching markets. When the agents' values are drawn from a…

Computer Science and Game Theory · Computer Science 2012-12-18 Nikhil R. Devanur , Jason D. Hartline , Qiqi Yan

In Bayesian statistics, the choice of the prior can have an important influence on the posterior and the parameter estimation, especially when few data samples are available. To limit the added subjectivity from a priori information, one…

Methodology · Statistics 2025-12-05 Nils Baillie , Antoine Van Biesbroeck , Clément Gauchy

The options framework is a popular approach for building temporally extended actions in reinforcement learning. In particular, the option-critic architecture provides general purpose policy gradient theorems for learning actions from…

Machine Learning · Computer Science 2020-02-07 Matthew Riemer , Ignacio Cases , Clemens Rosenbaum , Miao Liu , Gerald Tesauro

In this paper, we present an innovative method for constructing proper priors for the skewness (shape) parameter in the skew-symmetric family of distributions. The proposed method is based on assigning a prior distribution on the…

Methodology · Statistics 2017-08-28 Holger Dette , Christophe Ley , Francisco Javier Rubio

Current objective functions used for training neural MCMC proposal distributions implicitly rely on architectural restrictions to yield sensible optimization results, which hampers the development of highly expressive neural MCMC proposal…

Machine Learning · Computer Science 2022-04-12 Chris Cannella , Vahid Tarokh

Many common correlation structures assumed for data can be described through latent Gaussian models. When Bayesian inference is carried out, it is required to set the prior distribution for scale parameters that rules the model components,…

Methodology · Statistics 2025-02-10 Aldo Gardini , Fedele Greco , Carlo Trivisano

Distribution matching (DM) is a versatile domain-invariant representation learning technique that has been applied to tasks such as fair classification, domain adaptation, and domain translation. Non-parametric DM methods struggle with…

Machine Learning · Computer Science 2025-06-18 Ziyu Gong , Jim Lim , David I. Inouye

Priors allow us to robustify inference and to incorporate expert knowledge in Bayesian hierarchical models. This is particularly important when there are random effects that are hard to identify based on observed data. The challenge lies in…

Computation · Statistics 2022-03-21 Ingeborg Gullikstad Hem , Geir-Arne Fuglstad , Andrea Riebler

Scoring systems, as a type of predictive model, have significant advantages in interpretability and transparency and facilitate quick decision-making. As such, scoring systems have been extensively used in a wide variety of industries such…

Machine Learning · Computer Science 2022-11-23 Yi Yang , Ying Wu , Mei Li , Xiangyu Chang , Yong Tan

Recent work has formalized the reward hypothesis through the lens of expected utility theory, by interpreting reward as utility. Hausner's foundational work showed that dropping the continuity axiom leads to a generalization of expected…

Machine Learning · Computer Science 2025-05-20 Mehran Shakerinava , Siamak Ravanbakhsh , Adam Oberman

Distributions over exchangeable matrices with infinitely many columns, such as the Indian buffet process, are useful in constructing nonparametric latent variable models. However, the distribution implied by such models over the number of…

Methodology · Statistics 2012-09-07 Sinead Williamson , Zoubin Ghahramani , Steven N. MacEachern , Eric P. Xing

Forecasts of multivariate probability distributions are required for a variety of applications. Scoring rules enable the evaluation of forecast accuracy, and comparison between forecasting methods. We propose a theoretical framework for…

Statistics Theory · Mathematics 2026-01-30 Xiaochun Meng , James W. Taylor , Souhaib Ben Taieb , Siran Li

We present a framework for designing scores to summarize performance metrics. Our design has two multi-criteria objectives: (1) improving on scores should improve all performance metrics, and (2) achieving pareto-optimal scores should…

Computers and Society · Computer Science 2024-10-10 Anmol Kabra , Mina Karzand , Tosca Lechner , Nathan Srebro , Serena Wang

Offline multi-objective optimization aims to identify Pareto-optimal solutions given a dataset of designs and their objective values. In this work, we propose a preference-guided diffusion model that generates Pareto-optimal designs by…

Machine Learning · Computer Science 2025-12-19 Yashas Annadani , Syrine Belakaria , Stefano Ermon , Stefan Bauer , Barbara E Engelhardt

Score-based diffusion models are a recently developed framework for posterior sampling in Bayesian inverse problems with a state-of-the-art performance for severely ill-posed problems by leveraging a powerful prior distribution learned from…

We consider joint inversion for two or more unknown parameters from observational data in the Bayesian framework. Standard approaches often either treat the parameters as independent or impose structural similarity through regularisation…

Methodology · Statistics 2026-05-04 Ruanui Nicholson , Matti Niskanen , Oliver J. Maclaren , Jari P. Kaipio