English
Related papers

Related papers: Learning from both experts and data

200 papers

Understanding the causal relationships that underlie a system is a fundamental prerequisite to accurate decision-making. In this work, we explore how expert knowledge can be used to improve the data-driven identification of causal graphs,…

Artificial Intelligence · Computer Science 2023-07-06 Stephanie Long , Alexandre Piché , Valentina Zantedeschi , Tibor Schuster , Alexandre Drouin

We consider the problem of eliciting expert assessments of an uncertain parameter. The context is risk control, where there are, in fact, three uncertain parameters to be estimates. Two of these are probabilities, requiring the that the…

Artificial Intelligence · Computer Science 2020-10-23 Paul B. Kantor

Estimating the uncertainty in deep neural network predictions is crucial for many real-world applications. A common approach to model uncertainty is to choose a parametric distribution and fit the data to it using maximum likelihood…

Machine Learning · Computer Science 2022-11-28 Ali Harakeh , Jordan Hu , Naiqing Guan , Steven L. Waslander , Liam Paull

We consider the problem of learning a discrete distribution in the presence of an $\epsilon$ fraction of malicious data sources. Specifically, we consider the setting where there is some underlying distribution, $p$, and each data source…

Machine Learning · Computer Science 2017-11-23 Mingda Qiao , Gregory Valiant

The setting of a right-censored random sample subject to contamination is considered. In various fields, expert information is often available and used to overcome the contamination. This paper integrates expert knowledge into the…

Methodology · Statistics 2023-03-28 Martin Bladt , Christian Furrer

This paper presents a general and efficient framework for probabilistic inference and learning from arbitrary uncertain information. It exploits the calculation properties of finite mixture models, conjugate families and factorization. Both…

Artificial Intelligence · Computer Science 2011-05-19 M. C. Garrido , P. E. Lopez-de-Teruel , A. Ruiz

Diffusion probabilistic models can generate high-quality samples. Yet, their sampling process requires numerous denoising steps, making it slow and computationally intensive. We propose to reduce the sampling cost by pruning a pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Alireza Ganjdanesh , Yan Kang , Yuchen Liu , Richard Zhang , Zhe Lin , Heng Huang

Hybrid modelling reduces the misspecification of expert models by combining them with machine learning (ML) components learned from data. Similarly to many ML algorithms, hybrid model performance guarantees are limited to the training…

Machine Learning · Computer Science 2023-04-13 Antoine Wehenkel , Jens Behrmann , Hsiang Hsu , Guillermo Sapiro , Gilles Louppe , Jörn-Henrik Jacobsen

Unbiased assessment of the predictivity of models learnt by supervised machine-learning methods requires knowledge of the learned function over a reserved test set (not used by the learning algorithm). The quality of the assessment depends,…

Statistics Theory · Mathematics 2022-07-11 Elias Fekhari , Bertrand Iooss , Joseph Muré , Luc Pronzato , Maria-João Rendas

Inference on unknown quantities in dynamical systems via observational data is essential for providing meaningful insight, furnishing accurate predictions, enabling robust control, and establishing appropriate designs for future…

Methodology · Statistics 2018-02-06 M. Chung , M. Binois , R. B. Gramacy , D. J. Moquin , A. P. Smith , A. M. Smith

Distributed estimation that recruits potentially large groups of humans to collect data about a phenomenon of interest has emerged as a paradigm applicable to a broad range of detection and estimation tasks. However, it also presents a…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Kewei Chen , Donya Ghavidel , Vijay Gupta , Yih-Fang Huang

Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and robotics. A widely used measure for quantifying the…

Machine Learning · Statistics 2015-09-17 Johannes Kulick , Robert Lieck , Marc Toussaint

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

We study prediction of future outcomes with supervised models that use privileged information during learning. The privileged information comprises samples of time series observed between the baseline time of prediction and the future…

Optimum parameter estimation methods require knowledge of a parametric probability density that statistically describes the available observations. In this work we examine Bayesian and non-Bayesian parameter estimation problems under a…

Applications · Statistics 2022-02-01 George V. Moustakides

Data-free knowledge distillation is a challenging model lightweight task for scenarios in which the original dataset is not available. Previous methods require a lot of extra computational costs to update one or more generators and their…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Yuzheng Wang , Zuhao Ge , Zhaoyu Chen , Xian Liu , Chuangjia Ma , Yunquan Sun , Lizhe Qi

Expert finding is an information retrieval task that is concerned with the search for the most knowledgeable people with respect to a specific topic, and the search is based on documents that describe people's activities. The task involves…

Information Retrieval · Computer Science 2015-01-22 Catarina Moreira , Bruno Martins , Pável Calado

We study two-sample variable selection: identifying variables that discriminate between the distributions of two sets of data vectors. Such variables help scientists understand the mechanisms behind dataset discrepancies. Although…

Machine Learning · Statistics 2025-11-06 Kensuke Mitsuzawa , Motonobu Kanagawa , Stefano Bortoli , Margherita Grossi , Paolo Papotti

Work in cognitive science and artificial intelligence has suggested that exposing learning agents to traces of interaction between multiple individuals can improve performance in a variety of settings, yet it remains unknown which features…

Computation and Language · Computer Science 2026-04-15 Dhara Yu , Karthikeya Kaushik , Bill D. Thompson

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane