English
Related papers

Related papers: Method G: Uncertainty Quantification for Distribut…

200 papers

As data plays an increasingly pivotal role in decision-making, the emergence of data markets underscores the growing importance of data valuation. Within the machine learning landscape, Data Shapley stands out as a widely embraced method…

Machine Learning · Statistics 2024-07-30 Mengmeng Wu , Zhihong Liu , Xiang Li , Ruoxi Jia , Xiangyu Chang

Data integration is a notoriously difficult and heuristic-driven process, especially when ground-truth data are not readily available. This paper presents a measure of uncertainty by providing maximal and minimal ranges of a query outcome…

Databases · Computer Science 2023-09-12 Deniz Turkcapar , Sanjay Krishnan

The development and evaluation of graph neural networks (GNNs) generally follow the independent and identically distributed (i.i.d.) assumption. Yet this assumption is often untenable in practice due to the uncontrollable data generation…

Machine Learning · Computer Science 2025-03-06 Yiming Xu , Bin Shi , Zhen Peng , Huixiang Liu , Bo Dong , Chen Chen

The major sources of abundant data are constantly expanding with the available data collection methodologies in various applications - medical, insurance, scientific, bio-informatics and business. These data sets may be distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-24 Aruna Govada , Sanjay K. Sahay

We propose a framework for general Bayesian inference. We argue that a valid update of a prior belief distribution to a posterior can be made for parameters which are connected to observations through a loss function rather than the…

Statistics Theory · Mathematics 2016-02-29 Pier Giovanni Bissiri , Chris Holmes , Stephen Walker

Distributed data aggregation is an important task, allowing the decentralized determination of meaningful global properties, that can then be used to direct the execution of other applications. The resulting values result from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-10-05 Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

The objective of this work is to quantify the uncertainty in probability of failure estimates resulting from incomplete knowledge of the probability distributions for the input random variables. We propose a framework that couples the…

Methodology · Statistics 2021-10-26 Dimitris G. Giovanis , Michael Shields

The study of multimodality has garnered significant interest in fields where the analysis of interactions among multiple information sources can enhance predictive modeling, data fusion, and interpretability. Partial information…

Machine Learning · Computer Science 2025-10-07 Wenyuan Zhao , Adithya Balachandran , Chao Tian , Paul Pu Liang

As of 2005, sampling has been incorporated in all major database systems. While efficient sampling techniques are realizable, determining the accuracy of an estimate obtained from the sample is still an unresolved problem. In this paper, we…

Databases · Computer Science 2013-07-02 Supriya Nirkhiwale , Alin Dobra , Chris Jermaine

Generalized Fiducial Inference (GFI) is motivated by R.A. Fisher's approach of obtaining posterior-like distributions when there is no prior information available for the unknown parameter. Without the use of Bayes' theorem GFI proposes a…

Statistics Theory · Mathematics 2016-08-26 Abhishek Pal Majumder , Jan Hannig

Many current challenges involve understanding the complex dynamical interplay between the constituents of systems. Typically, the number of such constituents is high, but only limited data sources on them are available. Conventional…

Populations and Evolution · Quantitative Biology 2021-12-17 Jana C. Massing , Thilo Gross

Collective intelligence, which aggregates the shared information from large crowds, is often negatively impacted by unreliable information sources with the low quality data. This becomes a barrier to the effective use of collective…

Social and Information Networks · Computer Science 2012-10-04 Guo-Jun Qi , Charu Aggarwal , Pierre Moulin , Thomas Huang

Information theoretic quantities play an important role in various settings in machine learning, including causality testing, structure inference in graphical models, time-series problems, feature selection as well as in providing privacy…

Information Theory · Computer Science 2018-10-30 Arman Rahimzamani , Himanshu Asnani , Pramod Viswanath , Sreeram Kannan

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

Decentralized data sources are prevalent in real-world applications, posing a formidable challenge for causal inference. These sources cannot be consolidated into a single entity owing to privacy constraints. The presence of dissimilar data…

Machine Learning · Computer Science 2024-05-31 Thanh Vinh Vo , Young lee , Tze-Yun Leong

We are interested in estimating the effect of a treatment applied to individuals at multiple sites, where data is stored locally for each site. Due to privacy constraints, individual-level data cannot be shared across sites; the sites may…

Machine Learning · Computer Science 2023-04-04 Ruoxuan Xiong , Allison Koenecke , Michael Powell , Zhu Shen , Joshua T. Vogelstein , Susan Athey

In reliable decision-making systems based on machine learning, models have to be robust to distributional shifts or provide the uncertainty of their predictions. In node-level problems of graph learning, distributional shifts can be…

Machine Learning · Computer Science 2023-11-02 Gleb Bazhenov , Denis Kuznedelev , Andrey Malinin , Artem Babenko , Liudmila Prokhorenkova

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

In this paper we analyse Belief Propagation over a Gaussian model in a dynamic environment. Recently, this has been proposed as a method to average local measurement values by a distributed protocol ("Consensus Propagation", Moallemi & Van…

Artificial Intelligence · Computer Science 2012-08-10 Erik Aurell , René Pfitzner

Due to rapid data growth, statistical analysis of massive datasets often has to be carried out in a distributed fashion, either because several datasets stored in separate physical locations are all relevant to a given problem, or simply to…

Computation · Statistics 2016-02-08 Matthias Katzfuss , Dorit Hammerling