English
Related papers

Related papers: Estimation of Individual Micro Data from Aggregate…

200 papers

The statistical analysis of massive and complex data sets will require the development of algorithms that depend on distributed computing and collaborative inference. Inspired by this, we propose a collaborative framework that aims to…

Statistics Theory · Mathematics 2015-07-02 Gérard Biau , Kevin Bleakley , Benoit Cadre

By distributing the training process, local approximation reduces the cost of the standard Gaussian Process. An ensemble technique combines local predictions from Gaussian experts trained on different partitions of the data. Ensemble…

Machine Learning · Computer Science 2024-01-09 Hamed Jalali , Gjergji Kasneci

Training data compositions for Large Language Models (LLMs) can significantly affect their downstream performance. However, a thorough data ablation study exploring large sets of candidate data mixtures is typically prohibitively expensive…

Computation and Language · Computer Science 2024-12-10 Clara Na , Ian Magnusson , Ananya Harsh Jha , Tom Sherborne , Emma Strubell , Jesse Dodge , Pradeep Dasigi

Many databases on the web are "hidden" behind (i.e., accessible only through) their restrictive, form-like, search interfaces. Recent studies have shown that it is possible to estimate aggregate query answers over such hidden web databases…

Databases · Computer Science 2014-05-02 Weimo Liu , Saravanan Thirumuruganathan , Nan Zhang , Gautam Das

In the context of personalized medicine, machine learning algorithms are growing in popularity. These algorithms require substantial information, which can be acquired effectively through the usage of previously gathered data. Open data and…

Machine Learning · Computer Science 2026-01-13 Niklas Jacobs , Manuel C. Voelkle , Norbert Kathmann , Kevin Hilbert

Estimating mutual information (MI) from samples is a fundamental problem in statistics, machine learning, and data analysis. Recently it was shown that a popular class of non-parametric MI estimators perform very poorly for strongly…

Information Theory · Computer Science 2016-02-18 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Gathering cyber threat intelligence from open sources is becoming increasingly important for maintaining and achieving a high level of security as systems become larger and more complex. However, these open sources are often subject to…

Cryptography and Security · Computer Science 2022-07-25 Markus Bayer , Tobias Frey , Christian Reuter

The multicommodity capacitated fixed-charge network design problem has been extensively studied in the literature due to its wide range of applications. Despite the fact that many sophisticated solution methods exist today, finding…

Optimization and Control · Mathematics 2024-09-10 Charly Robinson La Rocca , Jean-François Cordeau , Emma Frejinger

This paper presents methods which are aimed at finding approximations to missing data in a dataset by using optimization algorithms to optimize the network parameters after which prediction and classification tasks can be performed. The…

Neural and Evolutionary Computing · Computer Science 2014-03-24 Collins Leke , Bhekisipho Twala , T. Marwala

In this paper, we propose a novel distributed data-driven optimization scheme. In detail, we focus on the so-called aggregative framework, a scenario in which a set of agents aim to cooperatively minimize the sum of local costs, each…

Optimization and Control · Mathematics 2026-01-27 Riccardo Brumali , Guido Carnevale , Giuseppe Notarstefano

We consider data assimilation for the heat equation using a finite element space semi-discretization. The approach is optimization based, but the design of regularization operators and parameters rely on techniques from the theory of…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Lauri Oksanen

Existing variance reduction techniques used in stochastic simulations for rare event analysis still require a substantial number of model evaluations to estimate small failure probabilities. In the context of complex, nonlinear finite…

Machine Learning · Computer Science 2025-08-04 Liuyun Xu , Seymour M. J. Spence

Load forecasting is an essential task performed within the energy industry to help balance supply with demand and maintain a stable load on the electricity grid. As supply transitions towards less reliable renewable energy generation, smart…

Machine Learning · Computer Science 2022-09-09 Christopher Briggs , Zhong Fan , Peter Andras

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

In this work, we study the problem of clustering survival data $-$ a challenging and so far under-explored task. We introduce a novel semi-supervised probabilistic approach to cluster survival data by leveraging recent advances in…

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on…

Atmospheric and Oceanic Physics · Physics 2023-05-17 Maximiliano A. Sacco , Manuel Pulido , Juan J. Ruiz , Pierre Tandeo

Email service providers have employed many email classification and prioritization systems over the last decade to improve their services. In order to assist email services, we propose a personalized email community detection method to…

Social and Information Networks · Computer Science 2013-06-07 Waqas Nawaz , Yongkoo Han , Kifayat-Ullah Khan , Young-Koo Lee

In this study, we develop a novel framework to assess health risks due to heat hazards across various localities (zip codes) across the state of Maryland with the help of two commonly used indicators i.e. exposure and vulnerability. Our…

Machine Learning · Computer Science 2023-10-24 Akshay Bansal , Ayda Kianmehr

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

Machine Learning · Computer Science 2025-03-04 Rickard Brännvall

This paper presents a general and efficient framework for probabilistic inference and learning from arbitrary uncertain information. It exploits the calculation properties of finite mixture models, conjugate families and factorization. Both…

Artificial Intelligence · Computer Science 2011-05-19 M. C. Garrido , P. E. Lopez-de-Teruel , A. Ruiz