English
Related papers

Related papers: Estimation of Individual Micro Data from Aggregate…

200 papers

Nowadays, the confidentiality of data and information is of great importance for many companies and organizations. For this reason, they may prefer not to release exact data, but instead to grant researchers access to approximate data. For…

Methodology · Statistics 2021-12-24 Zahra A. Shirazi , João Pedro A. R. da Silva , Camila P. E. de Souza

Deep learning techniques have greatly enhanced the performance of fire detection in videos. However, video-based fire detection models heavily rely on labeled data, and the process of data labeling is particularly costly and time-consuming,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Qinghua Lin , Zuoyong Li , Kun Zeng , Haoyi Fan , Wei Li , Xiaoguang Zhou

Selecting high-quality data can improve the pretraining efficiency of large language models (LLMs). Existing methods generally rely on heuristic techniques or single quality signals, limiting their ability to evaluate data quality…

Computation and Language · Computer Science 2025-05-23 Liangyu Xu , Xuemiao Zhang , Feiyu Duan , Sirui Wang , Rongxiang Weng , Jingang Wang , Xunliang Cai

This paper addresses the critical challenge of improving predictions of climate extreme events, specifically heat waves, using machine learning methods. Our work is framed as a classification problem in which we try to predict whether…

Machine Learning · Computer Science 2025-11-17 Julien Collard , Pierre Gentine , Tian Zheng

Clustered data is ubiquitous in a variety of scientific fields. In this paper, we propose a flexible and interpretable modeling approach, called grouped heterogenous mixture modeling, for clustered data, which models cluster-wise…

Methodology · Statistics 2020-02-10 Shonosuke Sugasawa

Integrated IPD-AD analysis, which combines individual participant data (IPD) with aggregate data (AD), is increasingly recognized as an effective strategy for generating more reliable and generalizable inferences from heterogeneous studies.…

Methodology · Statistics 2026-03-03 Ming-Yueh Huang , Jing Qin , Chiung-Yu Huang

Matrix factorization (MF) can extract the low-rank features and integrate the information of the data manifold distribution from high-dimensional data, which can consider the nonlinear neighbourhood information. Thus, MF has drawn wide…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-24 Zixuan Li , Hao Li , Kenli Li , Fan Wu , Lydia Chen , Keqin Li

Collective intelligence, which aggregates the shared information from large crowds, is often negatively impacted by unreliable information sources with the low quality data. This becomes a barrier to the effective use of collective…

Social and Information Networks · Computer Science 2012-10-04 Guo-Jun Qi , Charu Aggarwal , Pierre Moulin , Thomas Huang

Data privacy has increasingly become a daunting challenge because it limits data availability, which is essential in estimating statistical models such as generalized linear mixed models. Access to personal data often involves considerable…

Methodology · Statistics 2026-05-05 Marie Analiz April Limpoco , Christel Faes , Niel Hens

We consider the problem of mean estimation under user-level local differential privacy, where $n$ users are contributing through their local pool of data samples. Previous work assume that the number of data samples is the same across…

Methodology · Statistics 2024-10-15 Corentin Pla , Hugo Richard , Maxime Vono

Open-source data and tools are lauded as essential for replicable and usable social science, though little is known about their use in resource constrained human service provision. This paper examines the challenges and opportunities of…

Computers and Society · Computer Science 2025-12-16 Maria Y. Rodriguez , Ehren Dohler , Jon Phillips , Melissa Villodas , Voltaire Vegara , Kenny Joseph , Amy Wilson

Many algorithms have been proposed for fitting network models with communities, but most of them do not scale well to large networks, and often fail on sparse networks. Here we propose a new fast pseudo-likelihood method for fitting the…

Social and Information Networks · Computer Science 2013-11-06 Arash A. Amini , Aiyou Chen , Peter J. Bickel , Elizaveta Levina

Distributed learning of probabilistic models from multiple data repositories with minimum communication is increasingly important. We study a simple communication-efficient learning framework that first calculates the local maximum…

Machine Learning · Statistics 2014-10-13 Qiang Liu , Alexander Ihler

The sparse, hierarchical, and modular processing of natural signals is related to the ability of humans to recognize objects with high accuracy. In this study, we report a sparse feature processing and encoding method, which improved the…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Swathikiran Sudhakarana , Alex Pappachen James

In this paper we present a privacy-aware method for estimating source-dominated microphone clusters in the context of acoustic sensor networks (ASNs). The approach is based on clustered federated learning which we adapt to unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-17 Alexandru Nelus , Rene Glitza , Rainer Martin

We consider the problem of communication-constrained collaborative personalized mean estimation under a privacy constraint in an environment of several agents continuously receiving data according to arbitrary unknown agent-specific…

Social and Information Networks · Computer Science 2025-11-10 Yauhen Yakimenka , Hsuan-Yin Lin , Eirik Rosnes , Jörg Kliewer

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

Statistical Mechanics · Physics 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

Suppose we have individual data from an internal study and various summary statistics from relevant external studies. External summary statistics have the potential to improve statistical inference for the internal population; however, it…

Methodology · Statistics 2026-02-06 Wenjie Hu , Ruoyu Wang , Wei Li , Wang Miao

Federated learning (FL) is an emerging technique used to train a machine-learning model collaboratively using the data and computation resource of the mobile devices without exposing privacy-sensitive user data. Appropriate incentive…

Machine Learning · Computer Science 2020-09-22 Takayuki Nishio , Ryoichi Shinkuma , Narayan B. Mandayam

Privacy-preserving data aggregation in ad hoc networks is a challenging problem, considering the distributed communication and control requirement, dynamic network topology, unreliable communication links, etc. Different from the widely…

Systems and Control · Computer Science 2018-02-07 Jianping He , Lin Cai , Peng Cheng , Jianping Pan , Ling Shi