English
Related papers

Related papers: Statistical Distortion: Consequences of Data Clean…

200 papers

Protecting the privacy of data-sets has become hugely important these days. Many real-life data-sets like income data, medical data need to be secured before making it public. However, security comes at the cost of losing some useful…

Methodology · Statistics 2018-07-16 Debolina Ghatak , Bimak K Roy

Finding a basis matrix (dictionary) by which objective signals are represented sparsely is of major relevance in various scientific and technological fields. We consider a problem to learn a dictionary from a set of training signals. We…

Disordered Systems and Neural Networks · Physics 2015-06-04 Ayaka Sakata , Yoshiyuki Kabashima

Dataset distillation has emerged as a strategy to overcome the hurdles associated with large datasets by learning a compact set of synthetic data that retains essential information from the original dataset. While distilled data can be used…

Machine Learning · Computer Science 2024-07-23 William Yang , Ye Zhu , Zhiwei Deng , Olga Russakovsky

If our aesthetic preferences are affected by fractal geometry of nature, scaling regularities would be expected to appear in all art forms, including music. While a variety of statistical tools have been proposed to analyze time series in…

Pattern Formation and Solitons · Physics 2023-04-05 John McDonough , Andrzej Herczyński

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

Machine Learning · Computer Science 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates

The article contains a methodology for social statistics assessing. The significance of minorities (groups that differ in their attributes from the majority) has grown substantially in the modern postindustrial economy and society. In the…

Physics and Society · Physics 2018-09-12 G. K. Kamenev , I. G. Kamenev

A common problem in machine learning is determining if a variable significantly contributes to a model's prediction performance. This problem is aggravated for datasets, such as gene expression datasets, that suffer the worst case of…

Methodology · Statistics 2023-10-13 Yue Wu , Ted Spaide , Kenji Nakamichi , Russell Van Gelder , Aaron Lee

In this paper, we propose a metric on the space of finite sets of trajectories for assessing multi-target tracking algorithms in a mathematically sound way. The main use of the metric is to compare estimates of trajectories from different…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Ángel F. García-Fernández , Abu Sajana Rahmathullah , Lennart Svensson

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a…

Methodology · Statistics 2022-03-30 Xiucai Ding , Qiang Sun

Though data cleaning systems have earned great success and wide spread in both academia and industry, they fall short when trying to clean spatial data. The main reason is that state-of-the-art data cleaning systems mainly rely on…

Databases · Computer Science 2023-11-09 Yuchuan Huang , Mohamed F. Mokbel

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

Robust estimation of location is a fundamental problem in statistics, particularly in scenarios where data contamination by outliers or model misspecification is a concern. In univariate settings, methods such as the sample median and…

Statistics Theory · Mathematics 2025-05-07 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Gonzalo Perera

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different results. As a result, their performance is evaluated over several repeats, or runs, on the…

Machine Learning · Computer Science 2026-05-18 Moslem Noori , Elisabetta Valiante , Thomas Van Vaerenbergh , Masoud Mohseni , Ignacio Rozada

We focus in this report on two main axes. The first is dedicated to the study of the effect of replicas distribution on data grid performances. In this respect, our main contributions are as follows: 1) An overview of replication strategies…

Databases · Computer Science 2019-12-24 Tarek Hamrouni

In this work we introduce declarative statistics, a suite of declarative modelling tools for statistical analysis. Statistical constraints represent the key building block of declarative statistics. First, we introduce a range of relevant…

Artificial Intelligence · Computer Science 2017-12-29 Roberto Rossi , Özgür Akgün , Steven Prestwich , S. Armagan Tarim

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

In Cyber-Physical Systems (CPSs), inference based on communicated data is of critical significance as it can be used to manipulate or damage the control operations by adversaries. This calls for efficient mechanisms for secure transmission…

Information Theory · Computer Science 2018-09-13 Gaurav Kumar Agarwal , Mohammed Karmoose , Suhas Diggavi , Christina Fragouli , Paulo Tabuada

This work is motivated by learning the individualized minimal clinically important difference, a vital concept to assess clinical importance in various biomedical studies. We formulate the scientific question into a high-dimensional…

Methodology · Statistics 2023-03-28 Huijie Feng , Jingyi Duan , Yang Ning , Jiwei Zhao

Assessing and improving the quality of data are fundamental challenges for data-intensive systems that have given rise to applications targeting transformation and cleaning of data. However, while schema design, data cleaning, and data…

Databases · Computer Science 2017-03-28 Rada Chirkova , Jon Doyle , Juan L. Reutter