English
Related papers

Related papers: A Statistical Method for Corrupt Agents Detection

200 papers

Measurements on dynamical systems, experimental or otherwise, are often subjected to inaccuracies capable of introducing corruption; removal of which is a problem of fundamental importance in the physical sciences. In this work we propose…

Fluid Dynamics · Physics 2022-11-08 Daniel Kelshaw , Luca Magri

This paper constructs a third-step second-order numerical approach for solving a mathematical model on the dynamic of corruption and poverty. The stability and error estimates of the proposed technique are analyzed using the $L^{2}$-norm.…

General Economics · Economics 2022-06-13 Eric Ngondiep

Principal component analysis (PCA) aims at estimating the direction of maximal variability of a high-dimensional dataset. A natural question is: does this task become easier, and estimation more accurate, when we exploit additional…

Information Theory · Computer Science 2014-06-19 Andrea Montanari , Emile Richard

PCA is a classical statistical technique whose simplicity and maturity has seen it find widespread use as an anomaly detection technique. However, it is limited in this regard by being sensitive to gross perturbations of the input, and by…

Machine Learning · Computer Science 2017-08-01 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

Principal Component Analysis (PCA) is a ubiquitous tool with many applications in machine learning including feature construction, subspace embedding, and outlier detection. In this paper, we present an algorithm for computing the top…

Machine Learning · Computer Science 2013-10-25 Nikos Karampatziakis , Paul Mineiro

We introduce a variant of (sparse) PCA in which the set of feasible support sets is determined by a graph. In particular, we consider the following setting: given a directed acyclic graph $G$ on $p$ vertices corresponding to variables, the…

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

In this paper, we study the problem of sparse Principal Component Analysis (PCA) in the high-dimensional setting with missing observations. Our goal is to estimate the first principal component when we only have access to partial…

Statistics Theory · Mathematics 2012-06-04 Karim Lounici

Robust Principal Component Analysis (RPCA) is a widely used method for recovering low-rank structure from data matrices corrupted by significant and sparse outliers. These corruptions may arise from occlusions, malicious tampering, or other…

Methodology · Statistics 2023-10-31 Xiaojun Zheng , Simon Mak , Liyan Xie , Yao Xie

Loosely speaking, the Shannon entropy rate is used to gauge a stochastic process' intrinsic randomness; the statistical complexity gives the cost of predicting the process. We calculate, for the first time, the entropy rate and statistical…

Statistical Mechanics · Physics 2017-09-13 S. E. Marzen , J. P. Crutchfield

The Agenda 2030 recognises corruption as a major obstacle to sustainable development and integrates its reduction among SDG targets, in view of developing peaceful, just and strong institutions. In this paper, we propose a method to assess…

Applications · Statistics 2023-09-06 Michela Gnaldi , Simone Del Sarto

The randomzied Kaczmarz method, along with its recently developed variants, has become a popular tool for dealing with large-scale linear systems. However, these methods usually fail to converge when the linear systems are affected by heavy…

Optimization and Control · Mathematics 2023-10-09 Lu Zhang , Hongxia Wang , Hui Zhang

A new statistical procedure, based on a modified spline basis, is proposed to identify the linear components in the panel data model with fixed effects. Under some mild assumptions, the proposed procedure is shown to consistently estimate…

Econometrics · Economics 2019-11-21 Ruiqi Liu , Ben Boukai , Zuofeng Shang

At the crossway of machine learning and data analysis, anomaly detection aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Methodology · Statistics 2025-06-06 Romain Valla , Pavlo Mozharovskyi , Florence d'Alché-Buc

We propose a new sparse principal component analysis (SPCA) method in which the solutions are obtained by projecting the full cardinality principal components onto subsets of variables. The resulting components are guaranteed to explain a…

Methodology · Statistics 2019-10-09 Giovanni Maria Merola

We introduce a comprehensive and statistical framework in a model free setting for a complete treatment of localized data corruptions due to severe noise sources, e.g., an occluder in the case of a visual recording. Within this framework,…

Machine Learning · Computer Science 2014-10-02 Huseyin Ozkan , Ozgun S. Pelvan , Suleyman S. Kozat

Modern power systems have begun integrating synchrophasor technologies into part of daily operations. Given the amount of solutions offered and the maturity rate of application development it is not a matter of "if" but a matter of "when"…

Machine Learning · Computer Science 2015-09-18 Jordan Landford , Rich Meier , Richard Barella , Xinghui Zhao , Eduardo Cotilla-Sanchez , Robert B. Bass , Scott Wallace

Often in applications ranging from medical imaging and sensor networks to error correction and data science (and beyond), one needs to solve large-scale linear systems in which a fraction of the measurements have been corrupted. We consider…

Numerical Analysis · Mathematics 2021-07-09 Jamie Haddock , Deanna Needell , Elizaveta Rebrova , William Swartworth

Klaassen in (Klaassen 2015) proposed a method for the detection of data manipulation given the means and standard deviations for the cells of a oneway ANOVA design. This comment critically reviews this method. In addition, inspired by this…

Methodology · Statistics 2015-07-16 Hannes Matuschek

Principal Component analysis (PCA) is a useful statistical technique that is commonly used for multivariate analysis of correlated variables. It is usually applied as a dimension reduction method: the top principal components (PCs)…