English
Related papers

Related papers: A PCA-based Data Prediction Method

200 papers

Dimensionality reduction is a crucial step for pattern recognition and data mining tasks to overcome the curse of dimensionality. Principal component analysis (PCA) is a traditional technique for unsupervised dimensionality reduction, which…

Machine Learning · Computer Science 2017-05-04 Zan Gao , Guotai Zhang , Feiping Nie , Hua Zhang

A problem of current interest is the estimation of spatially distributed processes at locations where measurements are missing. Linear interpolation methods rely on the Gaussian assumption, which is often unrealistic in practice, or…

Data Analysis, Statistics and Probability · Physics 2013-01-09 Milan Žukovič , Dionissios T. Hristopulos

Our predictions for particle physics processes are realized in a chain of complex simulators. They allow us to generate high-fidelity simulated data, but they are not well-suited for inference on the theory parameters with observed data. We…

High Energy Physics - Phenomenology · Physics 2020-11-03 Johann Brehmer , Kyle Cranmer

Missing data is a fundamental challenge in data science, significantly hindering analysis and decision-making across a wide range of disciplines, including healthcare, bioinformatics, social science, e-commerce, and industrial monitoring.…

Machine Learning · Statistics 2026-05-12 Jicong Fan

Techniques such as clusterization, neural networks and decision making usually rely on algorithms that are not well suited to deal with missing values. However, real world data frequently contains such cases. The simplest solution is to…

Machine Learning · Computer Science 2016-08-16 Davi E. N. Frossard , Igor O. Nunes , Renato A. Krohling

Sensor data has been playing an important role in machine learning tasks, complementary to the human-annotated data that is usually rather costly. However, due to systematic or accidental mis-operations, sensor data comes very often with a…

Machine Learning · Computer Science 2017-11-22 Jingguang Zhou , Zili Huang

Dislocation networks and their evolution are known to control the mechanical properties of metal samples. However, the lack of computationally efficient and statistically rigorous descriptors for such defect systems has hindered the…

Disordered Systems and Neural Networks · Physics 2021-05-18 Andreas E. Robertson , Surya R. Kalidindi

Tensor classification is gaining importance across fields, yet handling partially observed data remains challenging. In this paper, we introduce a novel approach to tensor classification with incomplete data, framed within high-dimensional…

Machine Learning · Statistics 2024-11-01 Elynn Chen , Yuefeng Han , Jiayu Li

Linear principal component analysis (PCA) can be extended to a nonlinear PCA by using artificial neural networks. But the benefit of curved components requires a careful control of the model complexity. Moreover, standard techniques for…

Machine Learning · Computer Science 2012-04-04 Matthias Scholz

In the last couple of decades, there has been major advancements in the domain of missing data imputation. The techniques in the domain include amongst others: Expectation Maximization, Neural Networks with Evolutionary Algorithms or…

Neural and Evolutionary Computing · Computer Science 2015-12-07 Collins Leke , Tshilidzi Marwala , Satyakama Paul

This paper describes a novel approach to change-point detection when the observed high-dimensional data may have missing elements. The performance of classical methods for change-point detection typically scales poorly with the…

Machine Learning · Statistics 2015-06-11 Yao Xie , Jiaji Huang , Rebecca Willett

We provide a probabilistic and infinitesimal view of how the principal component analysis procedure (PCA) can be generalized to analysis of nonlinear manifold valued data. Starting with the probabilistic PCA interpretation of the Euclidean…

Statistics Theory · Mathematics 2018-06-26 Stefan Sommer

We propose a new method to impute missing values in mixed datasets. It is based on a principal components method, the factorial analysis for mixed data, which balances the influence of all the variables that are continuous and categorical…

Applications · Statistics 2013-02-20 Vincent Audigier , François Husson , Julie Josse

Training Data Attribution (TDA) seeks to trace model predictions back to influential training examples, enhancing interpretability and safety. We formulate TDA as a Bayesian information-theoretic problem: subsets are scored by the…

Machine Learning · Computer Science 2026-04-10 Dharmesh Tailor , Nicolò Felicioni , Kamil Ciosek

A large number of algorithms in machine learning, from principal component analysis (PCA), and its non-linear (kernel) extensions, to more recent spectral embedding and support estimation methods, rely on estimating a linear subspace from…

Machine Learning · Statistics 2014-08-22 Alessandro Rudi , Guille D. Canas , Lorenzo Rosasco

Distributed computing is a standard way to scale up machine learning and data science algorithms to process large amounts of data. In such settings, avoiding communication amongst machines is paramount for achieving high performance. Rather…

Machine Learning · Statistics 2021-05-04 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

In order to predict and fill in the gaps in categorical datasets, this research looked into the use of machine learning algorithms. The emphasis was on ensemble models constructed using the Error Correction Output Codes framework, including…

Machine Learning · Computer Science 2024-09-13 Muhammad Ishaq , Sana Zahir , Laila Iftikhar , Mohammad Farhad Bulbul , Seungmin Rho , Mi Young Lee

Modern scientific computational methods are undergoing a transformative change; big data and statistical learning methods now have the potential to outperform the classical first-principles modeling paradigm. This book bridges this…

Data Analysis, Statistics and Probability · Physics 2018-03-22 John Harlim

Methods for analysis of principal components in discrete data have existed for some time under various names such as grade of membership modelling, probabilistic latent semantic analysis, and genotype inference with admixture. In this paper…

Machine Learning · Computer Science 2012-07-19 Wray L. Buntine , Aleks Jakulin

Most recent network failure diagnosis systems focused on data center networks where complex measurement systems can be deployed to derive routing information and ensure network coverage in order to achieve accurate and fast fault…

Networking and Internet Architecture · Computer Science 2022-07-06 Yufeng Xin , Shih-Wen Fu , Anirban Mandal , Ryan Tanaka , Mats Rynge , Karan Vahi , Ewa Deelman