English
Related papers

Related papers: Initialization of Self-Organizing Maps: Principal …

200 papers

We consider the structured-output prediction problem through probabilistic approaches and generalize the "perturb-and-MAP" framework to more challenging weighted Hamming losses, which are crucial in applications. While in principle our…

Machine Learning · Statistics 2018-11-22 Tatiana Shpakova , Francis Bach , Anton Osokin

Convergence rate of training algorithms for neural networks is heavily affected by initialization of weights. In this paper, an original algorithm for initialization of weights in backpropagation neural net is presented with application to…

Machine Learning · Computer Science 2020-04-07 Nadir Murru , Rosaria Rossini

Principal Component Analysis (PCA) finds a linear mapping and maximizes the variance of the data which makes PCA sensitive to outliers and may cause wrong eigendirection. In this paper, we propose techniques to solve this problem; we use…

Artificial Intelligence · Computer Science 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul

The robust principal component analysis (RPCA) decomposes a data matrix into a low-rank part and a sparse part. There are mainly two types of algorithms for RPCA. The first type of algorithm applies regularization terms on the singular…

Numerical Analysis · Mathematics 2021-02-02 Ningyu Sha , Lei Shi , Ming Yan

Pose Graph Optimization (PGO) is an important non-convex optimization problem and is the state-of-the-art formulation for SLAM in robotics. It also has applications like camera motion estimation, structure from motion and 3D reconstruction…

Robotics · Computer Science 2018-06-04 S. M. Nasiri , Reshad Hosseini , Hadi Moradi

Simultaneous Localization and Mapping (SLAM) algorithms perform visual-inertial estimation via filtering or batch optimization methods. Empirical evidence suggests that filtering algorithms are computationally faster, while optimization…

Systems and Control · Electrical Eng. & Systems 2022-08-05 Amay Saxena , Chih-Yuan Chiu , Joseph Menke , Ritika Shrivastava , Shankar Sastry

Compact optimization algorithms are a class of Estimation of Distribution Algorithms (EDAs) characterized by extremely limited memory requirements (hence they are called "compact"). As all EDAs, compact algorithms build and update a…

Artificial Intelligence · Computer Science 2019-04-11 Giovanni Iacca , Fabio Caraffini

In many atmospheric and earth sciences, it is of interest to identify dominant spatial patterns of variation based on data observed at $p$ locations and $n$ time points with the possibility that $p>n$. While principal component analysis…

Methodology · Statistics 2016-02-29 Wen-Ting Wang , Hsin-Cheng Huang

The popular convergence theory of the EM algorithm explains that the observed incomplete data log-likelihood L and the complete data log-likelihood Q are positively correlated, and we can maximize L by maximizing Q. The Deterministic…

Machine Learning · Statistics 2020-07-28 Chenguang Lu

Stochastic planning can be reduced to probabilistic inference in large discrete graphical models, but hardness of inference requires approximation schemes to be used. In this paper we argue that such applications can be disentangled along…

Artificial Intelligence · Computer Science 2022-09-05 Zhennan Wu , Roni Khardon

Principal Component Analysis (PCA) is widely used for dimensionality reduction and data analysis. However, PCA results are adversely affected by outliers often observed in real-world data. Existing robust PCA methods are often…

Computational Engineering, Finance, and Science · Computer Science 2025-06-23 Timbwaoga Aime Judicael Ouermi , Jixian Li , Chris R. Johnson

Quantum algorithms and complexity have recently been studied not only for discrete, but also for some numerical problems. Most attention has been paid so far to the integration problem, for which a speed-up is shown by quantum computers…

Quantum Physics · Physics 2007-05-23 Boleslaw Kacewicz

We establish essentially optimal bounds on the complexity of initial-value problems in the randomized and quantum settings. For this purpose we define a sequence of new algorithms whose error/cost properties improve from step to step. These…

Quantum Physics · Physics 2007-05-23 Boleslaw Kacewicz

Non-orthogonal multiple access (NOMA) technique is important for achieving a high data rate in next-generation wireless communications. A key challenge to fully utilizing the effectiveness of the NOMA technique is the optimization of the…

Information Theory · Computer Science 2024-10-28 Teppei Otsuka , Aohan Li , Hiroki Takesue , Kensuke Inaba , Kazuyuki Aihara , Mikio Hasegawa

The PC algorithm is the state-of-the-art algorithm for causal structure discovery on observational data. It can be computationally expensive in the worst case due to the conditional independence tests are performed in an…

Machine Learning · Computer Science 2021-09-13 Kai Zhang , Chao Tian , Kun Zhang , Todd Johnson , Xiaoqian Jiang

Stochastic Subspace Identification (SSI) is widely used in modal analysis of engineering structures, known for its numerical stability and high accuracy in modal parameter identification. SSI methods are generally classified into two types:…

Computational Physics · Physics 2025-04-02 Biqi Chen , Jun Zhang , Ying Wang

Robust principal component analysis is an important representative method in data analysis. It is usually viewed as an optimization problem involving the rank and $\ell_0$-norm of matrices. In this paper, we study the rank and $\ell_0$…

Optimization and Control · Mathematics 2026-03-04 Wenjing Li , Wei Bian , Kim-Chuan Toh

Most accurate predictions are typically obtained by learning machines with complex feature spaces (as e.g. induced by kernels). Unfortunately, such decision rules are hardly accessible to humans and cannot easily be used to gain insights…

Machine Learning · Statistics 2010-08-13 Alexander Zien , Nicole Kraemer , Soeren Sonnenburg , Gunnar Raetsch

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

Machine Learning · Computer Science 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

Goal oriented autonomous operation of space rovers has been known to increase scientific output of a mission. In this work we present an algorithm, called the RoI Prioritised Sampling (RPS), that prioritises Region-of-Interests (RoIs) in an…

Image and Video Processing · Electrical Eng. & Systems 2022-04-21 Protim Bhattacharjee , Martin Burger , Anko Boerner , Veniamin I. Morgenshtern