English
Related papers

Related papers: Disjoint principal component analysis by constrain…

200 papers

Principal Component Analysis (PCA) is a fundamental data preprocessing tool in the world of machine learning. While PCA is often thought of as a dimensionality reduction method, the purpose of PCA is actually two-fold: dimension reduction…

Machine Learning · Computer Science 2023-01-25 Arpita Gang , Waheed U. Bajwa

Ranking is one of the most fundamental problems in machine learning with applications in many branches of computer science such as: information retrieval systems, recommendation systems, machine translation and computational biology.…

Data Structures and Algorithms · Computer Science 2015-04-07 Krzysztof Choromanski

In this paper we consider a distributed optimization scenario in which a set of agents has to solve a convex optimization problem with separable cost function, local constraint sets and a coupling inequality constraint. We propose a novel…

Systems and Control · Computer Science 2018-04-25 Ivano Notarnicola , Giuseppe Notarstefano

In this paper we propose a Particle Swarm Optimization algorithm combined with Novelty Search. Novelty Search finds novel place to search in the search domain and then Particle Swarm Optimization rigorously searches that area for global…

Neural and Evolutionary Computing · Computer Science 2024-09-02 Mr. Rajesh Misra , Kumar S Ray

Mixtures of Gaussian factors are powerful tools for modeling an unobserved heterogeneous population, offering - at the same time - dimension reduction and model-based clustering. Unfortunately, the high prevalence of spurious solutions and…

Methodology · Statistics 2016-08-08 L. A. García-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar

With the availability of extraordinarily huge data sets, solving the problems of distributed statistical methodology and computing for such data sets has become increasingly crucial in the big data area. In this paper, we focus on the…

Machine Learning · Statistics 2023-10-24 Yue Chao , Lei Huang , Xuejun Ma

Principal component analysis is a versatile tool to reduce dimensionality which has wide applications in statistics and machine learning. It is particularly useful for modeling data in high-dimensional scenarios where the number of…

Methodology · Statistics 2022-08-18 Xiaoyu Hu , Fang Yao

Principal component analysis and factor analysis are fundamental multivariate analysis methods. In this paper a unified framework to connect them is introduced. Under a general latent variable model, we present matrix optimization problems…

Methodology · Statistics 2024-05-31 Shifeng Xiong

Machine learning with big data often involves large optimization models. For distributed optimization over a cluster of machines, frequent communication and synchronization of all model parameters (optimization variables) can be very…

Optimization and Control · Mathematics 2017-10-17 Lin Xiao , Adams Wei Yu , Qihang Lin , Weizhu Chen

We study the distributed computing setting in which there are multiple servers, each holding a set of points, who wish to compute functions on the union of their point sets. A key task in this setting is Principal Component Analysis (PCA),…

Machine Learning · Computer Science 2014-12-24 Maria-Florina Balcan , Vandana Kanchanapally , Yingyu Liang , David Woodruff

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Principal component analysis (PCA) is perhaps the most widely used method for data dimensionality reduction. A key question in PCA is deciding how many factors to retain. This manuscript describes a new approach to automatically selecting…

Methodology · Statistics 2026-02-10 Enes Makalic , Daniel F. Schmidt

Topology optimisation of trusses can be formulated as a combinatorial and multi-modal problem in which locating distinct optimal designs allows practitioners to choose the best design based on their preferences. Bilevel optimisation has…

Neural and Evolutionary Computing · Computer Science 2021-12-16 Hirad Assimi , Frank Neumann , Markus Wagner , Xiaodong Li

Recent methods for learning a linear subspace from data corrupted by outliers are based on convex $\ell_1$ and nuclear norm optimization and require the dimension of the subspace and the number of outliers to be sufficiently small. In sharp…

Machine Learning · Computer Science 2018-12-27 Zhihui Zhu , Yifan Wang , Daniel P. Robinson , Daniel Q. Naiman , Rene Vidal , Manolis C. Tsakiris

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

Optimization and Control · Mathematics 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

Sparse principal component analysis with global support (SPCAgs), is the problem of finding the top-$r$ leading principal components such that all these principal components are linear combinations of a common subset of at most $k$…

Optimization and Control · Mathematics 2022-05-11 Santanu S. Dey , Marco Molinaro , Guanyi Wang

Particle swarm optimization (PSO) is an iterative search method that moves a set of candidate solution around a search-space towards the best known global and local solutions with randomized step lengths. PSO frequently accelerates…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Johannes Jakubik , Adrian Binding , Stefan Feuerriegel

Many practical applications require solving an optimization over large and high-dimensional data sets, which makes these problems hard to solve and prohibitively time consuming. In this paper, we propose a parallel distributed algorithm…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-12-03 Elad Gilboa , Phani Chavali , Peng Yang , Arye Nehorai

Distributed Constraint Optimization Problems (DCOPs) are a widely studied framework for coordinating interactions in cooperative multi-agent systems. In classical DCOPs, variables owned by agents are assumed to be discrete. However, in many…

Multiagent Systems · Computer Science 2020-10-21 Moumita Choudhury , Amit Sarker , Md. Mosaddek Khan , William Yeoh

With this paper, we contribute to the growing research area of feature-based analysis of bio-inspired computing. In this research area, problem instances are classified according to different features of the underlying problem in terms of…

Neural and Evolutionary Computing · Computer Science 2016-02-10 Shayan Poursoltan , Frank Neumann