English
Related papers

Related papers: Boosting Independent Component Analysis

200 papers

In this article, we introduce a procedure for selecting variables in principal components analysis. The procedure was developed to identify a small subset of the original variables that best explain the principal components through…

Statistics Theory · Mathematics 2017-01-31 Yanina Gimenez , Guido Giussani

Boosting is a fundamental approach in machine learning that enjoys both strong theoretical and practical guarantees. At a high-level, boosting algorithms cleverly aggregate weak learners to generate predictions with arbitrarily high…

Machine Learning · Computer Science 2022-10-19 Vinod Raman , Ambuj Tewari

Uplift modeling is an area of machine learning which aims at predicting the causal effect of some action on a given individual. The action may be a medical procedure, marketing campaign, or any other circumstance controlled by the…

Machine Learning · Computer Science 2018-07-23 Michał Sołtys , Szymon Jaroszewicz

In recent years, numerous ideas have emerged for designing a mutually reinforcing mechanism or extra stages for the image fusion task, ignoring the inevitable gaps between different vision tasks and the computational burden. We argue that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Hui Li , Xi Li , Josef Kittler

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

Independent component analysis (ICA), is a blind source separation method that is becoming increasingly used to separate brain and non-brain related activities in electroencephalographic (EEG) and other electrophysiological recordings. It…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Gwenevere Frank , Scott Makeig , Arnaud Delorme

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

A compressed full-text self-index occupies space close to that of the compressed text and simultaneously allows fast pattern matching and random access to the underlying text. Among the best compressed self-indexes, in theory and in…

Data Structures and Algorithms · Computer Science 2011-04-20 Juha Kärkkäinen , Simon J. Puglisi

Finding a maximum independent set is a fundamental NP-hard problem that is used in many real-world applications. Given an unweighted graph, this problem asks for a maximum cardinality set of pairwise non-adjacent vertices. Some of the most…

Data Structures and Algorithms · Computer Science 2021-03-30 Demian Hespe , Sebastian Lamm , Christian Schorr

Boosting combines weak (biased) learners to obtain effective learning algorithms for classification and prediction. In this paper, we show a connection between boosting and kernel-based methods, highlighting both theoretical and practical…

Machine Learning · Statistics 2017-04-14 Aleksandr Y. Aravkin , Giulio Bottegal , Gianluigi Pillonetto

Recent deep clustering models have produced impressive clustering performance. However, a common issue with existing methods is the disparity between global and local feature structures. While local structures typically show strong…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hanyang Li , Yuheng Jia , Hui Liu , Junhui Hou

Latent variable discovery is a central problem in data analysis with a broad range of applications in applied science. In this work, we consider data given as an invertible mixture of two statistically independent components and assume that…

Machine Learning · Statistics 2023-03-08 Uri Shaham , Jonathan Svirsky , Ori Katz , Ronen Talmon

We present an alternating least squares type numerical optimization scheme to estimate conditionally-independent mixture models in $\mathbb{R}^n$, without parameterizing the distributions. Following the method of moments, we tackle an…

Numerical Analysis · Mathematics 2023-08-09 Yifan Zhang , Joe Kileel

We consider the multi-label ranking approach to multi-label learning. Boosting is a natural method for multi-label ranking as it aggregates weak predictions through majority votes, which can be directly used as scores to produce a ranking…

Machine Learning · Statistics 2018-02-27 Young Hun Jung , Ambuj Tewari

Recently, there has been a trend to combine independent component analysis and canonical polyadic decomposition (ICA-CPD) for an enhanced robustness for the computation of CPD, and ICA-CPD could be further converted into CPD of a 5th-order…

Machine Learning · Statistics 2016-12-30 Xiao-Feng Gong , Cheng-Yuan Wang , Ya-Na Hao , Qiu-Hua Lin

We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We focus on the case where the mixing is close to a local…

Machine Learning · Statistics 2025-03-20 Simon Buchholz , Bernhard Schölkopf

Many single-target regression problems require estimates of uncertainty along with the point predictions. Probabilistic regression algorithms are well-suited for these tasks. However, the options are much more limited when the prediction…

Machine Learning · Statistics 2021-06-08 Michael O'Malley , Adam M. Sykulski , Rick Lumpkin , Alejandro Schuler

In nonadaptive group testing, the main research objective is to design an efficient algorithm to identify a set of up to $t$ positive elements among $n$ samples with as few tests as possible. Disjunct matrices and separable matrices are two…

Combinatorics · Mathematics 2021-10-15 Bingchen Qian , Xin Wang , Gennian Ge

ProBoost, a new boosting algorithm for probabilistic classifiers, is proposed in this work. This algorithm uses the epistemic uncertainty of each training sample to determine the most challenging/uncertain ones; the relevance of these…

We consider the task of enforcing individual fairness in gradient boosting. Gradient boosting is a popular method for machine learning from tabular data, which arise often in applications where algorithmic fairness is a concern. At a high…

Machine Learning · Computer Science 2021-04-01 Alexander Vargo , Fan Zhang , Mikhail Yurochkin , Yuekai Sun