English
Related papers

Related papers: Factor Analysis and Alternating Minimization

200 papers

To study discrimination in automated decision-making systems, scholars have proposed several definitions of fairness, each expressing a different fair ideal. These definitions require practitioners to make complex decisions regarding which…

Computers and Society · Computer Science 2021-02-23 Kweku Kwegyir-Aggrey , Rebecca Santorella , Sarah M. Brown

Calibration, the practice of choosing the parameters of a structural model to match certain empirical moments, can be viewed as minimum distance estimation. Existing standard error formulas for such estimators require a consistent estimate…

Econometrics · Economics 2024-06-19 Matthew D. Cocci , Mikkel Plagborg-Møller

In this paper, we address the challenging problem of learning from imbalanced data using a Nearest-Neighbor (NN) algorithm. In this setting, the minority examples typically belong to the class of interest requiring the optimization of…

Machine Learning · Computer Science 2020-01-23 Rémi Viola , Rémi Emonet , Amaury Habrard , Guillaume Metzler , Sébastien Riou , Marc Sebban

Regression models are essential for a wide range of real-world applications. However, in practice, target values are not always precisely known; instead, they may be represented as intervals of acceptable values. This challenge has led to…

Machine Learning · Computer Science 2025-12-08 Tung L Nguyen , Toby Dylan Hocking

We investigate the problem of jointly testing a pair of composite hypotheses and, depending on the test result, estimating a random parameter under distributional uncertainties. Specifically, it is assumed that the distribution of the data…

Signal Processing · Electrical Eng. & Systems 2026-04-27 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

We consider the problem of reconstructing a low rank matrix from a subset of its entries and analyze two variants of the so-called Alternating Minimization algorithm, which has been proposed in the past. We establish that when the…

Machine Learning · Statistics 2016-09-21 David Gamarnik , Sidhant Misra

Factor analysis is over a century old, but it is still problematic to choose the number of factors for a given data set. The scree test is popular but subjective. The best performing objective methods are recommended on the basis of…

Methodology · Statistics 2015-11-12 A. B. Owen , J. Wang

Factorization of matrices where the rank of the two factors diverges linearly with their sizes has many applications in diverse areas such as unsupervised representation learning, dictionary learning or sparse coding. We consider a setting…

Disordered Systems and Neural Networks · Physics 2022-08-11 Antoine Maillard , Florent Krzakala , Marc Mézard , Lenka Zdeborová

This paper introduces a machine for sampling approximate model-X knockoffs for arbitrary and unspecified data distributions using deep generative models. The main idea is to iteratively refine a knockoff sampling mechanism until a criterion…

Methodology · Statistics 2020-03-03 Yaniv Romano , Matteo Sesia , Emmanuel J. Candès

This paper develops a new global optimisation method that applies to a family of criteria that are not entirely known. This family includes the criteria obtained from the class of posteriors that have nor-malising constants that are…

Statistics Theory · Mathematics 2019-07-16 R. Stoica , Madalina Deaconu , Anne Philippe , Lluis Hurtado

This paper proposes a novel method for determining the number of factors in linear factor models under stability considerations. An instability measure is proposed based on the principal angle between the estimated loading spaces obtained…

Methodology · Statistics 2024-09-13 Sze Ming Lee , Yunxiao Chen

Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering…

Information Retrieval · Computer Science 2021-10-28 Steffen Rendle , Walid Krichene , Li Zhang , Yehuda Koren

Exact monitoring in dynamic Bayesian networks is intractable, so approximate algorithms are necessary. This paper presents a new family of approximate monitoring algorithms that combine the best qualities of the particle filtering and…

Artificial Intelligence · Computer Science 2013-01-07 Brenda Ng , Leonid Peshkin , Avi Pfeffer

Factor analysis provides linear factors that describe relationships between individual variables of a data set. We extend this classical formulation into linear factors that describe relationships between groups of variables, where each…

Machine Learning · Statistics 2014-12-03 Arto Klami , Seppo Virtanen , Eemeli Leppäaho , Samuel Kaski

We give a general unified method that can be used for $L_1$ {\em closeness testing} of a wide range of univariate structured distribution families. More specifically, we design a sample optimal and computationally efficient algorithm for…

Data Structures and Algorithms · Computer Science 2015-08-25 Ilias Diakonikolas , Daniel M. Kane , Vladimir Nikishkin

We propose a new simulation-based estimation method, adversarial estimation, for structural models. The estimator is formulated as the solution to a minimax problem between a generator (which generates simulated observations using the…

Econometrics · Economics 2024-01-09 Tetsuya Kaji , Elena Manresa , Guillaume Pouliot

In agent control issues, the idea of combining reinforcement learning and planning has attracted much attention. Two methods focus on micro and macro action respectively. Their advantages would show together if there is a good cooperation…

Artificial Intelligence · Computer Science 2020-03-20 Xuerun Chen

This paper describes algorithms for nonnegative matrix factorization (NMF) with the beta-divergence (beta-NMF). The beta-divergence is a family of cost functions parametrized by a single shape parameter beta that takes the Euclidean…

Machine Learning · Computer Science 2011-03-09 Cédric Févotte , Jérôme Idier

Optimal transportation distances are valuable for comparing and analyzing probability distributions, but larger-scale computational techniques for the theoretically favorable quadratic case are limited to smooth domains or regularized…

Other Computer Science · Computer Science 2016-03-23 Justin Solomon , Raif Rustamov , Leonidas Guibas , Adrian Butscher

We resolve a long-standing open question, about the existence of a constant-factor approximation algorithm for the average-case \textsc{Decision Tree} problem with uniform probability distribution over the hypotheses. We answer the question…

Data Structures and Algorithms · Computer Science 2026-04-29 Michał Szyfelbein