English
Related papers

Related papers: Approximation of Nonnegative Systems by Finite Imp…

200 papers

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied. In particular, we modify the Linear Programming…

Machine Learning · Statistics 2014-01-10 Jason Gejie Liu , Shuchin Aeron

We consider the reduction of parametric families of linear dynamical systems having an affine parameter dependence that differ from one another by a low-rank variation in the state matrix. Usual approaches for parametric model reduction…

Numerical Analysis · Mathematics 2019-12-25 Christopher Beattie , Serkan Gugercin , Zoran Tomljanovic

We propose a general proximal algorithm for the inversion of ill-conditioned matrices. This algorithm is based on a variational characterization of pseudo-inverses. We show that a particular instance of it (with constant regularization…

Numerical Analysis · Mathematics 2009-04-07 Pierre Maréchal , Aude Rondepierre

We propose an optimization formulation for the simultaneous estimation of a latent variable and the identification of a linear continuous-time dynamic system, given a single input-output pair. We justify this approach based on Bayesian…

Optimization and Control · Mathematics 2023-06-29 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan , S. Joe Qin

Submodular maximization is one of the central topics in combinatorial optimization. It has found numerous applications in the real world. In the past decades, a series of algorithms have been proposed for this problem. However, most of the…

Data Structures and Algorithms · Computer Science 2023-04-03 Xiaoming Sun , Jialin Zhang , Shuo Zhang , Zhijie Zhang

The motivation for this paper stems from the desire to develop an adaptive sampling method for solving constrained optimization problems in which the objective function is stochastic and the constraints are deterministic. The method…

Optimization and Control · Mathematics 2021-01-01 Yuchen Xie , Raghu Bollapragada , Richard Byrd , Jorge Nocedal

We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish…

Optimization and Control · Mathematics 2024-06-04 Jochen Schmid , Philipp Seufert , Michael Bortz

We study the decomposition of a nonnegative tensor into a minimal sum of outer product of nonnegative vectors and the associated parsimonious naive Bayes probabilistic model. We show that the corresponding approximation problem, which is…

Numerical Analysis · Computer Science 2009-04-12 Lek-Heng Lim , Pierre Comon

Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

A decision rule is epsilon-minimax if it is minimax up to an additive factor epsilon. We present an algorithm for provably obtaining epsilon-minimax solutions for a class of statistical decision problems. In particular, we are interested in…

We consider the model reduction problem for linear time-invariant dynamical systems having nonzero (but otherwise indeterminate) initial conditions. Building upon the observation that the full system response is decomposable as a…

Systems and Control · Computer Science 2017-01-04 Christopher A. Beattie , Serkan Gugercin , Volker Mehrmann

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

In this paper, we study an algorithm for solving a class of nonconvex and nonsmooth nonseparable optimization problems. Based on proximal alternating linearized minimization (PALM), we propose a new iterative algorithm which combines…

Optimization and Control · Mathematics 2023-06-14 Chenzheng Guo , Jing Zhao

In this paper, we study output feedback selection in linear time-invariant structured systems. We assume that the inputs and the outputs are dedicated, i.e., each input directly actuates a single state and each output directly senses a…

Optimization and Control · Mathematics 2019-04-01 Aishwary Joshi , Shana Moothedath , Prasanna Chaporkar

The problem of recovering a low-rank matrix from the linear constraints, known as affine matrix rank minimization problem, has been attracting extensive attention in recent years. In general, affine matrix rank minimization problem is a…

Optimization and Control · Mathematics 2020-01-31 Angang Cui , Jigen Peng , Haiyang Li

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

Recovering a low-rank signal matrix from its noisy observation, commonly known as matrix denoising, is a fundamental inverse problem in statistical signal processing. Matrix denoising methods are generally based on shrinkage or thresholding…

Methodology · Statistics 2017-01-23 Santosh Kumar Yadav , Rohit Sinha , Prabin Kumar Bora

The Nonnegative Matrix Factorization (NMF) of the rating matrix has shown to be an effective method to tackle the recommendation problem. In this paper we propose new methods based on the NMF of the rating matrix and we compare them with…

Machine Learning · Computer Science 2019-08-30 Gianna M. Del Corso , Francesco Romani