English
Related papers

Related papers: Sparse Identification of Posynomial Models

200 papers

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

When uncertainty meets costly information gathering, a fundamental question emerges: which data points should we probe to unlock near-optimal solutions? Sparsification of stochastic packing problems addresses this trade-off. The existing…

Data Structures and Algorithms · Computer Science 2025-12-02 Shaddin Dughmi , Yusuf Hakan Kalayci , Xinyu Liu

In this paper we propose a second--order method for solving \emph{linear composite sparse optimization problems} consisting of minimizing the sum of a differentiable (possibly nonconvex function) and a nondifferentiable convex term. The…

Optimization and Control · Mathematics 2021-02-15 Pedro Merino , Juan Carlos De Los Reyes

In this work we present a data-driven method for the discovery of parametric partial differential equations (PDEs), thus allowing one to disambiguate between the underlying evolution equations and their parametric dependencies. Group…

Numerical Analysis · Mathematics 2018-06-05 Samuel Rudy , Alessandro Alla , Steven L. Brunton , J. Nathan Kutz

A great variety of fundamental optimization and counting problems arising in computer science, mathematics and physics can be reduced to one of the following computational tasks involving polynomials and set systems: given an $m$-variate…

Data Structures and Algorithms · Computer Science 2016-11-15 Damian Straszak , Nisheeth K. Vishnoi

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

Information Theory · Computer Science 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

Airfoil shape optimization plays a critical role in the design of high-performance aircraft. However, the high-dimensional nature of airfoil representation causes the challenging problem known as the "curse of dimensionality". To overcome…

Machine Learning · Computer Science 2023-11-21 Yu-Eop Kang , Dawoon Lee , Kwanjung Yee

We consider stopping criteria that balance algebraic and discretization errors for the conjugate gradient algorithm applied to high-order finite element discretizations of Poisson problems. Firstly, we introduce a new stopping criterion…

Numerical Analysis · Mathematics 2024-08-06 Yichen Guo , Eric de Sturler , Tim Warburton

Solving and optimising Partial Differential Equations (PDEs) in geometrically parameterised domains often requires iterative methods, leading to high computational and time complexities. One potential solution is to learn a direct mapping…

Numerical Analysis · Mathematics 2025-06-12 Guglielmo Padula , Gianluigi Rozza

Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model…

Machine Learning · Computer Science 2021-05-05 Gert-Jan Both , Gijs Vermarien , Remy Kusters

A constructive proof of identification of multilinear decompositions of multiway arrays is presented. It can be applied to show identification in a variety of multivariate latent structures. Examples are finite-mixture models and hidden…

Statistics Theory · Mathematics 2016-08-06 Stéphane Bonhomme , Koen Jochmans , Jean-Marc Robin

Linear regression without correspondences is the problem of performing a linear regression fit to a dataset for which the correspondences between the independent samples and the observations are unknown. Such a problem naturally arises in…

Machine Learning · Computer Science 2019-10-07 Manolis C. Tsakiris , Liangzu Peng , Aldo Conca , Laurent Kneip , Yuanming Shi , Hayoung Choi

We propose efficient computational methods to fit multivariate Gaussian additive models, where the mean vector and the covariance matrix are allowed to vary with covariates, in an empirical Bayes framework. To guarantee the…

Computation · Statistics 2025-04-07 Vincenzo Gioia , Matteo Fasiolo , Ruggero Bellio , Simon N. Wood

A general framework for solving image inverse problems is introduced in this paper. The approach is based on Gaussian mixture models, estimated via a computationally efficient MAP-EM algorithm. A dual mathematical interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2010-06-16 Guoshen Yu , Guillermo Sapiro , Stéphane Mallat

The varying coefficient model has received broad attention from researchers as it is a powerful dimension reduction tool for non-parametric modeling. Most existing varying coefficient models fitted with polynomial spline assume equidistant…

Methodology · Statistics 2022-06-15 Xufei Wang , Bo Jiang , Jun S. Liu

We propose a new method for model selection and model fitting in multivariate nonparametric regression models, in the framework of smoothing spline ANOVA. The ``COSSO'' is a method of regularization with the penalty functional being the sum…

Statistics Theory · Mathematics 2007-06-13 Yi Lin , Hao Helen Zhang

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem…

Information Theory · Computer Science 2013-12-23 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

Estimating covariance parameters for multivariate spatial Gaussian random fields is computationally challenging, as the number of parameters grows rapidly with the number of variables, and likelihood evaluation requires operations of order…

Methodology · Statistics 2026-04-10 Francisco Cuevas-Pacheco , Gabriel Riffo , Xavier Emery

Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables.…

Optimization and Control · Mathematics 2013-06-04 Yifan Sun , Martin S. Andersen , Lieven Vandenberghe

Ising models describe the joint probability distribution of a vector of binary feature variables. Typically, not all the variables interact with each other and one is interested in learning the presumably sparse network structure of the…

Machine Learning · Computer Science 2019-07-09 Frank Nussbaum , Joachim Giesen