English
Related papers

Related papers: HOPS: High-order Polynomials with Self-supervised …

200 papers

High-fidelity simulations, such as computational fluid dynamics and finite element analysis, are essential for modeling complex engineering systems but are often prohibitively expensive for tasks including parametric studies, optimization,…

Machine Learning · Computer Science 2026-05-07 Melika Baghi , Xiao Liu , Kamran Paynabar

In theory, hierarchies of semidefinite programming (SDP) relaxations based on sum of squares (SOS) polynomials have been shown to provide arbitrarily close approximations for a general polynomial optimization problem (POP). However, due to…

Optimization and Control · Mathematics 2018-12-31 Xiaolong Kuang , Bissan Ghaddar , Joe Naoum-Sawaya , Luis F. Zuluaga

Model reduction plays a critical role in system control, with established methods such as balanced truncation widely used for linear systems. However, extending these methods to nonlinear settings, particularly polynomial dynamical systems…

Dynamical Systems · Mathematics 2025-06-25 Xin Mao , Can Chen

In applications involving ordinal predictors, common approaches to reduce dimensionality are either extensions of unsupervised techniques such as principal component analysis, or variable selection procedures that rely on modeling the…

Statistics Theory · Mathematics 2017-10-13 Liliana Forzani , Rodrigo García Arancibia , Pamela Llop , Diego Tomassi

Large models and enormous data are essential driving forces of the unprecedented successes achieved by modern algorithms, especially in scientific computing and machine learning. Nevertheless, the growing dimensionality and model…

Machine Learning · Computer Science 2023-10-04 Yijun Dong

In this paper, we study first-order methods on a large variety of low-rank matrix optimization problems, whose solutions only live in a low dimensional eigenspace. Traditional first-order methods depend on the eigenvalue decomposition at…

Optimization and Control · Mathematics 2019-04-25 Yongfeng Li , Haoyang Liu , Zaiwen Wen , Yaxiang Yuan

In this paper, we propose a novel model for high-dimensional data, called the Hybrid Orthogonal Projection and Estimation (HOPE) model, which combines a linear orthogonal projection and a finite mixture model under a unified generative…

Machine Learning · Computer Science 2016-04-26 Shiliang Zhang , Hui Jiang

Proper Orthogonal Decomposition (POD) is a widely used technique for the construction of low-dimensional approximation spaces from high-dimensional input data. For large-scale applications and an increasing amount of input data vectors,…

Numerical Analysis · Mathematics 2021-06-09 Christian Himpe , Tobias Leibner , Stephan Rave

This paper presents a pseudo-spectral method for Dynamic Optimization Problems (DOPs) that allows for tight polynomial bounds to be achieved via flexible sub-intervals. The proposed method not only rigorously enforces inequality…

Optimization and Control · Mathematics 2026-04-08 Eduardo M. G. Vila , Eric C. Kerrigan , Paul Bruce

The Moment/Sum-of-squares hierarchy provides a way to compute the global minimizers of polynomial optimization problems (POP), at the cost of solving a sequence of increasingly large semidefinite programs (SDPs). We consider large-scale…

Optimization and Control · Mathematics 2023-09-13 Johannes Aspman , Gilles Bareilles , Vyacheslav Kungurtsev , Jakub Marecek , Martin Takáč

This paper proposes a novel higher-order multi-scale (HOMS) computational method, which is highly targeted for efficient, high-accuracy and low-computational-cost simulation of hygro-thermo-mechanical (H-T-M) coupling problems in…

Numerical Analysis · Mathematics 2025-12-11 Hao Dong , Yifei Ding , Jiale Linghu , Yufeng Nie , Yaochuang Han

Standard gradient descent methods are susceptible to a range of issues that can impede training, such as high correlations and different scaling in parameter space.These difficulties can be addressed by second-order approaches that apply a…

Machine Learning · Computer Science 2020-04-29 Ted Moskovitz , Rui Wang , Janice Lan , Sanyam Kapoor , Thomas Miconi , Jason Yosinski , Aditya Rawal

In this work, a new hybrid predictive Reduced Order Model (ROM) is proposed to solve reacting flow problems. This algorithm is based on a dimensionality reduction using Proper Orthogonal Decomposition (POD) combined with deep learning…

Machine Learning · Computer Science 2023-01-25 Adrián Corrochano , Rodolfo S. M. Freitas , Alessandro Parente , Soledad Le Clainche

In recent years, the use of sparse recovery techniques in the approximation of high-dimensional functions has garnered increasing interest. In this work we present a survey of recent progress in this emerging topic. Our main focus is on the…

Numerical Analysis · Mathematics 2017-06-12 Ben Adcock , Simone Brugiapaglia , Clayton G. Webster

Projection-based reduced-order models (PROMs) have demonstrated accuracy, reliability, and robustness in approximating high-dimensional, differential equation-based computational models across many applications. For this reason, it has been…

Numerical Analysis · Mathematics 2025-05-05 Calista Biondic , Siva Nadarajah

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

This paper presents the design and analysis of a Hybrid High-Order (HHO) approximation for a distributed optimal control problem governed by the Poisson equation. We propose three distinct schemes to address unconstrained control problems…

Numerical Analysis · Mathematics 2025-01-14 Gouranga Mallik , Ramesh Chandra Sau

Global polynomial optimization is an important tool across applied mathematics, with many applications in operations research, engineering, and physical sciences. In various settings, the polynomials depend on external parameters that may…

Optimization and Control · Mathematics 2024-06-14 Richard L. Zhu , Mathias Oster , Yuehaw Khoo

Projection-based model order reduction on nonlinear manifolds has been recently proposed for problems with slowly decaying Kolmogorov n-width such as advection-dominated ones. These methods often use neural networks for manifold learning…

Computational Physics · Physics 2023-03-20 Jorio Cocola , John Tencer , Francesco Rizzi , Eric Parish , Patrick Blonigan

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar