English
Related papers

Related papers: On the Approximation Theory of Linear Variational …

200 papers

Linear projection schemes like Proper Orthogonal Decomposition can efficiently reduce the dimensions of dynamical systems but are naturally limited, e.g., for convection-dominated problems. Nonlinear approaches have shown to outperform…

Dynamical Systems · Mathematics 2022-10-03 Peter Benner , Pawan Goyal , Jan Heiland , Igor Pontes

Design optimisation potentially leads to lightweight aircraft structures with lower environmental impact. Due to the high number of design variables and constraints, these problems are ordinarily solved using gradient-based optimisation…

Computational Engineering, Finance, and Science · Computer Science 2024-01-23 Hauke Maathuis , Roeland De Breuker , Saullo G. P. Castro

In traditional topology optimization, the computing time required to iteratively update the material distribution within a design domain strongly depends on the complexity or size of the problem, limiting its application in real engineering…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Gabriel Garayalde , Matteo Torzoni , Matteo Bruggi , Alberto Corigliano

Overparameterized models have proven to be powerful tools for solving various machine learning tasks. However, overparameterization often leads to a substantial increase in computational and memory costs, which in turn requires extensive…

Machine Learning · Computer Science 2024-03-13 Soo Min Kwon , Zekai Zhang , Dogyoon Song , Laura Balzano , Qing Qu

In real case applications within the virtual prototyping process, it is not always possible to reduce the complexity of the physical models and to obtain numerical models which can be solved quickly. Usually, every single numerical…

Machine Learning · Computer Science 2024-08-29 Thomas Most , Johannes Will

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

We present a computational framework for efficient optimization-based "inverse design" of large-area "metasurfaces" (subwavelength-patterned surfaces) for applications such as multi-wavelength and multi-angle optimizations, and…

3D representations of highly deformable 3D models, such as dynamic 3D meshes, have recently become very popular due to their wide applicability in various domains. This trend inevitably leads to a demand for storage and transmission of…

Signal Processing · Electrical Eng. & Systems 2021-11-22 Gerasimos Arvanitis , Aris S. Lalos , Konstantinos Moustakas

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is…

Numerical Analysis · Mathematics 2018-03-06 Michael Griebel , Peter Oswald

Model-based derivative-free optimization (DFO) methods are an important class of DFO methods that are known to struggle with solving high-dimensional optimization problems. Recent research has shown that incorporating random subspaces into…

Optimization and Control · Mathematics 2026-05-14 Yiwen Chen , Warren Hare , Amy Wiebe

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

We consider model-based derivative-free optimization (DFO) for large-scale problems, based on iterative minimization in random subspaces. We provide the first worst-case complexity bound for such methods for convergence to approximate…

Optimization and Control · Mathematics 2024-12-20 Coralia Cartis , Lindon Roberts

Variational mean field approximations tend to struggle with contemporary overparametrized deep neural networks. Where a Bayesian treatment is usually associated with high-quality predictions and uncertainties, the practical reality has been…

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

There is increasing demand for automated systems that can fabricate 3D structures. Robotic spatial extrusion has become an attractive alternative to traditional layer-based 3D printing due to a manipulator's flexibility to print large,…

Robotics · Computer Science 2020-02-07 Caelan Reed Garrett , Yijiang Huang , Tomás Lozano-Pérez , Caitlin Tobin Mueller

Classical multidimensional scaling only works well when the noisy distances observed in a high dimensional space can be faithfully represented by Euclidean distances in a low dimensional space. Advanced models such as Maximum Variance…

Machine Learning · Statistics 2014-06-24 Chao Ding , Hou-Duo Qi

Scientists and engineers rely on accurate mathematical models to quantify the objects of their studies, which are often high-dimensional. Unfortunately, high-dimensional models are inherently difficult, i.e. when observations are sparse or…

Machine Learning · Computer Science 2018-02-13 Robert A. Bridges , Chris Felder , Chelsey Hoff

Many real-world problems can be formulated as the alignment between two geometric patterns. Previously, a great amount of research focus on the alignment of 2D or 3D patterns in the field of computer vision. Recently, the alignment problem…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Hu Ding , Wenjie Liu , Mingquan Ye

We study some methods of subgradient projections for solving a convex feasibility problem with general (not necessarily hyperplanes or half-spaces) convex sets in the inconsistent case and propose a strategy that controls the relaxation…

Optimization and Control · Mathematics 2010-09-21 Dan Butnariu , Yair Censor , Pini Gurfil , Ethan Hadar