English
Related papers

Related papers: A New Two-dimensional Model-based Subspace Method …

200 papers

This paper studies the performative prediction problem where a learner aims to minimize the expected loss with a decision-dependent data distribution. Such setting is motivated when outcomes can be affected by the prediction model, e.g., in…

Optimization and Control · Mathematics 2024-05-24 Haitong Liu , Qiang Li , Hoi-To Wai

We present new methods for solving a broad class of bound-constrained nonsmooth composite minimization problems. These methods are specially designed for objectives that are some known mapping of outputs from a computationally expensive…

Optimization and Control · Mathematics 2023-09-11 Jeffrey Larson , Matt Menickelly

Optimizing high-dimensional and complex black-box functions is crucial in numerous scientific applications. While Bayesian optimization (BO) is a powerful method for sample-efficient optimization, it struggles with the curse of…

Machine Learning · Computer Science 2025-07-08 Taeyoung Yun , Kiyoung Om , Jaewoo Lee , Sujin Yun , Jinkyoo Park

Decentralized bilevel optimization has garnered significant attention due to its critical role in solving large-scale machine learning problems. However, existing methods often rely on prior knowledge of problem parameters-such as…

Optimization and Control · Mathematics 2025-10-29 Zhiwei Zhai , Wenjing Yan , Ying-Jun Angela Zhang

We re-introduce a derivative-free subspace optimization framework originating from Chapter 5 of the Ph.D. thesis [Z. Zhang, On Derivative-Free Optimization Methods, Ph.D. thesis, Chinese Academy of Sciences, Beijing, 2012] of the author…

Optimization and Control · Mathematics 2025-01-09 Zaikun Zhang

The work provides an integrated pipeline for the model order reduction of turbulent flows around parametrised geometries in aerodynamics. In particular, Free-Form Deformation is applied for geometry parametrisation, whereas two different…

Numerical Analysis · Mathematics 2018-03-15 F. Salmoiraghi , A. Scardigli , H. Telib , G. Rozza

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

Machine Learning · Computer Science 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

Multiresolution topology optimization (MTO) methods involve decoupling of the design and analysis discretizations, such that a high-resolution design can be obtained at relatively low analysis costs. Recent studies have shown that the MTO…

Computational Engineering, Finance, and Science · Computer Science 2018-11-27 Deepak K. Gupta , Fred van Keulen , Matthijs Langelaar

We propose Stereo Direct Sparse Odometry (Stereo DSO) as a novel method for highly accurate real-time visual odometry estimation of large-scale environments from stereo cameras. It jointly optimizes for all the model parameters within the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Rui Wang , Martin Schwörer , Daniel Cremers

In this work, we propose a heuristic based open source solver for finding global solution to constrained derivative-free optimization (DFO) problems. Our solver named Global optimization using Surrogates for Derivative-free Optimization…

Optimization and Control · Mathematics 2024-04-30 Gannavarapu Chandramouli , Vishnu Narayanan

Derivative-free Riemannian optimization (DFRO) aims to minimize an objective function using only function evaluations, under the constraint that the decision variables lie on a Riemannian manifold. The rapid increase in problem dimensions…

Optimization and Control · Mathematics 2026-01-14 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through…

Optimization and Control · Mathematics 2022-10-12 Lulu Zhang , Zhi-Qin John Xu , Yaoyu Zhang

A novel derivative-free algorithm, optimization by moving ridge functions (OMoRF), for unconstrained and bound-constrained optimization is presented. This algorithm couples trust region methodologies with output-based dimension reduction to…

Optimization and Control · Mathematics 2021-01-07 James C. Gross , Geoffrey T. Parks

In this paper, we propose an augmented subspace based adaptive proper orthogonal decomposition (POD) method for solving the time dependent partial differential equations. By augmenting the POD subspace with some auxiliary modes, we obtain…

Numerical Analysis · Mathematics 2023-04-19 Xiaoying Dai , Miao Hu , Jack Xin , Aihui Zhou

A novel data-driven stochastic robust optimization (DDSRO) framework is proposed for optimization under uncertainty leveraging labeled multi-class uncertainty data. Uncertainty data in large datasets are often collected from various…

Machine Learning · Computer Science 2019-04-04 Chao Ning , Fengqi You

This is an overview paper written in style of research proposal. In recent years we introduced a general framework for large-scale unconstrained optimization -- Sequential Subspace Optimization (SESOP) and demonstrated its usefulness for…

Numerical Analysis · Computer Science 2014-01-03 Michael Zibulevsky

In this paper, we illustrate a novel method for solving optimization problems when derivatives are not explicitly available. We show that combining implicit filtering (IF), an existing derivative free optimization (DFO) method, with a deep…

Optimization and Control · Mathematics 2021-05-20 Brian Irwin , Eldad Haber , Raviv Gal , Avi Ziv

Developing appropriate analytic-function-based constitutive models for new materials with nonlinear mechanical behavior is demanding. For such kinds of materials, it is more challenging to realize the integrated design from the collection…

Optimization and Control · Mathematics 2022-11-11 Yunhang Guo , Zongliang Du , Lubin Wang , Wen Meng , Tien Zhang , Ruiyi Su , Dongsheng Yang , Shan Tang , Xu Guo

This work proposes a new framework of model reduction for parametric complex systems. The framework employs a popular model reduction technique dynamic mode decomposition (DMD), which is capable of combining data-driven learning and physics…

Numerical Analysis · Mathematics 2022-04-21 Hannah Lu , Daniel M. Tartakovsky

Recently, building on the foundation of neural radiance field, various techniques have emerged to learn unsigned distance fields (UDF) to reconstruct 3D non-watertight models from multi-view images. Yet, a central challenge in UDF-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Junkai Deng , Fei Hou , Xuhui Chen , Wencheng Wang , Ying He