English
Related papers

Related papers: A globally convergent method to accelerate large-s…

200 papers

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

Although widely adopted, existing approaches for fine-tuning pre-trained language models have been shown to be unstable across hyper-parameter settings, motivating recent work on trust region methods. In this paper, we present a simplified…

Machine Learning · Computer Science 2020-08-10 Armen Aghajanyan , Akshat Shrivastava , Anchit Gupta , Naman Goyal , Luke Zettlemoyer , Sonal Gupta

A new model order reduction approach is proposed for parametric steady-state nonlinear fluid flows characterized by shocks and discontinuities whose spatial locations and orientations are strongly parameter dependent. In this method,…

Fluid Dynamics · Physics 2019-01-04 Nirmal J. Nair , Maciej Balajewicz

This paper describes a data-driven framework for approximate global optimization in which precomputed solutions to a sample of problems are retrieved and adapted during online use to solve novel problems. This approach has promise for…

Robotics · Computer Science 2016-05-17 Kris Hauser

Edge-preserving smoothing (EPS) can be formulated as minimizing an objective function that consists of data and prior terms. This global EPS approach shows better smoothing performance than a local one that typically has a form of weighted…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Youngjung Kim , Dongbo Min , Bumsub Ham , Kwanghoon Sohn

Approximating a function with a finite series, e.g., involving polynomials or trigonometric functions, is a critical tool in computing and data analysis. The construction of such approximations via now-standard approaches like least squares…

Optimization and Control · Mathematics 2021-08-30 Dihan Dai , Yekaterina Epshteyn , Akil Narayan

In this paper, we present a general numerical platform for designing accurate, efficient, and stable numerical algorithms for incompressible hydrodynamic models that obeys the thermodynamical laws. The obtained numerical schemes are…

Numerical Analysis · Mathematics 2021-03-04 Jia Zhao

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

Optimization and Control · Mathematics 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

Onboard learning is a transformative approach in edge AI, enabling real-time data processing, decision-making, and adaptive model training directly on resource-constrained devices without relying on centralized servers. This paradigm is…

Machine Learning · Computer Science 2026-01-22 Monirul Islam Pavel , Siyi Hu , Mahardhika Pratama , Ryszard Kowalczyk

For real-time multirotor kinodynamic motion planning, the efficiency of sampling-based methods is usually hindered by difficult-to-sample homotopy classes like narrow passages. In this paper, we address this issue by a hybrid scheme. We…

Robotics · Computer Science 2021-03-10 Hongkai Ye , Tianyu Liu , Chao Xu , Fei Gao

We present an accelerated greedy strategy for training of projection-based reduced-order models for parametric steady and unsteady partial differential equations. Our approach exploits hierarchical approximate proper orthogonal…

Numerical Analysis · Mathematics 2024-01-17 Eki Agouzal , Tommaso Taddei

This thesis presents recent advances in model order reduction methods with the primary aim to construct online-efficient reduced surrogate models for parameterized multiscale phenomena and accelerate large-scale PDE-constrained parameter…

Numerical Analysis · Mathematics 2022-11-18 Tim Keil

Reduced-order simulation is an emerging method for accelerating physical simulations with high DOFs, and recently developed neural-network-based methods with nonlinear subspaces have been proven effective in diverse applications as more…

Machine Learning · Computer Science 2024-09-09 Aoran Lyu , Shixian Zhao , Chuhua Xian , Zhihao Cen , Hongmin Cai , Guoxin Fang

This paper presents a piecewise convexification method for solving non-convex multi-objective optimization problems with box constraints. Based on the ideas of the $\alpha$-based Branch and Bound (${\rm \alpha BB}$) method of global…

Optimization and Control · Mathematics 2022-06-28 Q. Zhu , L. P. Tang , X. M. Yang

We examine the interaction of multigrid methods and shape optimization in appropriate shape spaces. Our aim is a scalable algorithm for application on supercomputers, which can only be achieved by mesh-independent convergence. The impact of…

Optimization and Control · Mathematics 2021-04-12 Martin Siebenborn , Kathrin Welker

This paper proposes novel algorithm for non-convex multimodal constrained optimisation problems. It is based on sequential solving restrictions of problem to sections of feasible set by random subspaces (in general, manifolds) of low…

Optimization and Control · Mathematics 2023-03-28 Dmitry A. Pasechnyuk , Alexander Gornov

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

In this work, we develop a novel technique for reconstructing images from projection-based nano- and microtomography. Our contribution focuses on enhancing reconstruction quality, particularly for specimen composed of homogeneous material…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Anuraag Mishra , Andrea Gilch , Benjamin Apeleo Zubiri , Jan Rolfes , Frauke Liers

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat
‹ Prev 1 4 5 6 7 8 10 Next ›