English
Related papers

Related papers: A Structured Tour of Optimization with Finite Diff…

200 papers

Prescribed-time convergence mechanism has become a prominent research focus in the current field of optimization and control due to its ability to precisely control the target completion time. The recently arisen prescribed-time algorithms…

Optimization and Control · Mathematics 2023-10-31 Shuaiyu Zhou , Yiheng Wei , Jinde Cao , Yang Liu

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

In this paper, we explore the two-point zeroth-order gradient estimator and identify the distribution of random perturbations that minimizes the estimator's asymptotic variance as the perturbation stepsize tends to zero. We formulate it as…

Machine Learning · Computer Science 2025-10-24 Shaocong Ma , Heng Huang

We develop a system-theoretic framework for the structured analysis of distributed optimization algorithms with decomposable cost functions. We model such algorithms as a network of interacting dynamical systems and derive tests for…

Optimization and Control · Mathematics 2026-04-14 Aron Karakai , Jaap Eising , Andrea Martinelli , Florian Dörfler

A structured version of derivative-free random pattern search optimization algorithms is introduced which is able to exploit coordinate partially separable structure (typically associated with sparsity) often present in unconstrained and…

Optimization and Control · Mathematics 2021-01-13 Margherita Porcelli , Philippe L. Toint

We examine a class of embeddings based on structured random matrices with orthogonal rows which can be applied in many machine learning applications including dimensionality reduction and kernel approximation. For both the…

Machine Learning · Statistics 2018-09-05 Krzysztof Choromanski , Mark Rowland , Adrian Weller

Decentralized optimization to minimize a finite sum of functions over a network of nodes has been a significant focus within control and signal processing research due to its natural relevance to optimal control and signal estimation…

Machine Learning · Computer Science 2020-09-15 Ran Xin , Shi Pu , Angelia Nedić , Usman A. Khan

The robust truss topology optimization against the uncertain static external load can be formulated as mixed-integer semidefinite programming. Although a global optimal solution can be computed with a branch-and-bound method, it is very…

Optimization and Control · Mathematics 2019-01-25 Yoshihiro Kanno

A new pattern search method for bound constrained optimization is introduced. The proposed algorithm employs the coordinate directions, in a suitable way, with a nonmonotone line search for accepting the new iterate, without using…

Optimization and Control · Mathematics 2018-06-25 Johanna A. Frau , Elvio A. Pilotta

Fast, gradient-based structural optimization has long been limited to a highly restricted subset of problems -- namely, density-based compliance minimization -- for which gradients can be analytically derived. For other objective functions,…

Computational Engineering, Finance, and Science · Computer Science 2024-09-17 Keith J. Lee , Yijiang Huang , Caitlin T. Mueller

Optimal Transport has recently gained interest in machine learning for applications ranging from domain adaptation, sentence similarities to deep learning. Yet, its ability to capture frequently occurring structure beyond the "ground…

Machine Learning · Statistics 2017-12-19 David Alvarez-Melis , Tommi S. Jaakkola , Stefanie Jegelka

Practical global path planning is critical for commercializing cleaning robots working in semi-structured environments. In the literature, global path planning methods for free space usually focus on path length and neglect the traffic rule…

Robotics · Computer Science 2025-11-18 Yong Li , Hui Cheng

It is known that the gradient method can be viewed as a dynamic system where various iterative schemes can be designed as a part of the closed loop system with desirable properties. In this paper, the finite-time and fixed-time convergence…

Optimization and Control · Mathematics 2021-10-01 Yuquan Chen , Yiheng Wei , YangQuan Chen

This paper presents a computational framework for the robust stiffness design of hyperelastic structures at finite deformations subject to various uncertain sources. In particular, the loading, material properties, and geometry…

Computational Engineering, Finance, and Science · Computer Science 2025-01-28 Nan Feng , Guodong Zhang , Kapil Khandelwal

The optimal control of a mechanical system is of crucial importance in many realms. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion…

Optimization and Control · Mathematics 2008-10-09 S. Ober-Bloebaum , O. Junge , J. E. Marsden

In many clinical trials, individuals in different subgroups have experience differential treatment effects. This leads to individualized differences in treatment benefit. In this article, we introduce the general concept of predictive…

Methodology · Statistics 2018-07-11 Debashis Ghosh , Youngjoo Cho

Recent works have developed new projection-free first-order methods based on utilizing linesearches and normal vector computations to maintain feasibility. These oracles can be cheaper than orthogonal projection or linear optimization…

Optimization and Control · Mathematics 2024-05-01 Thabo Samakhoana , Benjamin Grimmer

A gradient-based method for shape optimization problems constrained by the acoustic wave equation is presented. The method makes use of high-order accurate finite differences with summation-by-parts properties on multiblock curvilinear…

Numerical Analysis · Mathematics 2024-05-09 Gustav Eriksson , Vidar Stiernström

We propose a fresh take on understanding the mechanisms of neural networks by analyzing the rich directional structure of optimization trajectories, represented by their pointwise parameters. Towards this end, we introduce some natural…

Machine Learning · Computer Science 2024-06-25 Sidak Pal Singh , Bobby He , Thomas Hofmann , Bernhard Schölkopf

This work combines the consistency in lower-order differential operators with external approximations of functional spaces to obtain error estimates for finite difference finite volume schemes on unstructured non-uniform meshes. This…

Numerical Analysis · Mathematics 2016-12-02 Qingshan Chen
‹ Prev 1 3 4 5 6 7 10 Next ›