English
Related papers

Related papers: Polling Set Construction and Worst-Case Complexity…

200 papers

In derivative-free optimization, the cosine measure is a value that often arises in the convergence analysis of direct search methods. Given the increasing interest in high-dimensional derivative-free optimization problems, it is valuable…

Optimization and Control · Mathematics 2025-06-25 Warren Hare , Scholar Sun

Estimating camera pose from a single image is a fundamental problem in computer vision. Existing methods for solving this task fall into two distinct categories, which we refer to as direct and indirect. Direct methods, such as PoseNet,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Hunter Blanton , Scott Workman , Nathan Jacobs

Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the algorithms and analyses is the possibility of extending the…

Machine Learning · Computer Science 2016-02-24 Francis Bach

This paper introduces a first-order method for solving optimal powered descent guidance (PDG) problems, that directly handles the nonconvex constraints associated with the maximum and minimum thrust bounds with varying mass and the pointing…

Optimization and Control · Mathematics 2024-04-02 Jiwoo Choi , Jong-Han Kim

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of first-order methods.…

Machine Learning · Computer Science 2020-04-28 Ozan Sener , Vladlen Koltun

The problem of steering a particular class of $n$-dimensional continuous-time dynamical systems towards the minima of a function without gradient information is considered. We propose an hybrid controller, implementing a discrete-time…

Systems and Control · Electrical Eng. & Systems 2019-12-05 Alessandro Melis , Ricardo G. Sanfelice , Lorenzo Marconi

This paper explores a method for solving constrained optimization problems when the derivatives of the objective function are unavailable, while the derivatives of the constraints are known. We allow the objective and constraint function to…

Optimization and Control · Mathematics 2024-02-20 Melody Qiming Xuan , Jorge Nocedal

Polynomial optimization encompasses a broad class of problems in which both the objective function and constraints are polynomial functions of the decision variables. In recent years, a substantial body of research has focused on…

Optimization and Control · Mathematics 2026-01-05 Haibin Chen , Hong Yan , Guanglu Zhou

In this paper, we consider derivative free optimization problems, where the objective function is smooth but is computed with some amount of noise, the function evaluations are expensive and no derivative information is available. We are…

Optimization and Control · Mathematics 2019-06-05 Albert S Berahas , Liyuan Cao , Krzysztof Choromanski , Katya Scheinberg

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…

Machine Learning · Computer Science 2019-02-01 Jarrid Rector-Brooks , Jun-Kun Wang , Barzan Mozafari

In this work, we introduce new direct search schemes for the solution of bilevel optimization (BO) problems. Our methods rely on a fixed accuracy black box oracle for the lower-level problem, and deal both with smooth and potentially…

Optimization and Control · Mathematics 2023-09-14 Youssef Diouane , Vyacheslav Kungurtsev , Francesco Rinaldi , Damiano Zeffiro

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed graph structure, and…

Machine Learning · Computer Science 2013-09-27 Kiyohito Nagano , Yoshinobu Kawahara

This paper addresses smooth convexly constrained optimization problems where the Euclidean projection onto the feasible set is computationally tractable. Although momentum techniques like Polyak's heavy-ball are known for accelerating…

Optimization and Control · Mathematics 2026-03-20 Federica Donnini , Pierluigi Mansueto

Linear optimization is many times algorithmically simpler than non-linear convex optimization. Linear optimization over matroid polytopes, matching polytopes and path polytopes are example of problems for which we have simple and efficient…

Machine Learning · Computer Science 2015-08-17 Dan Garber , Elad Hazan

This work presents the convergence rate analysis of stochastic variants of the broad class of direct-search methods of directional type. It introduces an algorithm designed to optimize differentiable objective functions $f$ whose values can…

Optimization and Control · Mathematics 2020-03-09 Kwassi Joseph Dzahini

Graphs of Convex Sets (GCS) is a recent method for synthesizing smooth trajectories by decomposing the planning space into convex sets, forming a graph to encode the adjacency relationships within the decomposition, and then simultaneously…

Robotics · Computer Science 2024-10-14 Ramkumar Natarajan , Chaoqi Liu , Howie Choset , Maxim Likhachev

High-throughput computational materials searches generate large databases of locally-stable structures. Conventionally, the needle-in-a-haystack search for the few experimentally-synthesizable compounds is performed using a convex hull…

Materials Science · Physics 2018-10-24 Andrea Anelli , Edgar A. Engel , Chris J. Pickard , Michele Ceriotti

"To Appear in Theory and Practice of Logic Programming (TPLP)" This paper presents a technique for the optimization of bound queries over disjunctive deductive databases with constraints. The proposed approach is an extension of the…

Logic in Computer Science · Computer Science 2007-05-23 G. Greco , S. Greco , I. Trubtsyna , E. Zumpano

We study the polyhedral structure of the static probabilistic lot-sizing problem and propose valid inequalities that integrate information from the chance constraint and the binary setup variables. We prove that the proposed inequalities…

Optimization and Control · Mathematics 2020-06-02 Xiao Liu , Simge Kucukyavuz

In many contemporary optimization problems such as those arising in machine learning, it can be computationally challenging or even infeasible to evaluate an entire function or its derivatives. This motivates the use of stochastic…

Optimization and Control · Mathematics 2021-07-01 El-houcine Bergou , Youssef Diouane , Vladimir Kunc , Vyacheslav Kungurtsev , Clément W. Royer