English
Related papers

Related papers: Efficient method for accelerating line searches us…

200 papers

The most popular method for computing the matrix logarithm is a combination of the inverse scaling and squaring method in conjunction with a Pad\'e approximation, sometimes accompanied by the Schur decomposition. The main computational…

Numerical Analysis · Mathematics 2024-01-19 Elias Jarlebring , Jorge Sastre , J. Javier Ibáñez González

The problem of best subset selection in linear regression is considered with the aim to find a fixed size subset of features that best fits the response. This is particularly challenging when the total available number of features is very…

Methodology · Statistics 2023-11-28 Sarat Moka , Benoit Liquet , Houying Zhu , Samuel Muller

We present an efficient subpixel refinement method usinga learning-based approach called Linear Predictors. Two key ideas are shown in this paper. Firstly, we present a novel technique, called Symbolic Linear Predictors, which makes the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Vincent Lui , Jonathon Geeves , Winston Yii , Tom Drummond

We study the problem of supervised linear dimensionality reduction, taking an information-theoretic viewpoint. The linear projection matrix is designed by maximizing the mutual information between the projected signal and the class label…

Machine Learning · Computer Science 2012-07-03 Minhua Chen , William Carson , Miguel Rodrigues , Robert Calderbank , Lawrence Carin

In this work, we propose an efficient method for solving box constrained derivative free optimization problems involving high dimensions. The proposed method relies on exploring the feasible region using a direct search approach based on…

Optimization and Control · Mathematics 2019-01-17 Gannavarapu Chandramouli , Vishnu Narayanan

Iteration methods based on barycentric rational interpolation are derived that exhibit accelerating orders of convergence. For univariate root search, the derivative-free methods approach quadratic convergence and the first-derivative…

Numerical Analysis · Mathematics 2020-11-11 Sebastian Cassel

We demonstrate that neural networks can be used to improve search strategies, over existing strategies, in LHC searches for light electroweak-charged scalars that decay to a muon and a heavy invisible fermion. We propose a new search…

High Energy Physics - Phenomenology · Physics 2025-01-23 Alan S. Cornell , Benjamin Fuks , Mark D. Goodsell , Anele M. Ncube

In this paper, we present a novel stochastic optimization method, which uses the binary search technique with first order gradient based optimization method, called Binary Search Gradient Optimization (BSG) or BiGrad. In this optimization…

Machine Learning · Computer Science 2020-07-28 Vijay Pandey

There has been much recent interest in finding unconstrained local minima of smooth functions, due in part of the prevalence of such problems in machine learning and robust statistics. A particular focus is algorithms with good complexity…

Optimization and Control · Mathematics 2017-12-12 Clément W. Royer , Stephen J. Wright

We propose a statistical adaptive procedure called SALSA for automatically scheduling the learning rate (step size) in stochastic gradient methods. SALSA first uses a smoothed stochastic line-search procedure to gradually increase the…

Machine Learning · Statistics 2020-02-26 Pengchuan Zhang , Hunter Lang , Qiang Liu , Lin Xiao

We present a new branch-and-bound type search method for mixed integer linear optimization problems based on the concept of offshoots (introduced in this paper). While similar to a classic branch-and-bound method, it allows for changing the…

Optimization and Control · Mathematics 2017-09-07 Philipp M. Christophel , Imre Pólik

We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates…

Optimization and Control · Mathematics 2024-04-18 Yunier Bello-Cruz , J. G. Melo , L. F. Prudente , R. V. G. Serra

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

We fix a fundamental issue in the stochastic extragradient method by providing a new sampling strategy that is motivated by approximating implicit updates. Since the existing stochastic extragradient algorithm, called Mirror-Prox, of…

Optimization and Control · Mathematics 2021-02-22 Konstantin Mishchenko , Dmitry Kovalev , Egor Shulgin , Peter Richtárik , Yura Malitsky

Telecommunication networks frequently face technological advancements and need to upgrade their infrastructure. Adapting legacy networks to the latest technology requires synchronized technicians responsible for migrating the equipment. The…

Optimization and Control · Mathematics 2023-05-11 Maryam Daryalal , Hamed Pouya

A new highly accurate algorithm for the solution of the Falkner-Skan equation of boundary layer theory is presented. The algorithm, based on a Maclaurin series representation, finds its coefficients from recurrence. In addition,…

Mathematical Physics · Physics 2010-06-22 B. D. Ganapol

We introduce a search problem generalizing the typical setting of Binary Search on the line. Similar to the setting for Binary Search, a target is chosen adversarially on the line, and in response to a query, the algorithm learns whether…

Data Structures and Algorithms · Computer Science 2023-03-14 Calvin Leng , David Kempe

In this paper, we extend a previously presented Grover-based heuristic to tackle general combinatorial optimization problems with linear constraints. We further describe the introduced method as a framework that enables performance…

Quantum Physics · Physics 2025-12-08 Sören Wilkening , Timo Ziegler , Maximilian Hess

We present in this paper first-order alternating linearization algorithms based on an alternating direction augmented Lagrangian approach for minimizing the sum of two convex functions. Our basic methods require at most $O(1/\epsilon)$…

Optimization and Control · Mathematics 2010-10-14 Donald Goldfarb , Shiqian Ma , Katya Scheinberg

Shor's algorithm contains a classical post-processing part for which we aim to create an efficient, understandable method aside from continued fractions. Let r be an unknown positive integer. Assume that with some constant probability we…

Quantum Physics · Physics 2013-01-31 Allison Koenecke , Pawel Wocjan