English
Related papers

Related papers: Artificial Free Clone Of Simplex Method For Feasib…

200 papers

Simple exclusion processes for particles moving along two parallel lattices and jumping between them are theoretically investigated for asymmetric rates of transition between the channels. An approximate theoretical approach, that describes…

Statistical Mechanics · Physics 2009-11-11 Ekaterina Pronina , Anatoly B. Kolomeisky

An algorithm for unconstrained non-convex optimization is described, which does not evaluate the objective function and in which minimization is carried out, at each iteration, within a randomly selected subspace. It is shown that this…

Optimization and Control · Mathematics 2025-01-31 S. Bellavia , S. Gratton , B. Morini , Ph. L. Toint

To most applied statisticians, a fitting procedure's degrees of freedom is synonymous with its model complexity, or its capacity for overfitting to data. In particular, it is often used to parameterize the bias-variance tradeoff in model…

Other Statistics · Statistics 2017-01-06 Lucas Janson , William Fithian , Trevor Hastie

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

Optimization and Control · Mathematics 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

We provide a new efficient adaptive algorithm for performing phase estimation that does not require that the user infer the bits of the eigenphase in reverse order; rather it directly infers the phase and estimates the uncertainty in the…

Quantum Physics · Physics 2016-07-06 Nathan Wiebe , Christopher E Granade

We introduce a class of first-order methods for smooth constrained optimization that are based on an analogy to non-smooth dynamical systems. Two distinctive features of our approach are that (i) projections or optimizations over the entire…

Optimization and Control · Mathematics 2025-04-15 Michael Muehlebach , Michael I. Jordan

We introduce a suite of new particle-based algorithms for sampling in constrained domains which are entirely learning rate free. Our approach leverages coin betting ideas from convex optimisation, and the viewpoint of constrained sampling…

Machine Learning · Statistics 2023-12-27 Louis Sharrock , Lester Mackey , Christopher Nemeth

The self-concordant-like property of a smooth convex function is a new analytical structure that generalizes the self-concordant notion. While a wide variety of important applications feature the self-concordant-like property, this concept…

Optimization and Control · Mathematics 2018-01-23 Quoc Tran-Dinh , Yen-Huan Li , Volkan Cevher

This paper presents an algorithmic framework for the minimization of strictly convex quadratic functions. The framework is flexible and generic. At every iteration the search direction is a linear combination of the negative gradient, as…

Optimization and Control · Mathematics 2025-05-08 Liam MacDonald , Rua Murray , Rachael Tappenden

We challenge the perceived consensus that the application of deep learning to solve the automated driving planning task necessarily requires huge amounts of real-world data or highly realistic simulation. Focusing on a roundabout scenario,…

Robotics · Computer Science 2024-01-04 Martin Stoll , Markus Mazzola , Maxim Dolgov , Jürgen Mathes , Nicolas Möser

We expand the basic geometric elements of the simplex method to linear programs in locally convex topological vector spaces and provide conditions under which the method converges in value to optimality. This setting generalizes many…

Optimization and Control · Mathematics 2026-04-13 Robert L Smith , Christopher Thomas Ryan

In this paper we presented a new driving variable approach in minimum angle rule which is simple and comparatively fast for providing a dual feasible basis. We also present experimental results that compare the speed of the minimum angle…

Optimization and Control · Mathematics 2012-07-03 Syed Inayatullah , Nasiruddin Khan , Muhammad Imtiaz , Fozia Hanif Khan

We show that adaptive proximal gradient methods for convex problems are not restricted to traditional Lipschitzian assumptions. Our analysis reveals that a class of linesearch-free methods is still convergent under mere local H\"older…

Optimization and Control · Mathematics 2024-07-08 Konstantinos A. Oikonomidis , Emanuel Laude , Puya Latafat , Andreas Themelis , Panagiotis Patrinos

The independence clustering problem is considered in the following formulation: given a set $S$ of random variables, it is required to find the finest partitioning $\{U_1,\dots,U_k\}$ of $S$ into clusters such that the clusters…

Machine Learning · Computer Science 2017-03-21 Daniil Ryabko

Thus far the LHC experiments have yet to discover beyond-the-standard-model physics. This motivates efforts to search for new physics in model independent ways. In this spirit, we describe procedures for using a variant of the Matrix…

High Energy Physics - Phenomenology · Physics 2014-08-29 Dipsikha Debnath , James S. Gainer , Konstantin T. Matchev

Using the asymptotical minimax framework, we examine convergence rates equivalency between a continuous functional deconvolution model and its real-life discrete counterpart over a wide range of Besov balls and for the $L^2$-risk. For this…

Statistics Theory · Mathematics 2010-10-06 Marianna Pensky , Theofanis Sapatinas

Consider composite nonconvex optimization problems where the objective function consists of a smooth nonconvex term (with Lipschitz-continuous gradient) and a convex (possibly nonsmooth) term. Existing parameter-free methods for such…

Optimization and Control · Mathematics 2025-10-08 Zilong Ye , Shiqian Ma , Junfeng Yang , Danqing Zhou

Alternating minimization, or Fienup methods, have a long history in phase retrieval. We provide new insights related to the empirical and theoretical analysis of these algorithms when used with Fourier measurements and combined with convex…

Information Theory · Computer Science 2018-02-14 Edouard Pauwels , Amir Beck , Yonina C. Eldar , Shoham Sabach

This work facilitates ensuring fairness of machine learning in the real world by decoupling fairness considerations in compound decisions. In particular, this work studies how fairness propagates through a compound decision-making…

Computers and Society · Computer Science 2017-07-04 Amanda Bower , Sarah N. Kitchen , Laura Niss , Martin J. Strauss , Alexander Vargas , Suresh Venkatasubramanian

In smooth strongly convex optimization, knowledge of the strong convexity parameter is critical for obtaining simple methods with accelerated rates. In this work, we study a class of methods, based on Polyak steps, where this knowledge is…

Optimization and Control · Mathematics 2020-07-06 Mathieu Barré , Adrien Taylor , Alexandre d'Aspremont