English
Related papers

Related papers: Hermite-type modifications of BOBYQA for optimizat…

200 papers

Multidisciplinary design optimization methods aim at adapting numerical optimization techniques to the design of engineering systems involving multiple disciplines. In this context, a large number of mixed continuous, integer and…

Large language models require massive memory footprints, severely limiting deployment on consumer hardware. Quantization reduces memory through lower numerical precision, but extreme 2-bit quantization suffers from catastrophic performance…

Machine Learning · Computer Science 2026-02-12 Bingxin Xu , Zhen Dong , Oussama Elachqar , Yuzhang Shang

We propose an Hermite spectral method for the Fokker-Planck-Landau (FPL) equation. Both the distribution functions and the collision terms are approximated by series expansions of the Hermite functions. To handle the complexity of the…

Computational Physics · Physics 2021-03-17 Ruo Li , Yinuo Ren , Yanli Wang

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

It is increasingly common to solve combinatorial optimisation problems that are partially-specified. We survey the case where the objective function or the relations between variables are not known or are only partially specified. The…

Machine Learning · Computer Science 2022-05-23 Stefano Teso , Laurens Bliek , Andrea Borghesi , Michele Lombardi , Neil Yorke-Smith , Tias Guns , Andrea Passerini

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

We first consider the problem of approximating a few eigenvalues of a rational matrix-valued function closest to a prescribed target. It is assumed that the proper rational part of the rational matrix-valued function is expressed in the…

Numerical Analysis · Mathematics 2022-01-10 Rifqi Aziz , Emre Mengi , Matthias Voigt

This article considers a box-constrained global optimization problem for Lipschitz-continuous functions with an unknown Lipschitz constant. Motivated by the famous DIRECT (DIviding RECTangles), a new HALRECT (HALving RECTangles) algorithm…

Optimization and Control · Mathematics 2022-09-20 Linas Stripinis , Remigijus Paulavičius

The LogQ algorithm encodes Quadratic Unconstrained Binary Optimization (QUBO) problems with exponentially fewer qubits than the Quantum Approximate Optimization Algorithm (QAOA). The advantages of conventional LogQ are accompanied by a…

Quantum Physics · Physics 2025-07-14 Yagnik Chatterjee , Jérémie Messud

Imaginary-time evolution has been shown to be a promising framework for tackling combinatorial optimization problems on quantum hardware. In this work, we propose a classical quantum-inspired strategy for solving combinatorial optimization…

Quantum Physics · Physics 2025-12-05 Erik M. Åsgrim , Ahsan Javed Awan

The goal of multi-objective query optimization (MOQO) is to find query plans that realize a good compromise between conflicting objectives such as minimizing execution time and minimizing monetary fees in a Cloud scenario. A previously…

Databases · Computer Science 2014-04-02 Immanuel Trummer , Christoph Koch

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

The gradient descent method aims at finding local minima of a given multivariate function by moving along the direction of its gradient, and hence, the algorithm typically involves computing all partial derivatives of a given function,…

Quantum Physics · Physics 2025-02-25 Nhat A. Nghiem

The least squares method provides the best-fit curve by minimizing the total squares error. In this work, we provide the modified least squares method based on the fractional orthogonal polynomials that belong to the space $M_{n}^{\lambda}…

Numerical Analysis · Mathematics 2024-05-02 Abhishek Kumar Singh , Mani Mehra , Anatoly A. Alikhanov

A new methodology is proposed to solve classical Boolean problems as Hamiltonians, using the quantum approximate optimization algorithm (QAOA). Our methodology successfully finds all optimized approximated solutions for Boolean problems,…

Quantum Physics · Physics 2024-07-11 Ali Al-Bayaty , Marek Perkowski

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

We combine conditioning techniques with sparse grid quadrature rules to develop a computationally efficient method to approximate marginal, but not necessarily univariate, posterior quantities, yielding approximate Bayesian inference via…

Computation · Statistics 2019-04-17 Joshua Hewitt , Jennifer A. Hoeting

One of the reasons for the success of the finite element method is its versatility to deal with different types of geometries. This is particularly true of problems posed in curved domains of arbitrary shape. In the case of second order…

Numerical Analysis · Mathematics 2020-03-24 Vitoriano Ruas

This paper discusses a class of two-block smooth large-scale optimization problems with both linear equality and linear inequality constraints, which have a wide range of applications, such as economic power dispatch, data mining, signal…

Optimization and Control · Mathematics 2023-09-27 Jinbao jian , Wenrui Chen , Chunming Tang , Jianghua Yin

Post-training quantization is an effective method for reducing the serving cost of large language models, where the standard approach is to use a round-to-nearest quantization level scheme. However, this often introduces large errors due to…

Machine Learning · Computer Science 2025-11-26 Ziteng Sun , Adrian Benton , Samuel Kushnir , Asher Trockman , Vikas Singh , Suhas Diggavi , Ananda Theertha Suresh