English
Related papers

Related papers: Nonlinear Conjugate Gradient Method for Multiobjec…

200 papers

In this work, we propose integral global optimality conditions for multiobjective problems not necessarily differentiable. The integral characterization, already known for single objective problems, are extended to multiobjective problems…

Optimization and Control · Mathematics 2025-09-16 Everton J. Silva , Elizabeth W. Karas , Lucelina B. Santos

Recent progress on deep learning relies heavily on the quality and efficiency of training algorithms. In this paper, we develop a fast training method motivated by the nonlinear Conjugate Gradient (CG) framework. We propose the Conjugate…

Machine Learning · Computer Science 2021-07-28 Zhiyong Hao , Yixuan Jiang , Huihua Yu , Hsiao-Dong Chiang

This paper presents an auto-conditioned proximal gradient method for nonconvex optimization. The method determines the stepsize using an estimation of local curvature and does not require any prior knowledge of problem parameters and any…

Optimization and Control · Mathematics 2025-09-19 Shotaro Yagishita , Masaru Ito

Technical indicators use graphic representations of data sets by applying various mathematical formulas to financial time series of prices. These formulas comprise a set of rules and parameters whose values are not necessarily known and…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Francisco J. Soltero , Pablo Fernández-Blanco , J. Ignacio Hidalgo

The Frank-Wolfe algorithm has become a popular first-order optimization algorithm for it is simple and projection-free, and it has been successfully applied to a variety of real-world problems. Its main drawback however lies in its…

Optimization and Control · Mathematics 2020-06-25 Cyrille W. Combettes , Sebastian Pokutta

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is…

Methodology · Statistics 2018-12-18 Jon Cockayne , Chris Oates , Ilse Ipsen , Mark Girolami

In this paper, a descent method for nonsmooth multiobjective optimization problems on complete Riemannian manifolds is proposed. The objective functions are only assumed to be locally Lipschitz continuous instead of convexity used in…

Optimization and Control · Mathematics 2025-01-14 Chunming Tang , Hao He , Jinbao Jian , Miantao Chao

Much recent research effort has been directed to the development of efficient algorithms for solving minimax problems with theoretical convergence guarantees due to the relevance of these problems to a few emergent applications. In this…

Optimization and Control · Mathematics 2023-01-18 Zi Xu , Huiling Zhang , Yang Xu , Guanghui Lan

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

Machine Learning · Computer Science 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

The standard implementation of the conjugate gradient algorithm suffers from communication bottlenecks on parallel architectures, due primarily to the two global reductions required every iteration. In this paper, we study conjugate…

Numerical Analysis · Computer Science 2021-04-20 Tyler Chen , Erin C. Carson

We consider minimizing a sum of agent-specific nondifferentiable merely convex functions over the solution set of a variational inequality (VI) problem in that each agent is associated with a local monotone mapping. This problem finds an…

Optimization and Control · Mathematics 2022-12-13 Harshal D. Kaushik , Sepideh Samadi , Farzad Yousefian

This paper proposes the algorithm NOWPAC (Nonlinear Optimization With Path-Augmented Constraints) for nonlinear constrained derivative-free optimization. The algorithm uses a trust region framework based on fully linear models for the…

Optimization and Control · Mathematics 2015-11-18 F. Augustin , Y. M. Marzouk

This paper presents an efficient gradient projection-based method for structural topological optimization problems characterized by a nonlinear objective function which is minimized over a feasible region defined by bilateral bounds and a…

Computational Engineering, Finance, and Science · Computer Science 2020-06-16 Zhi Zeng , Fulei Ma

We present a simple and at the same time fficient algorithm to compute all nondominated extreme points in the outcome set of multi-objective mixed integer linear programmes in any dimension. The method generalizes the well-known dichotomic…

Optimization and Control · Mathematics 2019-11-21 Anthony Przybylski , Kathrin Klamroth , Renaud Lacour

Conjugate gradient is an efficient algorithm for solving large sparse linear systems. It has been utilized to accelerate the computation in Bayesian analysis for many large-scale problems. This article discusses the applications of…

Methodology · Statistics 2023-08-30 Lu Zhang

Optimization techniques play a crucial role in estimating parameters and state information for nonlinear systems. However, some critical aspects of these problems have received little attention in previous research. In this paper, we…

Optimization and Control · Mathematics 2023-06-02 Kaushal Kumar

We present a stepwise approach to estimate high dimensional Gaussian graphical models. We exploit the relation between the partial correlation coefficients and the distribution of the prediction errors, and parametrize the model in terms of…

Methodology · Statistics 2018-08-21 Ginette Lafit , Francisco J. Nogales , Marcelo Ruiz , Ruben H. Zamar

This paper proposes a generalization of the conjugate gradient (CG) method used to solve the equation $Ax=b$ for a symmetric positive definite matrix $A$ of large size $n$. The generalization consists of permitting the scalar control…

Numerical Analysis · Mathematics 2016-11-17 Amit Bhaya , Pierre-Alexandre Bliman , Guilherme Niedu , Fernando Pazos

Stochastic nonconvex optimization problems with nonlinear constraints have a broad range of applications in intelligent transportation, cyber-security, and smart grids. In this paper, first, we propose an inexact-proximal accelerated…

Optimization and Control · Mathematics 2021-07-08 Morteza Boroun , Afrooz Jalilzadeh

Nonlinear optimization methods are typically iterative and make use of gradient information to determine a direction of improvement and function information to effectively check for progress. When this information is corrupted by noise,…

Optimization and Control · Mathematics 2025-10-21 Albert S. Berahas , Michael J. O'Neill , Clément W. Royer