中文
相关论文

相关论文: Computing the Newton-step faster than Hessian accu…

200 篇论文

We present new quantum algorithms for Triangle Finding improving its best previously known quantum query complexities for both dense and spare instances.For dense graphs on $n$ vertices, we get a query complexity of $O(n^{5/4})$ without any…

量子物理 · 物理学 2016-10-13 Titouan Carette , Mathieu Laurière , Frédéric Magniez

We present a finite-time analysis of two smoothed functional stochastic approximation algorithms for simulation-based optimization. The first is a two time-scale gradient-based method, while the second is a three time-scale Newton-based…

机器学习 · 计算机科学 2026-04-01 Kaustubh Kartikey , Shalabh Bhatnagar

We consider global problems, i.e. problems that take at least diameter time, even when the bandwidth is not restricted. We show that all problems considered admit efficient solutions in low-treewidth graphs. By ``efficient'' we mean that…

分布式、并行与集群计算 · 计算机科学 2022-05-31 Taisuke Izumi , Naoki Kitamura , Takamasa Naruse , Gregory Schwartzman

Computing a graph prototype may constitute a core element for clustering or classification tasks. However, its computation is an NP-Hard problem, even for simple classes of graphs. In this paper, we propose an efficient approach based on…

计算机视觉与模式识别 · 计算机科学 2019-06-27 Nicolas Boria , S'ebastien Bougleux , Benoit Gaüzère , Luc Brun

In distributed optimization and distributed numerical linear algebra, we often encounter an inversion bias: if we want to compute a quantity that depends on the inverse of a sum of distributed matrices, then the sum of the inverses does not…

机器学习 · 计算机科学 2019-05-29 Michał Dereziński , Michael W. Mahoney

The paper proposes a new algorithm for solving global univariate optimization problems. The algorithm does not require convexity of the target function. For a broad variety of target functions after performing (if necessary) several…

最优化与控制 · 数学 2016-01-26 Sergey Nikitin

We present a systematic derivation of the algorithms required for computing the gradient and the action of the Hessian of an arbitrary misfit function for large-scale parameter estimation problems involving linear time-dependent PDEs with…

最优化与控制 · 数学 2016-08-09 Kai Rothauge , Eldad Haber , Uri Ascher

We consider variants of a recently-developed Newton-CG algorithm for nonconvex problems \citep{royer2018newton} in which inexact estimates of the gradient and the Hessian information are used for various steps. Under certain conditions on…

最优化与控制 · 数学 2022-04-12 Zhewei Yao , Peng Xu , Fred Roosta , Stephen J. Wright , Michael W. Mahoney

We present the first q-Gaussian smoothed functional (SF) estimator of the Hessian and the first Newton-based stochastic optimization algorithm that estimates both the Hessian and the gradient of the objective function using q-Gaussian…

最优化与控制 · 数学 2014-10-31 Debarghya Ghoshdastidar , Ambedkar Dukkipati , Shalabh Bhatnagar

We consider distributed optimization problems where networked nodes cooperatively minimize the sum of their locally known convex costs. A popular class of methods to solve these problems are the distributed gradient methods, which are…

信息论 · 计算机科学 2017-02-21 Dragana Bajovic , Dusan Jakovetic , Natasa Krejic , Natasa Krklec Jerinkic

The Newton, Gauss--Newton and Levenberg--Marquardt methods all use the first derivative of a vector function (the Jacobian) to minimise its sum of squares. When the Jacobian matrix is ill-conditioned, the function varies much faster in some…

数值分析 · 数学 2025-08-01 S. J. Brooks

The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to be found, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for…

神经与进化计算 · 计算机科学 2023-12-14 Xin-long Luo , Hang Xiao , Sen Zhang

The generalized smooth condition, $(L_{0},L_{1})$-smoothness, has triggered people's interest since it is more realistic in many optimization problems shown by both empirical and theoretical evidence. Two recent works established the…

机器学习 · 计算机科学 2023-10-31 Zijian Liu , Srikanth Jagabathula , Zhengyuan Zhou

A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix,…

最优化与控制 · 数学 2021-01-12 William W. Hager , Davoud Ataee Tarzanagh

The pivot algorithm is a Markov Chain Monte Carlo algorithm for simulating the self-avoiding walk. At each iteration a pivot which produces a global change in the walk is proposed. If the resulting walk is self-avoiding, the new walk is…

凝聚态物理 · 物理学 2007-05-23 Tom Kennedy

The independence number of a tree decomposition is the maximum of the independence numbers of the subgraphs induced by its bags. The tree-independence number of a graph is the minimum independence number of a tree decomposition of it.…

数据结构与算法 · 计算机科学 2025-09-11 Clément Dallard , Fedor V. Fomin , Petr A. Golovach , Tuukka Korhonen , Martin Milanič

In this paper we present the first deterministic polynomial time algorithm for determining the existence of a Hamiltonian cycle and finding a Hamiltonian cycle in general graphs. Our algorithm can also solve the Hamiltonian path problem in…

数据结构与算法 · 计算机科学 2022-07-12 Aimin Hou

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

统计方法学 · 统计学 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

The fast growing scale and heterogeneity of current communication networks necessitate the design of distributed cross-layer optimization algorithms. So far, the standard approach of distributed cross-layer design is based on dual…

网络与互联网体系结构 · 计算机科学 2011-08-11 Jia Liu , Hanif D. Sherali

In the work [$\mathcal{O}(m\cdot n)$ algorithms for the recognition and isomorphism problems on circular-arc graphs, SIAM J. Comput. 24(3), 411--439, (1995)], Wen-Lian Hsu claims three results concerning the class of circular-arc graphs: -…

数据结构与算法 · 计算机科学 2024-11-27 Tomasz Krawczyk