中文
相关论文

相关论文: A Convergence indicator for Multi-Objective Optimi…

200 篇论文

Stochastic Gradient Langevin Dynamics (SGLD) ensures strong guarantees with regards to convergence in measure for sampling log-concave posterior distributions by adding noise to stochastic gradient iterates. Given the size of many practical…

机器学习 · 计算机科学 2020-06-15 Vyacheslav Kungurtsev , Bapi Chatterjee , Dan Alistarh

We propose the first algorithms with non-asymptotic convergence guarantees for computing the Petz-Augustin capacity, which generalizes the channel capacity and characterizes the optimal error exponent in classical-quantum channel coding.…

信息论 · 计算机科学 2026-01-13 Chun-Neng Chu , Wei-Fu Tseng , Yen-Huan Li

Distributed-memory implementations of numerical optimization algorithm, such as stochastic gradient descent (SGD), require interprocessor communication at every iteration of the algorithm. On modern distributed-memory clusters where…

分布式、并行与集群计算 · 计算机科学 2025-01-14 Aditya Devarakonda , Ramakrishnan Kannan

The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…

信息论 · 计算机科学 2025-05-28 Keenan J. A. Down , Pedro A. M. Mediano

We introduce the convex matching distance, a novel metric for comparing functions with values in the real plane. This metric measures the maximal bottleneck distance between the persistence diagrams associated with the convex combinations…

As the interest in multi- and many-objective optimization algorithms grows, the performance comparison of these algorithms becomes increasingly important. A large number of performance indicators for multi-objective optimization algorithms…

人工智能 · 计算机科学 2024-11-28 Amin Ibrahim , Azam Asilian Bidgoli , Shahryar Rahnamayan , Kalyanmoy Deb

During the past two decades, multi-agent optimization problems have drawn increased attention from the research community. When multiple objective functions are present among agents, many works optimize the sum of these objective functions.…

多智能体系统 · 计算机科学 2020-10-13 M. J. Blondin , M. T. Hale

There has been a growing effort in studying the distributed optimization problem over a network. The objective is to optimize a global function formed by a sum of local functions, using only local computation and communication. Literature…

最优化与控制 · 数学 2017-05-02 Guannan Qu , Na Li

The performance of multi-objective evolutionary algorithms deteriorates appreciably in solving many-objective optimization problems which encompass more than three objectives. One of the known rationales is the loss of selection pressure…

神经与进化计算 · 计算机科学 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Many structured data-fitting applications require the solution of an optimization problem involving a sum over a potentially large number of measurements. Incremental gradient algorithms offer inexpensive iterations by sampling a subset of…

数值分析 · 计算机科学 2018-08-23 Michael P. Friedlander , Mark Schmidt

In multiobjective optimization, the result of an optimization algorithm is a set of efficient solutions from which the decision maker selects one. It is common that not all the efficient solutions can be computed in a short time and the…

神经与进化计算 · 计算机科学 2024-03-20 Miguel Ángel Domínguez-Ríos , Francisco Chicano , Enrique Alba

We propose a new way to measure inequalities such as the glass ceiling effect in attributed networks. Existing measures typically rely solely on node degree distribution or degree assortativity, but our approach goes beyond these measures…

社会与信息网络 · 计算机科学 2023-03-20 Rui Luo , Buddhika Nettasinghe , Vikram Krishnamurthy

In minimum-cost inverse optimization problems, we are given a feasible solution to an underlying optimization problem together with a linear cost function, and the goal is to modify the costs by a small deviation vector so that the input…

最优化与控制 · 数学 2023-03-01 Kristóf Bérczi , Lydia Mirabel Mendoza-Cadena , Kitti Varga

The problem of estimation of density functionals like entropy and mutual information has received much attention in the statistics and information theory communities. A large class of estimators of functionals of the probability density…

统计理论 · 数学 2013-03-05 Kumar Sricharan , Dennis Wei , Alfred O. Hero

The concept of Relative Divergence of one Grading Function from another is extended from totally ordered chains to power sets of finite event spaces. Shannon Entropy concept is extended to normalized grading functions on such power sets.…

概率论 · 数学 2022-07-15 Alexander Dukhovny

The Expectation-Maximization (EM) algorithm for mixture models often results in slow or invalid convergence. The popular convergence proof affirms that the likelihood increases with Q; Q is increasing in the M -step and non-decreasing in…

机器学习 · 计算机科学 2018-10-29 Chenguang Lu

With the recent proliferation of large-scale learning problems,there have been a lot of interest on distributed machine learning algorithms, particularly those that are based on stochastic gradient descent (SGD) and its variants. However,…

机器学习 · 计算机科学 2015-12-07 Ruiliang Zhang , Shuai Zheng , James T. Kwok

Two important characteristics of multi-objective evolutionary algorithms are distribution and convergency. As a classic multi-objective genetic algorithm, NSGA-II is widely used in multi-objective optimization fields. However, in NSGA-II,…

神经与进化计算 · 计算机科学 2019-01-04 Xinwu Yang , Guizeng You , Chong Zhao , Mengfei Dou , Xinian Guo

Benson's outer approximation algorithm and its variants are the most frequently used methods for solving linear multiobjective optimization problems. These algorithms have two intertwined components: one-dimensional linear optimization one…

最优化与控制 · 数学 2019-03-21 Laszlo Csirmaz

This paper presents a new distance metric to compare two continuous probability density functions. The main advantage of this metric is that, unlike other statistical measurements, it can provide an analytic, closed-form expression for a…

机器学习 · 计算机科学 2023-06-14 Ahmad Sajedi , Yuri A. Lawryshyn , Konstantinos N. Plataniotis