中文
相关论文

相关论文: A non-smooth regularization framework for learning…

200 篇论文

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

机器学习 · 计算机科学 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width in image recognition, object detection and many other…

机器学习 · 计算机科学 2020-01-08 E Zhenqian , Gao Weiguo

Studies continually find that message-passing graph convolutional networks suffer from the over-smoothing issue. Basically, the issue of over-smoothing refers to the phenomenon that the learned embeddings for all nodes can become very…

机器学习 · 计算机科学 2024-04-16 Haimin Zhang , Min Xu

Understanding the fundamental mechanism behind the success of deep neural networks is one of the key challenges in the modern machine learning literature. Despite numerous attempts, a solid theoretical analysis is yet to be developed. In…

机器学习 · 计算机科学 2022-01-14 Tolga Ergen , Mert Pilanci

We propose using regularization for Multi-Agent Reinforcement Learning rather than learning explicit cooperative structures called {\em Multi-Agent Regularized Q-learning} (MARQ). Many MARL approaches leverage centralized structures in…

机器学习 · 计算机科学 2021-09-21 Chapman Siu , Jason Traish , Richard Yi Da Xu

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

最优化与控制 · 数学 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

Graph summarization is beneficial in a wide range of applications, such as visualization, interactive and exploratory analysis, approximate query processing, reducing the on-disk storage footprint, and graph processing in modern hardware.…

数据结构与算法 · 计算机科学 2022-01-03 Xiangyu Ke , Arijit Khan , Francesco Bonchi

In recent years, there has been a growing interest in mathematical models leading to the minimization, in a symmetric matrix space, of a Bregman divergence coupled with a regularization term. We address problems of this type within a…

最优化与控制 · 数学 2022-06-10 A. Benfenati , E. Chouzenoux , J. -C. Pesquet

Computational efficiency is a major bottleneck in using classic graph-based approaches for semi-supervised learning on datasets with a large number of unlabeled examples. Known techniques to improve efficiency typically involve an…

机器学习 · 计算机科学 2023-06-13 Dravyansh Sharma , Maxwell Jones

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

最优化与控制 · 数学 2017-07-18 Ion Matei , John S. Baras

We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph. Unlike existing multi-task learning methodologies, the graph structure is not assumed…

机器学习 · 计算机科学 2020-09-15 Shujian Yu , Francesco Alesiani , Ammar Shaker , Wenzhe Yin

In this work, we consider the distributed optimization of non-smooth convex functions using a network of computing units. We investigate this problem under two regularity assumptions: (1) the Lipschitz continuity of the global objective…

最优化与控制 · 数学 2018-06-04 Kevin Scaman , Francis Bach , Sébastien Bubeck , Yin Tat Lee , Laurent Massoulié

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

机器学习 · 计算机科学 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

Graph learning has emerged as a promising technique for multi-view clustering with its ability to learn a unified and robust graph from multiple views. However, existing graph learning methods mostly focus on the multi-view consistency…

机器学习 · 计算机科学 2021-07-06 Youwei Liang , Dong Huang , Chang-Dong Wang , Philip S. Yu

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

最优化与控制 · 数学 2019-08-02 Shi Pu , Angelia Nedić

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

机器学习 · 计算机科学 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten

This work studies the denoising of piecewise smooth graph signals that exhibit inhomogeneous levels of smoothness over a graph, where the value at each node can be vector-valued. We extend the graph trend filtering framework to denoising…

信号处理 · 电气工程与系统科学 2020-01-16 Rohan Varma , Harlin Lee , Jelena Kovačević , Yuejie Chi

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

最优化与控制 · 数学 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov

In this paper, we study the decentralized optimization problem of minimizing a finite sum of continuously differentiable and possibly nonconvex functions over a fixed-connected undirected network. We propose a unified decentralized…

最优化与控制 · 数学 2026-04-14 Hao Wu , Liping Wang

Multitask learning (MTL) aims to learn multiple tasks simultaneously through the interdependence between different tasks. The way to measure the relatedness between tasks is always a popular issue. There are mainly two ways to measure…

机器学习 · 计算机科学 2019-04-04 Ya Li , Xinmei Tian , Tongliang Liu , Dacheng Tao