English
Related papers

Related papers: A Distributed Frank-Wolfe Framework for Learning L…

200 papers

Federated learning (FL) offers a promising distributed learning paradigm for internet of vehicles (IoV) applications. However, it faces challenges from communication overhead and dynamic environments. Model compression techniques reduce…

Machine Learning · Computer Science 2026-04-28 Huaicheng Li , Junhui Zhao , Haoyu Quan , Xiaoming Wang

Despite the fact that different objects possess distinct class-specific features, they also usually share common patterns. Inspired by this observation, we propose a novel method to explicitly and simultaneously learn a set of common…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Tiep H. Vu , Vishal Monga

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

In this paper, we investigate the performance of a practical aggregated LiFi-WiFi system with the discrete constellation inputs from a practical view. We derive the achievable rate expressions of the aggregated LiFi-WiFi system for the…

Information Theory · Computer Science 2023-05-24 Shuai Ma , Fan Zhang , Songtao Lu , Hang Li , Ruixin Yang , Sihua Shao , Jiaheng Wang , Shiyin Li

We introduce a globally-convergent algorithm for optimizing the tree-reweighted (TRW) variational objective over the marginal polytope. The algorithm is based on the conditional gradient method (Frank-Wolfe) and moves pseudomarginals within…

Machine Learning · Statistics 2015-11-26 Rahul G. Krishnan , Simon Lacoste-Julien , David Sontag

Nonnegative matrix factorization (NMF) often relies on the separability condition for tractable algorithm design. Separability-based NMF is mainly handled by two types of approaches, namely, greedy pursuit and convex programming. A notable…

Signal Processing · Electrical Eng. & Systems 2022-07-20 Tri Nguyen , Xiao Fu , Ruiyuan Wu

In tensor completion, the latent nuclear norm is commonly used to induce low-rank structure, while substantially failing to capture the global information due to the utilization of unbalanced unfolding scheme. To overcome this drawback, a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Jinshi Yu , Weijun Sun , Yuning Qiu , Shengli Xie

The problem of $L_p$-norm constrained coding is to convert signal into code that lies inside an $L_p$-ball and most faithfully reconstructs the signal. Previous works under the name of sparse coding considered the cases of $L_0$ and $L_1$…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Dong Liu , Ke Sun , Zhangyang Wang , Runsheng Liu , Zheng-Jun Zha

In this paper, we present the Stochastic Origin Frank-Wolfe (SOFW) method, which is a special case of the block-coordinate Frank-Wolfe algorithm, applied to the problem of finding equilibrium flow distributions. By significantly reducing…

Optimization and Control · Mathematics 2025-10-03 Igor Ignashin , Demyan Yarmoshik , Andrei Raigorodskii

Stochastic variance reduced methods have gained a lot of interest recently for empirical risk minimization due to its appealing run time complexity. When the data size is large and disjointly stored on different machines, it becomes…

Machine Learning · Computer Science 2020-08-26 Shicong Cen , Huishuai Zhang , Yuejie Chi , Wei Chen , Tie-Yan Liu

We prove that the block-coordinate Frank-Wolfe (BCFW) algorithm converges with state-of-the-art rates in both convex and nonconvex settings under a very mild "block-iterative" assumption. This appears to be the first result on BCFW…

Optimization and Control · Mathematics 2025-12-17 Gábor Braun , Jannis Halbey , Sebastian Pokutta , Zev Woodstock

This paper proposes a distributed Reinforcement Learning (RL) based framework that can be used for synthesizing MAC layer wireless protocols in IoT networks with low-complexity wireless transceivers. The proposed framework does not rely on…

Machine Learning · Computer Science 2021-04-30 Hrishikesh Dutta , Subir Biswas

Low-rank tensor decompositions (TDs) provide an effective framework for multiway data analysis. Traditional TD methods rely on predefined structural assumptions, such as CP or Tucker decompositions. From a probabilistic perspective, these…

Machine Learning · Computer Science 2025-06-30 Zhengyun Cheng , Changhao Wang , Guanwen Zhang , Yi Xu , Wei Zhou , Xiangyang Ji

We consider the applications of the Frank-Wolfe (FW) algorithm for Apprenticeship Learning (AL). In this setting, we are given a Markov Decision Process (MDP) without an explicit reward function. Instead, we observe an expert that acts…

Machine Learning · Computer Science 2019-11-21 Tom Zahavy , Alon Cohen , Haim Kaplan , Yishay Mansour

Hawkes processes have recently risen to the forefront of tools when it comes to modeling and generating sequential events data. Multidimensional Hawkes processes model both the self and cross-excitation between different types of events and…

Machine Learning · Computer Science 2022-12-13 Renbo Zhao , Niccolò Dalmasso , Mohsen Ghassemi , Vamsi K. Potluru , Tucker Balch , Manuela Veloso

Non-negative matrix factorization (NMF) is the problem of determining two non-negative low rank factors $W$ and $H$, for the given input matrix $A$, such that $A \approx W H$. NMF is a useful tool for many applications in different domains…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-01 Ramakrishnan Kannan , Grey Ballard , Haesun Park

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

Optimization and Control · Mathematics 2024-09-17 Ruslan Nazykov , Aleksandr Shestakov , Vladimir Solodkin , Aleksandr Beznosikov , Gauthier Gidel , Alexander Gasnikov

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Low-rank training methods reduce the number of trainable parameters by re-parameterizing the weights with matrix decompositions (e.g., singular value decomposition). However, enforcing a fixed low-rank structure caps the rank of the weight…

Machine Learning · Computer Science 2025-10-16 Hyuntak Shin , Aecheon Jung , Sungeun Hong , Sunwoo Lee

Trajectory similarity computation is a fundamental component in a variety of real-world applications, such as ridesharing, road planning, and transportation optimization. Recent advances in mobile devices have enabled an unprecedented…

Databases · Computer Science 2021-01-27 Bolong Zheng , Lianggui Weng , Xi Zhao , Kai Zeng , Xiaofang Zhou , Christian S. Jensen