English
Related papers

Related papers: Efficient Transductive Online Learning via Randomi…

200 papers

The amount of data in our society has been exploding in the era of big data today. In this paper, we address several open challenges of big data stream classification, including high volume, high velocity, high dimensionality, high…

Machine Learning · Computer Science 2015-07-28 Dayong Wang , Pengcheng Wu , Peilin Zhao , Steven C. H. Hoi

Learning-based low rank approximation algorithms can significantly improve the performance of randomized low rank approximation with sketch matrix. With the learned value and fixed non-zero positions for sketch matrices from learning-based…

Machine Learning · Computer Science 2022-12-19 Tiejin Chen , Yicheng Tao

Semi-supervised video object segmentation is a task of segmenting the target object in a video sequence given only a mask annotation in the first frame. The limited information available makes it an extremely challenging task. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yunyao Mao , Ning Wang , Wengang Zhou , Houqiang Li

In learning-to-learn the goal is to infer a learning algorithm that works well on a class of tasks sampled from an unknown meta distribution. In contrast to previous work on batch learning-to-learn, we consider a scenario where tasks are…

Machine Learning · Statistics 2018-03-23 Giulia Denevi , Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

Sampling without replacement is a natural online rounding strategy for converting fractional bipartite matching into an integral one. In Online Bipartite Matching, we can use the Balance algorithm to fractionally match each online vertex,…

Data Structures and Algorithms · Computer Science 2024-10-10 Zhiyi Huang , Chui Shan Lee , Jianqiao Lu , Xinkai Shu

The success of deep learning over the past decade mainly relies on gradient-based optimisation and backpropagation. This paper focuses on analysing the performance of first-order gradient-based optimisation algorithms, gradient descent and…

Optimization and Control · Mathematics 2022-12-08 Behnam Mafakheri , Iman Shames , Jonathan H. Manton

We study the problem of cooperative inference where a group of agents interact over a network and seek to estimate a joint parameter that best explains a set of observations. Agents do not know the network topology or the observations of…

Optimization and Control · Mathematics 2017-04-11 Angelia Nedić , Alex Olshevsky , César A. Uribe

In the field of online sequential decision-making, we address the problem with delays utilizing the framework of online convex optimization (OCO), where the feedback of a decision can arrive with an unknown delay. Unlike previous research…

Machine Learning · Computer Science 2024-02-26 Ping Wu , Heyan Huang , Zhengyang Liu

Online-learning literature has focused on designing algorithms that ensure sub-linear growth of the cumulative long-term constraint violations. The drawback of this guarantee is that strictly feasible actions may cancel out constraint…

Optimization and Control · Mathematics 2019-10-22 Ezra Tampubolon , Holger Boche

In this work, we propose a novel optimization model termed "sum-of-minimum" optimization. This model seeks to minimize the sum or average of $N$ objective functions over $k$ parameters, where each objective takes the minimum value of a…

Optimization and Control · Mathematics 2024-06-11 Lisang Ding , Ziang Chen , Xinshang Wang , Wotao Yin

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

In this paper we focus on the solution of online problems with time-varying, linear equality and inequality constraints. Our approach is to design a novel online algorithm by leveraging the tools of control theory. In particular, for the…

Optimization and Control · Mathematics 2025-09-04 Umberto Casti , Nicola Bastianello , Ruggero Carli , Sandro Zampieri

Learning control policies offline from pre-recorded datasets is a promising avenue for solving challenging real-world problems. However, available datasets are typically of mixed quality, with a limited number of the trajectories that we…

Data is often generated in streams, with new observations arriving over time. A key challenge for learning models from data streams is capturing relevant information while keeping computational costs manageable. We explore intelligent data…

Machine Learning · Computer Science 2025-12-23 Benedetta Lavinia Mussati , Freddie Bickford Smith , Tom Rainforth , Stephen Roberts

We present a novel approach to online multi-target tracking based on recurrent neural networks (RNNs). Tracking multiple objects in real-world scenes involves many challenges, including a) an a-priori unknown and time-varying number of…

Computer Vision and Pattern Recognition · Computer Science 2016-12-08 Anton Milan , Seyed Hamid Rezatofighi , Anthony Dick , Ian Reid , Konrad Schindler

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo

We consider the problem of online combinatorial optimization under semi-bandit feedback. The goal of the learner is to sequentially select its actions from a combinatorial decision set so as to minimize its cumulative loss. We propose a…

Machine Learning · Computer Science 2013-05-14 Gergely Neu , Gábor Bartók

Existing online multi-label classification works cannot well handle the online label thresholding problem and lack the regret analysis for their online algorithms. This paper proposes a novel framework of adaptive label thresholding…

Machine Learning · Computer Science 2022-11-15 Tingting Zhai , Hongcheng Tang , Hao Wang

The unsupervised task of aligning two or more distributions in a shared latent space has many applications including fair representations, batch effect mitigation, and unsupervised domain adaptation. Existing flow-based approaches estimate…

Machine Learning · Computer Science 2022-03-17 Zeyu Zhou , Ziyu Gong , Pradeep Ravikumar , David I. Inouye

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

Machine Learning · Statistics 2024-05-20 Lexing Ying