English
Related papers

Related papers: Fast Second-Order Online Kernel Learning through I…

200 papers

Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial…

Machine Learning · Computer Science 2020-03-23 German I. Parisi , Vincenzo Lomonaco

Embedding-based collaborative filtering, often coupled with nearest neighbor search, is widely deployed in large-scale recommender systems for personalized content selection. Modern systems leverage multiple implicit feedback signals (e.g.,…

Information Retrieval · Computer Science 2025-05-29 Zhongjin Zhang , Yu Liang , Cong Fu , Yuxuan Zhu , Kun Wang , Yabo Ni , Anxiang Zeng , Jiazhi Xia

Recent advances in autoregressive video diffusion have enabled real-time frame streaming, yet existing solutions still suffer from temporal repetition, drift, and motion deceleration. We find that naively applying StreamingLLM-style…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jung Yi , Wooseok Jang , Paul Hyunbin Cho , Jisu Nam , Heeji Yoon , Seungryong Kim

The fine-tuning of deep pre-trained models has revealed compositional properties, with multiple specialized modules that can be arbitrarily composed into a single, multi-task model. However, identifying the conditions that promote…

Artificial Intelligence · Computer Science 2025-03-04 Angelo Porrello , Lorenzo Bonicelli , Pietro Buzzega , Monica Millunzi , Simone Calderara , Rita Cucchiara

A well-studied generalization of the standard online convex optimization (OCO) framework is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the…

Machine Learning · Computer Science 2024-10-29 Abhishek Sinha , Rahul Vaze

We study the problem of {\em online} low-rank matrix completion with $\mathsf{M}$ users, $\mathsf{N}$ items and $\mathsf{T}$ rounds. In each round, the algorithm recommends one item per user, for which it gets a (noisy) reward sampled from…

Machine Learning · Computer Science 2023-03-08 Prateek Jain , Soumyabrata Pal

We formalize sequential decision-making with information acquisition as the probing-augmented user-centric selection (PUCS) framework, where a learner first probes a subset of arms to obtain side information on resources and rewards, and…

Machine Learning · Computer Science 2025-08-19 Tianyi Xu , Yiting Chen , Henger Li , Zheyong Bian , Emiliano Dall'Anese , Zizhan Zheng

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Factorization Machine (FM) is a supervised learning approach with a powerful capability of feature engineering. It yields state-of-the-art performance in various batch learning tasks where all the training data is made available prior to…

Machine Learning · Computer Science 2018-02-06 Wenpeng Zhang , Xiao Lin , Peilin Zhao

In this paper, we demonstrate how to learn the objective function of a decision-maker while only observing the problem input data and the decision-maker's corresponding decisions over multiple rounds. We present exact algorithms for this…

Optimization and Control · Mathematics 2020-03-31 Andreas Bärmann , Alexander Martin , Sebastian Pokutta , Oskar Schneider

We study an online linear optimization (OLO) problem in which the learner is provided access to $K$ "hint" vectors in each round prior to making a decision. In this setting, we devise an algorithm that obtains logarithmic regret whenever…

Machine Learning · Computer Science 2020-10-08 Aditya Bhaskara , Ashok Cutkosky , Ravi Kumar , Manish Purohit

Although Faster R-CNN and its variants have shown promising performance in object detection, they only exploit simple first-order representation of object proposals for final classification and regression. Recent classification methods…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Hao Wang , Qilong Wang , Mingqi Gao , Peihua Li , Wangmeng Zuo

We investigate the problem of active learning in the streaming setting in non-parametric regimes, where the labels are stochastically generated from a class of functions on which we make no assumptions whatsoever. We rely on recently…

Machine Learning · Computer Science 2021-06-08 Pranjal Awasthi , Christoph Dann , Claudio Gentile , Ayush Sekhari , Zhilei Wang

Cost-Sensitive Online Classification has drawn extensive attention in recent years, where the main approach is to directly online optimize two well-known cost-sensitive metrics: (i) weighted sum of sensitivity and specificity; (ii) weighted…

Machine Learning · Computer Science 2019-11-19 Peilin Zhao , Yifan Zhang , Min Wu , Steven C. H. Hoi , Mingkui Tan , Junzhou Huang

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Existing progress in object keypoint estimation primarily benefits from the conventional supervised learning paradigm based on numerous data labeled with pre-defined keypoints. However, these well-trained models can hardly detect the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Mingfu Liang , Jiahuan Zhou , Xu Zou , Ying Wu

Follow-the-Regularized-Leader (FTRL) algorithms are a popular class of learning algorithms for online linear optimization (OLO) that guarantee sub-linear regret, but the choice of regularizer can significantly impact dimension-dependent…

Machine Learning · Computer Science 2024-10-24 Khashayar Gatmiry , Jon Schneider , Stefanie Jegelka

Online conformal prediction (OCP) seeks prediction intervals that achieve long-run $1-\alpha$ coverage for arbitrary (possibly adversarial) data streams, while remaining as informative as possible. Existing OCP methods often require manual…

Machine Learning · Statistics 2026-02-04 Tuo Liu , Edgar Dobriban , Francesco Orabona

Recent works in deep-learning have shown that second-order information is beneficial in many computer-vision tasks. Second-order information can be enforced both in the spatial context and the abstract feature dimensions. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Tony Ng , Vassileios Balntas , Yurun Tian , Krystian Mikolajczyk

Online Continual Learning (OCL) involves sequentially arriving data and is particularly challenged by catastrophic forgetting, which significantly impairs model performance. To address this issue, we introduce a novel framework, Online…

Machine Learning · Computer Science 2025-12-16 Congren Dai , Huichi Zhou , Jiahao Huang , Zhenxuan Zhang , Fanwen Wang , Yijian Gao , Guang Yang , Fei Ye