English
Related papers

Related papers: Online Bagging for Anytime Transfer Learning

200 papers

We study the problem of online multi-task learning where the tasks are performed within similar but not necessarily identical multi-armed bandit environments. In particular, we study how a learner can improve its overall performance across…

Machine Learning · Computer Science 2022-06-20 Zhi Wang , Chicheng Zhang , Kamalika Chaudhuri

The performance of machine learning model can be further improved if contextual cues are provided as input along with base features that are directly related to an inference task. In offline learning, one can inspect historical training…

Machine Learning · Computer Science 2019-10-21 Kin Gwn Lore , Kishore K. Reddy

In this work, we address the question of the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems. We demonstrate that by using well-developed techniques based on the concept of…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Pedro J. Freire , Daniel Abode , Jaroslaw E. Prilepsky , Nelson Costa , Bernhard Spinnler , Antonio Napoli , Sergei K. Turitsyn

This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival. Despite the recent proliferation of…

Artificial Intelligence · Computer Science 2024-07-19 Zixin Wang , Yadan Luo , Liang Zheng , Zhuoxiao Chen , Sen Wang , Zi Huang

Continual learning with an increasing number of classes is a challenging task. The difficulty rises when each example is presented exactly once, which requires the model to learn online. Recent methods with classic parameter optimization…

Machine Learning · Computer Science 2023-08-22 Mateusz Wójcik , Witold Kościukiewicz , Tomasz Kajdanowicz , Adam Gonczarek

Transferring knowledge across many streaming processes remains an uncharted territory in the existing literature and features unique characteristics: no labelled instance of the target domain, covariate shift of source and target domain,…

Machine Learning · Computer Science 2019-10-22 Mahardhika Pratama , Marcus de Carvalho , Renchunzi Xie , Edwin Lughofer , Jie Lu

Efficient management of storage resources in big data and cloud computing environments requires accurate identification of data's "cold" and "hot" states. Traditional methods, such as rule-based algorithms and early AI techniques, often…

Machine Learning · Computer Science 2024-11-25 Kai Lu , Siqi Zhao , Jiguang Wan

Locally caching contents at the network edge constitutes one of the most disruptive approaches in $5$G wireless networks. Reaping the benefits of edge caching hinges on solving a myriad of challenges such as how, what and when to…

Information Theory · Computer Science 2015-09-30 Ejder Baştuğ , Mehdi Bennis , Mérouane Debbah

An enormous and ever-growing volume of data is nowadays becoming available in a sequential fashion in various real-world applications. Learning in nonstationary environments constitutes a major challenge, and this problem becomes orders of…

Machine Learning · Computer Science 2020-09-28 Kleanthis Malialis , Christos G. Panayiotou , Marios M. Polycarpou

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

In online continual learning (CL), models trained on changing distributions easily forget previously learned knowledge and bias toward newly received tasks. To address this issue, we present Continual Bias Adaptor (CBA), a bi-level…

Machine Learning · Computer Science 2024-08-27 Quanziang Wang , Renzhen Wang , Yichen Wu , Xixi Jia , Minghao Zhou , Deyu Meng

Online hashing methods are efficient in learning the hash functions from the streaming data. However, when the hash functions change, the binary codes for the database have to be recomputed to guarantee the retrieval accuracy. Recomputing…

Data Structures and Algorithms · Computer Science 2019-12-05 Zhenyu Weng , Yuesheng Zhu

In many business settings, task-specific labeled data are scarce or costly to obtain, limiting supervised learning on a target task. A classical response is transfer learning (TL). Many TL works study how to transfer information from…

Machine Learning · Statistics 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Yohan Petetin

A crucial challenge in reinforcement learning is to reduce the number of interactions with the environment that an agent requires to master a given task. Transfer learning proposes to address this issue by re-using knowledge from previously…

Machine Learning · Computer Science 2023-04-28 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

Online learning via Bayes' theorem allows new data to be continuously integrated into an agent's current beliefs. However, a naive application of Bayesian methods in non stationary environments leads to slow adaptation and results in state…

Machine Learning · Computer Science 2022-02-09 Josue Nassar , Jennifer Brennan , Ben Evans , Kendall Lowrey

As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime.…

Machine Learning · Computer Science 2019-05-16 Yunhun Jang , Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci