English
Related papers

Related papers: ORIS: Online Active Learning Using Reinforcement L…

200 papers

Classification models are a fundamental component of physical-asset management technologies such as structural health monitoring (SHM) systems and digital twins. Previous work introduced risk-based active learning, an online approach for…

Machine Learning · Computer Science 2022-07-13 Aidan J. Hughes , Lawrence A. Bull , Paul Gardner , Nikolaos Dervilis , Keith Worden

The state-of-the-art online learning models generally conduct a single online gradient descent when a new sample arrives and thus suffer from suboptimal model weights. To this end, we introduce an online broad learning system framework with…

Machine Learning · Computer Science 2025-12-09 Chunyu Lei , Guang-Ze Chen , C. L. Philip Chen , Tong Zhang

The proliferation of automated data collection schemes and the advances in sensorics are increasing the amount of data we are able to monitor in real-time. However, given the high annotation costs and the time required by quality…

Machine Learning · Statistics 2023-07-17 Davide Cacciarelli , Murat Kulahci , John Sølve Tyssedal

An ever increasing volume of data is nowadays becoming available in a streaming manner in many application areas, such as, in critical infrastructure systems, finance and banking, security and crime and web analytics. To meet this new…

Machine Learning · Computer Science 2020-10-06 Kleanthis Malialis , Christos G. Panayiotou , Marios M. Polycarpou

Learning under a continuously changing data distribution with incorrect labels is a desirable real-world problem yet challenging. A large body of continual learning (CL) methods, however, assumes data streams with clean labels, and online…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jihwan Bang , Hyunseo Koh , Seulki Park , Hwanjun Song , Jung-Woo Ha , Jonghyun Choi

Label efficiency has become an increasingly important objective in deep learning applications. Active learning aims to reduce the number of labeled examples needed to train deep networks, but the empirical performance of active learning…

Machine Learning · Computer Science 2023-12-19 Jifan Zhang , Shuai Shao , Saurabh Verma , Robert Nowak

Online learning, where feature spaces can change over time, offers a flexible learning paradigm that has attracted considerable attention. However, it still faces three significant challenges. First, the heterogeneity of real-world data…

Machine Learning · Computer Science 2025-07-17 Shengda Zhuo , Di Wu , Yi He , Shuqiang Huang , Xindong Wu

While reinforcement learning (RL) has shown promising performance, its sample complexity continues to be a substantial hurdle, restricting its broader application across a variety of domains. Imitation learning (IL) utilizes oracles to…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Takuma Yoneda , Rick L. Stevens , Matthew R. Walter , Yuxin Chen

Humans have the ability to reuse previously learned policies to solve new tasks quickly, and reinforcement learning (RL) agents can do the same by transferring knowledge from source policies to a related target task. Transfer RL methods can…

Machine Learning · Computer Science 2023-08-16 Siyuan Li , Hao Li , Jin Zhang , Zhen Wang , Peng Liu , Chongjie Zhang

In recent years, enterprises have been targeted by advanced adversaries who leverage creative ways to infiltrate their systems and move laterally to gain access to critical data. One increasingly common evasive method is to hide the…

Cryptography and Security · Computer Science 2021-12-01 Talha Ongun , Jack W. Stokes , Jonathan Bar Or , Ke Tian , Farid Tajaddodianfar , Joshua Neil , Christian Seifert , Alina Oprea , John C. Platt

Active learning (AL) aims to reduce annotation costs while maximizing model performance by iteratively selecting valuable instances. While foundation models have made it easier to identify these instances, existing selection strategies…

Machine Learning · Computer Science 2026-03-16 Denis Huseljic , Paul Hahn , Marek Herde , Christoph Sandrock , Bernhard Sick

Active Learning (AL) is a powerful tool for learning with less labeled data, in particular, for specialized domains, like legal documents, where unlabeled data is abundant, but the annotation requires domain expertise and is thus expensive.…

Computation and Language · Computer Science 2022-11-16 Sepideh Mamooler , Rémi Lebret , Stéphane Massonnet , Karl Aberer

Model-based offline Reinforcement Learning (RL) constructs environment models from offline datasets to perform conservative policy optimization. Existing approaches focus on learning state transitions through ensemble models, rollouting…

Machine Learning · Computer Science 2025-03-27 Hongye Cao , Fan Feng , Jing Huo , Shangdong Yang , Meng Fang , Tianpei Yang , Yang Gao

Reinforcement learning (RL) using foundation models for policy approximations in multi-turn tasks remains challenging. We identify two main limitations related to sparse reward settings and policy gradient updates, based on which we…

Machine Learning · Computer Science 2025-11-14 Georgios Papoudakis , Thomas Coste , Jianye Hao , Jun Wang , Kun Shao

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

Machine Learning · Computer Science 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

In this paper, we explore how to efficiently combine crowdsourcing and machine intelligence for the problem of document screening, where we need to screen documents with a set of machine-learning filters. Specifically, we focus on building…

Information Retrieval · Computer Science 2020-12-07 Evgeny Krivosheev , Burcu Sayin , Alessandro Bozzon , Zoltán Szlávik

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

Online optimization of resource management for large-scale data centers and infrastructures to meet dynamic capacity reservation demands and various practical constraints (e.g., feasibility and robustness) is a very challenging problem.…

Networking and Internet Architecture · Computer Science 2024-10-18 Chang-Lin Chen , Hanhan Zhou , Jiayu Chen , Mohammad Pedramfar , Tian Lan , Zheqing Zhu , Chi Zhou , Pol Mauri Ruiz , Neeraj Kumar , Hongbo Dong , Vaneet Aggarwal

Medical image analysis requires substantial labeled data for model training, yet expert annotation is expensive and time-consuming. Active learning (AL) addresses this challenge by strategically selecting the most informative samples for…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Ifrat Ikhtear Uddin , Longwei Wang , Xiao Qin , Yang Zhou , KC Santosh

An active learning (AL) algorithm seeks to construct an effective classifier with a minimal number of labeled examples in a bootstrapping manner. While standard AL heuristics, such as selecting those points for annotation for which a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ishani Mondal , Debasis Ganguly