English
Related papers

Related papers: Reasoner for Real-World Event Detection: Scaling R…

200 papers

One practical challenge in reinforcement learning (RL) is how to make quick adaptations when faced with new environments. In this paper, we propose a principled framework for adaptive RL, called \textit{AdaRL}, that adapts reliably and…

Machine Learning · Computer Science 2022-03-16 Biwei Huang , Fan Feng , Chaochao Lu , Sara Magliacane , Kun Zhang

Current deep regression models usually learn in a point-wise way that treats each sample as an independent input, neglecting the relative ordering among different data. Consequently, the regression model could neglect the data's…

Machine Learning · Computer Science 2025-02-11 Fuhang Liang , Rucong Xu , Deng Lin

Anomaly detection plays a critical role in Autonomous Vehicles (AVs) by identifying unusual behaviors through perception systems that could compromise safety and lead to hazardous situations. Current approaches, which often rely on…

Artificial Intelligence · Computer Science 2025-07-08 Ashish Bastola , Mert D. Pesé , Long Cheng , Jonathon Smereka , Abolfazl Razi

We propose an adversarial deep reinforcement learning (ADRL) algorithm for high-dimensional stochastic control problems. Inspired by the information relaxation duality, ADRL reformulates the control problem as a min-max optimization between…

Optimization and Control · Mathematics 2025-07-03 Nan Chen , Mengzhou Liu , Xiaoyan Wang , Nanyi Zhang

Large language models (LLMs) demonstrate strong performance in math reasoning benchmarks, but their performance varies inconsistently across problems with varying levels of difficulty. This paper describes Adaptive Multi-Expert Reasoning…

Computation and Language · Computer Science 2026-04-14 Mohamed Ehab , Ali Hamdi

Exfiltration of data via email is a serious cybersecurity threat for many organizations. Detecting data exfiltration (anomaly) patterns typically requires labeling, most often done by a human annotator, to reduce the high number of false…

Machine Learning · Computer Science 2023-07-19 Jaturong Kongmanee , Mark Chignell , Khilan Jerath , Abhay Raman

Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. In practice, RL progress often…

Artificial Intelligence · Computer Science 2026-05-05 Caijun Xu , Changyi Xiao , Zhongyuan Peng , Xinrun Wang , Yixin Cao

The open world is inherently dynamic, characterized by ever-evolving concepts and distributions. Continual learning (CL) in this dynamic open-world environment presents a significant challenge in effectively generalizing to unseen test-time…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Youngeun Kim , Jun Fang , Qin Zhang , Zhaowei Cai , Yantao Shen , Rahul Duggal , Dripta S. Raychaudhuri , Zhuowen Tu , Yifan Xing , Onkar Dabeer

Out-of-distribution (OOD) detection is a critical task for the safe deployment of machine learning models in the real world. Existing prototype-based representation learning methods have demonstrated exceptional performance. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Ningkang Peng , JiuTao Zhou , Yuhao Zhang , Xiaoqian Peng , Qianfeng Yu , Linjing Qian , Tingyu Lu , Yi Chen , Yanhui Gu

This work proposes a novel technique Augmented Reinforcement Learning framework for the improvement of decision-making capabilities of machine learning models. The introduction of agents as external overseers checks on model decisions. The…

Machine Learning · Computer Science 2025-08-05 Sandesh Kumar Singh

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jiawei Zhan , Jun Liu , Jinlong Peng , Xiaochen Chen , Bin-Bin Gao , Yong Liu , Chengjie Wang

While model-based reinforcement learning (MBRL) improves sample efficiency by learning world models from raw observations, existing methods struggle to generalize across structurally similar scenes and remain vulnerable to spurious…

Machine Learning · Computer Science 2026-01-28 Zhao-Han Peng , Shaohui Li , Zhi Li , Shulan Ruan , Yu Liu , You He

While recent continual learning methods largely alleviate the catastrophic problem on toy-sized datasets, some issues remain to be tackled to apply them to real-world problem domains. First, a continual learning model should effectively…

Machine Learning · Computer Science 2020-02-18 Jaehong Yoon , Saehoon Kim , Eunho Yang , Sung Ju Hwang

Model-based offline reinforcement learning (RL) has emerged as a promising approach for recommender systems, enabling effective policy learning by interacting with frozen world models. However, the reward functions in these world models,…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Xuwei Xu , Jiajun Liu , Sen Wang

In the ever-changing and intricate landscape of financial markets, portfolio optimisation remains a formidable challenge for investors and asset managers. Conventional methods often struggle to capture the complex dynamics of market…

Machine Learning · Statistics 2025-10-09 Himanshu Choudhary , Arishi Orra , Manoj Thakur

Out-of-Distribution (OOD) detection is crucial for the reliable deployment of machine learning models in-the-wild, enabling accurate identification of test samples that differ from the training data distribution. Existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Ruisong Han , Zongbo Han , Jiahao Zhang , Mingyue Cheng , Changqing Zhang

Domain incremental learning (DIL) poses a significant challenge in real-world scenarios, as models need to be sequentially trained on diverse domains over time, all the while avoiding catastrophic forgetting. Mitigating representation…

Machine Learning · Computer Science 2024-06-25 Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

Reinforcement Learning (RL) has shown remarkable success in enhancing the reasoning capabilities of Large Language Models (LLMs). Process-Supervised RL (PSRL) has emerged as a more effective paradigm compared to outcome-based RL. However,…

Active learning for sentence understanding attempts to reduce the annotation cost by identifying the most informative examples. Common methods for active learning use either uncertainty or diversity sampling in the pool-based scenario. In…

Computation and Language · Computer Science 2022-10-28 Hanshan Zhang , Zhen Zhang , Hongfei Jiang , Yang Song

With the increasing presence of automated vehicles on open roads under driver supervision, disengagement cases are becoming more prevalent. While some data-driven planning systems attempt to directly utilize these disengagement cases for…

Robotics · Computer Science 2025-06-23 Weitao Zhou , Bo Zhang , Zhong Cao , Xiang Li , Qian Cheng , Chunyang Liu , Yaqin Zhang , Diange Yang