English
Related papers

Related papers: Conflict-Aware Active Automata Learning (Extended …

200 papers

Active Learning (AL) has emerged as a powerful approach for minimizing labeling costs by selectively sampling the most informative data for neural network model development. Effective AL for large-scale vision-language models necessitates…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Athmanarayanan Lakshmi Narayanan , Amrutha Machireddy , Ranganath Krishnan

Real-world digital environments are highly diverse and dynamic. These characteristics cause agents to frequently encounter unseen environments and distribution shifts, making continual learning in such environments essential for…

Computation and Language · Computer Science 2026-05-12 Tianci Xue , Zeyi Liao , Tianneng Shi , Zilu Wang , Kai Zhang , Dawn Song , Yu Su , Huan Sun

When facing the problem of autonomously learning multiple tasks with reinforcement learning systems, researchers typically focus on solutions where just one parametrised policy per task is sufficient to solve them. However, in complex…

Chain-of-Thought (CoT) monitoring, in which automated systems monitor the CoT of an LLM, is a promising approach for effectively overseeing AI systems. However, the extent to which a model's CoT helps us oversee the model - the…

Machine Learning · Computer Science 2026-04-01 Max Kaufmann , David Lindner , Roland S. Zimmermann , and Rohin Shah

The wide adoption of Machine Learning technologies has created a rapidly growing demand for people who can train ML models. Some advocated the term "machine teacher" to refer to the role of people who inject domain knowledge into ML models.…

Human-Computer Interaction · Computer Science 2020-10-01 Bhavya Ghai , Q. Vera Liao , Yunfeng Zhang , Rachel Bellamy , Klaus Mueller

Ensuring safety in dynamic multi-agent systems is challenging due to limited information about the other agents. Control Barrier Functions (CBFs) are showing promise for safety assurance but current methods make strong assumptions about…

Robotics · Computer Science 2023-10-05 Luigi Berducci , Shuo Yang , Rahul Mangharam , Radu Grosu

Collaborative multi-agent reinforcement learning has rapidly evolved, offering state-of-the-art algorithms for real-world applications, including sensitive domains. However, a key challenge to its widespread adoption is the lack of a…

Machine Learning · Computer Science 2026-01-22 Amine Andam , Jamal Bentahar , Mustapha Hedabou

A major challenge in the Deep RL (DRL) community is to train agents able to generalize over unseen situations, which is often approached by training them on a diversity of tasks (or environments). A powerful method to foster diversity is to…

Machine Learning · Computer Science 2020-04-08 Rémy Portelas , Katja Hofmann , Pierre-Yves Oudeyer

Compositional automata learning is attracting attention as an analysis technique for complex black-box systems. It exploits a target system's internal compositional structure to reduce complexity. In this paper, we identify system…

Formal Languages and Automata Theory · Computer Science 2025-08-07 Hiroya Fujinami , Masaki Waga , Jie An , Kohei Suenaga , Nayuta Yanagisawa , Hiroki Iseri , Ichiro Hasuo

Active learning agents typically employ a query selection algorithm which solely considers the agent's learning objectives. However, this may be insufficient in more realistic human domains. This work uses imitation learning to enable an…

Machine Learning · Computer Science 2019-07-02 Kalesha Bullard , Yannick Schroecker , Sonia Chernova

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

In this paper, we introduce Adversarial-and-attention Network (A3Net) for Machine Reading Comprehension. This model extends existing approaches from two perspectives. First, adversarial training is applied to several target variables within…

Computation and Language · Computer Science 2018-09-05 Jiuniu Wang , Xingyu Fu , Guangluan Xu , Yirong Wu , Ziyan Chen , Yang Wei , Li Jin

Many multi-agent reinforcement learning (MARL) algorithms are trained in fixed simulation environments, making them brittle when deployed in real-world scenarios with more complex and uncertain conditions. Contextual MARL (cMARL) addresses…

Machine Learning · Computer Science 2025-08-29 Anirudh Satheesh , Keenan Powell , Hua Wei

Detecting abnormal events in real-world customer service dialogues is highly challenging due to the complexity of business data and the dynamic nature of customer interactions. Moreover, models must demonstrate strong out-of-domain (OOD)…

Machine Learning · Computer Science 2025-07-03 Xiaoyun Zhang , Jingqing Ruan , Xing Ma , Yawen Zhu , Jiansong Chen , Ke Zeng , Xunliang Cai

Large language models (LLMs) are widely used for tutoring, feedback generation, and content creation, but their broad pretraining makes them hard to constrain and poor substitutes for controllable learners. Educational systems often require…

Computation and Language · Computer Science 2026-05-11 Hyeongdon Moon , Carolyn Rosé , John Stamper

We present $L^{\#}$, a new and simple approach to active automata learning. Instead of focusing on equivalence of observations, like the $L^{\ast}$ algorithm and its descendants, $L^{\#}$ takes a different perspective: it tries to establish…

Formal Languages and Automata Theory · Computer Science 2022-01-28 Frits Vaandrager , Bharat Garhewal , Jurriaan Rot , Thorsten Wißmann

The advent of autonomous vehicles (AVs) alongside human-driven vehicles (HVs) has ushered in an era of mixed traffic flow, presenting a significant challenge: the intricate interaction between these entities within complex driving…

Robotics · Computer Science 2023-09-19 Jiaqi Liu , Donghao Zhou , Peng Hang , Ying Ni , Jian Sun

Clinical settings are often characterized by abundant unlabelled data and limited labelled data. This is typically driven by the high burden placed on oracles (e.g., physicians) to provide annotations. One way to mitigate this burden is via…

Machine Learning · Computer Science 2022-05-19 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Active learning has emerged as a promising approach to reduce the substantial annotation burden in 3D object detection tasks, spurring several initiatives in outdoor environments. However, its application in indoor environments remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiangyi Wang , Na Zhao

Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimized models are…

Computation and Language · Computer Science 2024-05-27 Suyoung Kim , Jiyeon Hwang , Ho-Young Jung