English
Related papers

Related papers: Human-in-the-Loop Control of Objective Drift in LL…

200 papers

As Artificial Intelligence (AI) technologies continue to advance, protecting human autonomy and promoting ethical decision-making are essential to fostering trust and accountability. Human agency (the capacity of individuals to make…

Computers and Society · Computer Science 2025-10-13 Laxmiraju Kandikatla , Branislav Radeljic

Real-time multi-robot coordination in hazardous and adversarial environments requires fast, reliable adaptation to dynamic threats. While Large Language Models (LLMs) offer strong high-level reasoning capabilities, the lack of safety…

Robotics · Computer Science 2025-11-19 Yuwei Wu , Yuezhan Tao , Peihan Li , Guangyao Shi , Gaurav S. Sukhatme , Vijay Kumar , Lifeng Zhou

We approach the problem of learning by watching humans in the wild. While traditional approaches in Imitation and Reinforcement Learning are promising for learning in the real world, they are either sample inefficient or are constrained to…

Robotics · Computer Science 2022-07-20 Shikhar Bahl , Abhinav Gupta , Deepak Pathak

Personalized alignments for individual users have been a long-standing goal in large language models (LLMs). We introduce Drift, a novel framework that personalizes LLMs at decoding time with implicit user preferences. Traditional…

Computation and Language · Computer Science 2025-05-09 Minbeom Kim , Kang-il Lee , Seongho Joo , Hwaran Lee , Thibaut Thonet , Kyomin Jung

Autonomous vehicles must remain safe and effective when encountering rare long-tailed scenarios or cyber-physical intrusions during driving. We present RAIL, a risk-aware human-in-the-loop framework that turns heterogeneous runtime signals…

Artificial Intelligence · Computer Science 2026-01-21 Dawood Wasif , Terrence J. Moore , Seunghyun Yoon , Hyuk Lim , Dan Dongseong Kim , Frederica F. Nelson , Jin-Hee Cho

Large Language Models (LLMs) excel at single-turn tasks such as instruction following and summarization, yet real-world deployments require sustained multi-turn interactions where user goals and conversational context persist and evolve. A…

Computation and Language · Computer Science 2025-11-25 Vardhan Dongre , Ryan A. Rossi , Viet Dac Lai , David Seunghyun Yoon , Dilek Hakkani-Tür , Trung Bui

Foundation models, including large language models (LLMs), are increasingly used for human-in-the-loop (HITL) cyber-physical systems (CPS) because foundation model-based AI agents can potentially interact with both the physical environments…

Artificial Intelligence · Computer Science 2026-04-14 Deeksha Prahlad , Daniel Fan , Hokeun Kim

Large language models (LLMs) have created new opportunities to assist teachers and support student learning. While researchers have explored various prompt engineering approaches in educational contexts, the degree to which these approaches…

Computation and Language · Computer Science 2025-08-15 Clayton Cohn , Ashwin T S , Naveeduddin Mohammed , Gautam Biswas

Deep learning is increasingly viewed as a dynamical process in parameter space, yet many existing theories still treat training as a closed optimization system. This view is limited for real-world AI, where models operate under uncertainty,…

Machine Learning · Computer Science 2026-05-25 Kim Phuc Tran

Aligning large language models (LLMs) with human intentions has become a critical task for safely deploying models in real-world systems. While existing alignment approaches have seen empirical success, theoretically understanding how these…

Machine Learning · Computer Science 2024-08-08 Shawn Im , Yixuan Li

Large Language Models (LLMs) represent a leap in artificial intelligence, excelling in tasks using human language(s). Although the main focus of general-purpose LLMs is not code generation, they have shown promising results in the domain.…

Software Engineering · Computer Science 2024-01-30 Sanka Rasnayaka , Guanlin Wang , Ridwan Shariffdeen , Ganesh Neelakanta Iyer

Real-world applications of large language models (LLMs) in computational social science (CSS) tasks primarily depend on the effectiveness of instruction tuning (IT) or in-context learning (ICL). While IT has shown highly effective at…

Computation and Language · Computer Science 2024-09-24 Taihang Wang , Xiaoman Xu , Yimin Wang , Ye Jiang

Implementing systems based on Machine Learning to detect fraud and other Non-Technical Losses (NTL) is challenging: the data available is biased, and the algorithms currently used are black-boxes that cannot be either easily trusted or…

Machine Learning · Computer Science 2021-08-18 Bernat Coma-Puig , Josep Carmona

LLMs have demonstrated proficiency in contextualizing their outputs using human input, often matching or beating human-level performance on a variety of tasks. However, LLMs have not yet been used to characterize synergistic learning in…

Computation and Language · Computer Science 2024-07-03 Clayton Cohn , Caitlin Snyder , Justin Montenegro , Gautam Biswas

Despite growing interest in using large language models (LLMs) to automate annotation, their effectiveness in complex, nuanced, and multi-dimensional labelling tasks remains relatively underexplored. This study focuses on annotation for the…

Information Retrieval · Computer Science 2025-07-02 Leila Tavakoli , Hamed Zamani

The distribution gap between training datasets and data encountered in production is well acknowledged. Training datasets are often constructed over a fixed period of time and by carefully curating the data to be labeled. Thus, training…

We develop an algorithm for the motion and task planning of a system comprised of multiple robots and unactuated objects under tasks expressed as Linear Temporal Logic (LTL) constraints. The robots and objects evolve subject to uncertain…

Systems and Control · Electrical Eng. & Systems 2022-04-26 Christos K. Verginis , Yiannis Kantaros , Dimos V. Dimarogonas

Recent advancements in machine learning provide methods to train autonomous agents capable of handling the increasing complexity of sequential decision-making in robotics. Imitation Learning (IL) is a prominent approach, where agents learn…

Robotics · Computer Science 2025-05-01 Jonas Werner , Kun Chu , Cornelius Weber , Stefan Wermter

We study the problem of troubleshooting machine learning systems that rely on analytical pipelines of distinct components. Understanding and fixing errors that arise in such integrative systems is difficult as failures can occur at multiple…

Machine Learning · Computer Science 2016-11-28 Besmira Nushi , Ece Kamar , Eric Horvitz , Donald Kossmann

Recently, Large Language Models (LLMs)-based multi-agent paradigms for software engineering are introduced to automatically resolve software development tasks (e.g., from a given issue to source code). However, existing work is evaluated…