English
Related papers

Related papers: Emerging from Ground: Addressing Intent Deviation …

200 papers

Deep reinforcement learning (DRL) is playing an increasingly important role in real-world applications. However, obtaining an optimally performing DRL agent for complex tasks, especially with sparse rewards, remains a significant challenge.…

Machine Learning · Computer Science 2024-06-07 Zelei Cheng , Xian Wu , Jiahao Yu , Sabrina Yang , Gang Wang , Xinyu Xing

Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale human-constructed supervision for post-training. Such supervision is costly to obtain,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Chaoran Xu , Yingmao Miao , Pengfei Zhang , Hao Dou , Lei Sun , Xiangxiang Chu

Large Language Models (LLMs) are increasingly being deployed as the reasoning engines for agentic AI systems, yet they exhibit a critical flaw: a rigid adherence to explicit rules that leads to decisions misaligned with human common sense…

Artificial Intelligence · Computer Science 2025-10-16 Imran Khan

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

Machine Learning · Computer Science 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Large language models (LLMs) generate outputs by utilizing extensive context, which often includes redundant information from prompts, retrieved passages, and interaction history. In critical applications, it is vital to identify which…

Computation and Language · Computer Science 2026-02-03 Poushali Sengupta , Shashi Raj Pandey , Sabita Maharjan , Frank Eliassen

Tool-calling agents are increasingly deployed in real-world customer-facing workflows. Yet most studies on tool-calling agents focus on idealized settings with general, fixed, and well-specified tasks. In real-world applications, user…

Computation and Language · Computer Science 2026-04-23 Ziyi Wang , Yuxuan Lu , Yimeng Zhang , Pei Chen , Ziwei Dong , Jing Huang , Jiri Gesi , Xianfeng Tang , Chen Luo , Qun Liu , Yisi Sang , Hanqing Lu , Manling Li , Jin Lai , Dakuo Wang

Instruction tuning has underscored the significant potential of large language models (LLMs) in producing more human controllable and effective outputs in various domains. In this work, we focus on the data selection problem for…

Machine Learning · Computer Science 2025-09-01 Yang Wu , Huayi Zhang , Yizheng Jiao , Lin Ma , Xiaozhong Liu , Jinhong Yu , Dongyu Zhang , Dezhi Yu , Wei Xu

Recent advances in large language models (LLMs) have demonstrated the effectiveness of Iterative Self-Improvement (ISI) techniques. However, continuous training on self-generated data leads to reduced output diversity, a limitation…

Computation and Language · Computer Science 2025-01-03 Yiwei Qin , Yixiu Liu , Pengfei Liu

Reinforcement Learning (RL) has made significant strides in enabling artificial agents to learn diverse behaviors. However, learning an effective policy often requires a large number of environment interactions. To mitigate sample…

Artificial Intelligence · Computer Science 2024-04-04 Yash Shukla , Tanushree Burman , Abhishek Kulkarni , Robert Wright , Alvaro Velasquez , Jivko Sinapov

Instruction tuning, a specialized technique to enhance large language model (LLM) performance via instruction datasets, relies heavily on the quality of employed data. Existing quality improvement methods alter instruction data through…

Computation and Language · Computer Science 2023-12-29 Yang Xu , Yongqiang Yao , Yufan Huang , Mengnan Qi , Maoquan Wang , Bin Gu , Neel Sundaresan

LLM-based user simulation is the primary mechanism for end-to-end agent evaluation, yet simulated users are poor proxies for real humans: unconstrained LLM defaults produce a Formalism Ceiling (style match rates of 6-8% against real users),…

Human-Computer Interaction · Computer Science 2026-05-21 Ming Zhu , Juntao Tan , Rithesh Murthy , Jielin Qiu , Liangwei Yang , Wenting Zhao , Silvio Savarese , Shelby Heinecke , Huan Wang

This paper introduces RISE, a robust individualized decision learning framework with sensitive variables, where sensitive variables are collectible data and important to the intervention decision, but their inclusion in decision making is…

Machine Learning · Computer Science 2022-11-15 Xiaoqing Tan , Zhengling Qi , Christopher W. Seymour , Lu Tang

The development of Vision-Language-Action (VLA) models has been significantly accelerated by pre-trained Vision-Language Models (VLMs). However, most existing end-to-end VLAs treat the VLM primarily as a multimodal encoder, directly mapping…

Robotics · Computer Science 2026-04-29 Yi Chen , Yuying Ge , Hui Zhou , Mingyu Ding , Yixiao Ge , Xihui Liu

Tool-using agent systems powered by large language models (LLMs) are increasingly deployed across web, app, operating-system, and transactional environments. Yet existing safety benchmarks still emphasize explicit risks, potentially…

Artificial Intelligence · Computer Science 2026-05-06 Zuoyu Zhang , Yancheng Zhu

Recent work on domain-specific reasoning with large language models (LLMs) often relies on training-intensive approaches that require parameter updates. While activation steering has emerged as a parameter efficient alternative, existing…

Artificial Intelligence · Computer Science 2026-01-21 Wencheng Ye , Xiaoyang Yuan , Yi Bin , Pengpeng Zeng , Hengyu Jin , Liang Peng , Heng Tao Shen

Recommender systems (RecSys) have become critical tools for enhancing user engagement by delivering personalized content across diverse digital platforms. Recent advancements in large language models (LLMs) demonstrate significant potential…

Information Retrieval · Computer Science 2025-10-16 Yi Zhang , Lili Xie , Ruihong Qiu , Jiajun Liu , Sen Wang

Despite the sustained scaling on model capacity and data acquisition, Vision-Language-Action (VLA) models remain brittle in contact-rich and dynamic manipulation tasks, where minor execution deviations can compound into failures. While…

Large language models (LLMs) achieve high performance on mathematical reasoning, but these results can be inflated by training data leakage or superficial pattern matching rather than genuine reasoning. To this end, an adversarial…

Computation and Language · Computer Science 2026-02-03 Xinyuan Li , Murong Xu , Wenbiao Tao , Hanlun Zhu , Yike Zhao , Jipeng Zhang , Yunshi Lan

Large language model (LLM)-based agents frequently generate seemingly coherent plans that fail upon execution due to infeasible actions, constraint violations, and compounding errors over extended horizons. PIVOT (Plan-Inspect-eVOlve…

Artificial Intelligence · Computer Science 2026-05-13 Tuo Zhang , Alin-Ionut Popa , Yan Xu , Rui Song , Dimitrios Dimitriadis

Intent detection, a critical component in task-oriented dialogue (TOD) systems, faces significant challenges in adapting to the rapid influx of integrable tools with complex interrelationships. Existing approaches, such as zero-shot…

Computation and Language · Computer Science 2025-04-22 Zihao Feng , Xiaoxue Wang , Ziwei Bai , Donghang Su , Bowen Wu , Qun Yu , Baoxun Wang