English
Related papers

Related papers: Help Without Being Asked: A Deployed Proactive Age…

200 papers

We present PORTAL, a novel framework for developing artificial intelligence agents capable of playing thousands of 3D video games through language-guided policy generation. By transforming decision-making problems into language modeling…

Machine Learning · Computer Science 2025-03-18 Zhongwen Xu , Xianliang Wang , Siyi Li , Tao Yu , Liang Wang , Qiang Fu , Wei Yang

In this paper, we extended the method proposed in [21] to enable humans to interact naturally with autonomous agents through vocal and textual conversations. Our extended method exploits the inherent capabilities of pre-trained large…

Robotics · Computer Science 2024-12-31 Linus Nwankwo , Elmar Rueckert

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

Agentic AI coding systems can inspect repositories, plan implementation steps, edit files, call tools, run tests, and submit pull requests. These capabilities make software and hardware development faster in some settings, but current…

Software Engineering · Computer Science 2026-05-21 Christopher Koch

As multi-agent systems powered by Large Language Models (LLMs) are increasingly adopted in real-world workflows, users with diverse technical backgrounds are now building and refining their own agentic processes. However, these systems can…

Human-Computer Interaction · Computer Science 2026-03-05 Xinru Wang , Ming Yin , Eunyee Koh , Mustafa Doga Dogan

This paper presents a Large Language Model (LLM) based conversational agent system designed to enhance human-machine collaboration in Machine Learning Operations (MLOps). We introduce the Swarm Agent, an extensible architecture that…

Artificial Intelligence · Computer Science 2025-11-11 George Fatouros , Georgios Makridis , George Kousiouris , John Soldatos , Anargyros Tsadimas , Dimosthenis Kyriazis

Current AI agent frameworks commit early to a single interaction protocol, a fixed tool integration strategy, and static user models, limiting their deployment across diverse interaction paradigms. To address these constraints, we introduce…

Artificial Intelligence · Computer Science 2026-03-25 Alfred Shen , Aaron Shen

Recent multimodal large language models (MLLMs) achieve strong performance on reactive question answering, but real-world streaming assistants require proactive reasoning over continuous visual inputs. Existing benchmarks mainly study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jinzhao Li , Yinuo Chen , Wenxuan Song , Yijia Lei , Yichi Zhang , Honglei Yan , Panwang Pan , Miao Liu

Simulation agents are essential for designing and testing systems that interact with humans, such as autonomous vehicles (AVs). These agents serve various purposes, from benchmarking AV performance to stress-testing system limits, but all…

Artificial Intelligence · Computer Science 2025-05-21 Daphne Cornelisse , Aarav Pandya , Kevin Joseph , Joseph Suárez , Eugene Vinitsky

In customer contact centers, human agents often struggle with long average handling times (AHT) due to the need to manually interpret queries and retrieve relevant knowledge base (KB) articles. While retrieval augmented generation (RAG)…

Computation and Language · Computer Science 2024-10-15 Garima Agrawal , Sashank Gummuluri , Cosimo Spera

Retrieval Augmented Generation (RAG) systems have seen huge popularity in augmenting Large-Language Model (LLM) outputs with domain specific and time sensitive data. Very recently a shift is happening from simple RAG setups that query a…

Information Retrieval · Computer Science 2024-03-05 Tristan Kenneweg , Philip Kenneweg , Barbara Hammer

Task-oriented proactive dialogue agents play a pivotal role in recruitment, particularly for steering conversations towards specific business outcomes, such as acquiring social-media contacts for private-channel conversion. Although…

Artificial Intelligence · Computer Science 2026-01-09 Zhiyong Cao , Dunqiang Liu , Qi Dai , Haojun Xu , Huaiyan Xu , Huan He , Yafei Liu , Siyuan Liu , XiaoLin Lin , Ke Ma , Ruqian Shi , Sijia Yao , Hao Wang , Sicheng Zhou

This paper introduces the task of product demand clarification within an e-commercial scenario, where the user commences the conversation with ambiguous queries and the task-oriented agent is designed to achieve more accurate and tailored…

Information Retrieval · Computer Science 2024-07-02 Jingheng Ye , Yong Jiang , Xiaobin Wang , Yinghui Li , Yangning Li , Hai-Tao Zheng , Pengjun Xie , Fei Huang

A voice AI agent that blends seamlessly into daily life would interact with humans in an autonomous, real-time, and emotionally expressive manner. Rather than merely reacting to commands, it would continuously listen, reason, and respond…

Artificial Intelligence · Computer Science 2025-05-06 Yemin Shi , Yu Shu , Siwei Dong , Guangyi Liu , Jaward Sesay , Jingwen Li , Zhiting Hu

There is a growing demand for agentic AI technologies for a range of downstream applications like customer service and personal assistants. For applications where the agent needs to interact with a person, real-time low-latency…

Large language models (LLMs) are increasingly deployed as AI agents that operate in short reasoning-action loops, interleaving model computation with external calls. Unlike traditional chat applications, these agentic workloads require…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-12 Yuning Zhang , Yan Yan , Nan Yang , Dong Yuan

With the continuous evolution of Large Language Models (LLMs), LLM-based agents have advanced beyond passive chatbots to become autonomous cyber entities capable of performing complex tasks, including web browsing, malicious code and…

Networking and Internet Architecture · Computer Science 2025-05-28 Minrui Xu , Jiani Fan , Xinyu Huang , Conghao Zhou , Jiawen Kang , Dusit Niyato , Shiwen Mao , Zhu Han , Xuemin , Shen , Kwok-Yan Lam

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

While end-to-end neural conversation models have led to promising advances in reducing hand-crafted features and errors induced by the traditional complex system architecture, they typically require an enormous amount of data due to the…

Computation and Language · Computer Science 2018-01-10 Sungjin Lee

As large language models (LLM)-driven agents transition from isolated task solvers to persistent digital entities, the emergence of the Agentic Web, an ecosystem where heterogeneous agents autonomously interact and co-evolve, marks a…