English
Related papers

Related papers: Corpus-Level End-to-End Exploration for Interactiv…

200 papers

Passage retrieval is a fundamental task in many information systems, such as web search and question answering, where both efficiency and effectiveness are critical concerns. In recent years, neural retrievers based on pre-trained language…

Information Retrieval · Computer Science 2024-03-21 Qian Dong , Yiding Liu , Qingyao Ai , Haitao Li , Shuaiqiang Wang , Yiqun Liu , Dawei Yin , Shaoping Ma

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

End-to-end question answering (QA) requires both information retrieval (IR) over a large document collection and machine reading comprehension (MRC) on the retrieved passages. Recent work has successfully trained neural IR systems using…

Computation and Language · Computer Science 2020-12-03 Revanth Gangi Reddy , Bhavani Iyer , Md Arafat Sultan , Rong Zhang , Avi Sil , Vittorio Castelli , Radu Florian , Salim Roukos

End-to-end neural TTS has achieved superior performance on reading style speech synthesis. However, it's still a challenge to build a high-quality conversational TTS due to the limitations of the corpus and modeling capability. This study…

Sound · Computer Science 2020-11-17 Haohan Guo , Shaofei Zhang , Frank K. Soong , Lei He , Lei Xie

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S…

Artificial Intelligence · Computer Science 2024-10-11 Saaket Agashe , Jiuzhou Han , Shuyu Gan , Jiachen Yang , Ang Li , Xin Eric Wang

While recent advances in reasoning models have demonstrated cognitive behaviors through reinforcement learning, existing approaches struggle to invoke deep reasoning capabilities in multi-turn agents with long-horizon interactions. We…

Computation and Language · Computer Science 2025-10-10 Qiaoyu Tang , Hao Xiang , Le Yu , Bowen Yu , Yaojie Lu , Xianpei Han , Le Sun , WenJuan Zhang , Pengbo Wang , Shixuan Liu , Zhenru Zhang , Jianhong Tu , Hongyu Lin , Junyang Lin

Exploring unknown environments efficiently is a fundamental challenge in unsupervised goal-conditioned reinforcement learning. While selecting exploratory goals at the frontier of previously explored states is an effective strategy, the…

Machine Learning · Computer Science 2024-11-05 Yuanlin Duan , Guofeng Cui , He Zhu

We present a system that allows life-science researchers to search a linguistically annotated corpus of scientific texts using patterns over dependency graphs, as well as using patterns over token sequences and a powerful variant of boolean…

Computation and Language · Computer Science 2020-06-09 Hillel Taub-Tabib , Micah Shlain , Shoval Sadde , Dan Lahav , Matan Eyal , Yaara Cohen , Yoav Goldberg

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Computer use agents represent an emerging area in artificial intelligence, aiming to operate computers autonomously to fulfill user tasks, attracting significant attention from both industry and academia. However, the performance of…

Artificial Intelligence · Computer Science 2026-01-23 Yuhao Cheng , Liang Tang , Shuxian Li , Yukang Huo , Tiaonan Duan , Kaer Huang , Yanzhe Jing , Yiqiang Yan

Collaborative multi-agent exploration of unknown environments is crucial for search and rescue operations. Effective real-world deployment must address challenges such as limited inter-agent communication and static and dynamic obstacles.…

Robotics · Computer Science 2024-12-31 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

In computer animation, driving a simulated character with lifelike motion is challenging. Current generative models, though able to generalize to diverse motions, often pose challenges to the responsiveness of end-user control. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Yuxuan Mu , Shihao Zou , Kangning Yin , Zheng Tian , Li Cheng , Weinan Zhang , Jun Wang

Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency,…

Information Retrieval · Computer Science 2021-08-20 Hongyin Tang , Xingwu Sun , Beihong Jin , Jingang Wang , Fuzheng Zhang , Wei Wu

When users work with AI agents, they form conscious or subconscious expectations of them. Meeting user expectations is crucial for such agents to engage in successful interactions and teaming. However, users may form expectations of an…

Artificial Intelligence · Computer Science 2025-09-26 Akkamahadevi Hanni , Jonathan Montaño , Yu Zhang

Reading comprehension models are based on recurrent neural networks that sequentially process the document tokens. As interest turns to answering more complex questions over longer documents, sequential reading of large portions of text…

Computation and Language · Computer Science 2018-09-11 Mor Geva , Jonathan Berant

Text analytics has traditionally required specialized knowledge in Natural Language Processing (NLP) or text analysis, which presents a barrier for entry-level analysts. Recent advances in large language models (LLMs) have changed the…

Computation and Language · Computer Science 2026-05-11 Sam Yu-Te Lee , Chenyang Ji , Shicheng Wen , Lifu Huang , Dongyu Liu , Kwan-Liu Ma

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

Machine Learning · Computer Science 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine

Large language model agents are becoming increasingly capable at web-centric tasks such as information retrieval, complex reasoning. These emerging capabilities have given rise to surge research interests in developing LLM agent for…

Computation and Language · Computer Science 2026-04-02 Yu Li , Lehui Li , Lin Chen , Qingmin Liao , Fengli Xu , Yong Li