English
Related papers

Related papers: AgentTrek: Agent Trajectory Synthesis via Guiding …

200 papers

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies…

Software Engineering · Computer Science 2026-02-12 Adam AlSayyad , Kelvin Yuxiang Huang , Richik Pal

Autonomous agents powered by large language models (LLMs) have shown impressive capabilities in tool manipulation for complex task-solving. However, existing paradigms such as ReAct rely on sequential reasoning and execution, failing to…

Artificial Intelligence · Computer Science 2025-10-30 Jiaqi Wu , Qinlao Zhao , Zefeng Chen , Kai Qin , Yifei Zhao , Xueqian Wang , Yuhang Yao

While diffusion models generate high-fidelity video clips, transforming them into coherent storytelling engines remains challenging. Current agentic pipelines automate this via chained modules but suffer from semantic drift and cascading…

Mobile GUI agents can automate smartphone tasks by interacting directly with app interfaces, but how they should communicate with users during execution remains underexplored. Existing systems rely on two extremes: foreground execution,…

Human-Computer Interaction · Computer Science 2026-04-24 Jeonghyeon Kim , Byeongjun Joung , Junwon Lee , Joohyung Lee , Taehoon Min , Sunjae Lee

Agentic search has recently emerged as a powerful paradigm, where an agent interleaves multi-step reasoning with on-demand retrieval to solve complex questions. Despite its success, how to design a retriever for agentic search remains…

Information Retrieval · Computer Science 2026-01-22 Wenhan Liu , Xinyu Ma , Yutao Zhu , Yuchen Li , Daiting Shi , Dawei Yin , Zhicheng Dou

The surge in scientific publications challenges traditional review methods, demanding tools that integrate structured metadata with full-text analysis. Hybrid Retrieval Augmented Generation (RAG) systems, combining graph queries with vector…

GUI agents powered by vision-language models (VLMs) show promise in automating complex digital tasks. However, their effectiveness in real-world applications is often limited by scarce training data and the inherent complexity of these…

Computation and Language · Computer Science 2025-09-30 Ran Xu , Kaixin Ma , Wenhao Yu , Hongming Zhang , Joyce C. Ho , Carl Yang , Dong Yu

Trajectory data, capturing human actions and environmental states across various modalities, holds significant potential for enhancing AI agent capabilities, particularly in GUI environments. However, how to model the representation of…

Artificial Intelligence · Computer Science 2025-06-30 Xuan Zhang , Ziyan Jiang , Rui Meng , Yifei Leng , Zhenbang Xiao , Zora Zhiruo Wang , Yanyi Shang , Dehan Kong

Utilizing Graphic User Interface (GUI) for human-computer interaction is essential for accessing a wide range of digital tools. Recent advancements in Vision Language Models (VLMs) highlight the compelling potential to develop versatile…

Artificial Intelligence · Computer Science 2025-06-02 Wentong Chen , Junbo Cui , Jinyi Hu , Yujia Qin , Junjie Fang , Yue Zhao , Chongyi Wang , Jun Liu , Guirong Chen , Yupeng Huo , Yuan Yao , Yankai Lin , Zhiyuan Liu , Maosong Sun

In recent years, agentic workflows have been widely applied to solve complex human tasks. However, existing workflow construction still faces key challenges, including human-dependent workflow construction, the lack of graph-level execution…

Artificial Intelligence · Computer Science 2026-05-15 Mingda Zhang , Wenjin Liu , Tiesunlong Shen , Qika Lin , Rui Mao , Erik Cambria , Xiaoying Tang , Haoran Luo

Human mobility modeling is indispensable for diverse urban applications. However, existing data-driven methods often suffer from data scarcity, limiting their applicability in regions where historical trajectories are unavailable or…

Artificial Intelligence · Computer Science 2026-04-13 Chenjie Yang , Yutian Jiang , Anqi Liang , Wei Qi , Chenyu Wu , Junbo Zhang

The increasing adoption of agentic workflows across diverse domains brings a critical need to scalably and systematically evaluate the complex traces these systems generate. Current evaluation methods depend on manual, domain-specific human…

Artificial Intelligence · Computer Science 2025-06-25 Darshan Deshpande , Varun Gangal , Hersh Mehta , Jitin Krishnan , Anand Kannappan , Rebecca Qian

Generative models have substantially expanded video generation capabilities, yet practical thought-to-video creation remains a multi-stage, multi-modal, and decision-intensive process. However, existing tools either hide intermediate…

Multimedia · Computer Science 2026-02-10 Zhuoyun Zheng , Yu Dong , Gaorong Liang , Guan Li , Guihua Shan , Shiyu Cheng , Dong Tian , Jianlong Zhou , Jie Liang

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

Deep Research systems based on web agents have shown strong potential in solving complex information-seeking tasks, yet their search efficiency remains underexplored. We observe that many state-of-the-art open-source web agents rely on long…

Artificial Intelligence · Computer Science 2026-05-11 Junjie Wang , Zequn Xie , Dan Yang , Jie Feng , Yue Shen , Duolin Sun , Meixiu Long , Yihan Jiao , Zhehao Tan , Jian Wang , Peng Wei , Jinjie Gu

The rapid development of large language and multimodal models has sparked significant interest in using proprietary models, such as GPT-4o, to develop autonomous agents capable of handling real-world scenarios like web navigation. Although…

Computation and Language · Computer Science 2024-10-28 Hongliang He , Wenlin Yao , Kaixin Ma , Wenhao Yu , Hongming Zhang , Tianqing Fang , Zhenzhong Lan , Dong Yu

Software maintainability critically depends on high-quality requirements descriptions and explicit traceability between requirements and code. Although automated code summarization (ACS) and requirements traceability (RT) techniques have…

Software Engineering · Computer Science 2025-09-16 Dongming Jin , Zhi Jin , Yiran Zhang , Zheng Fang , Linyu Li , Yuanpeng He , Xiaohong Chen , Weisong Sun

Reinforcement learning (RL) agent development traditionally requires substantial expertise and iterative effort, often leading to high failure rates and limited accessibility. This paper introduces Agent$^2$, an LLM-driven…

Artificial Intelligence · Computer Science 2025-10-01 Yuan Wei , Xiaohan Shan , Ran Miao , Jianmin Li

Recent agentic frameworks for 3D scene synthesis have advanced realism and diversity by integrating heterogeneous generation and editing tools. These tools are organized into workflows orchestrated by an off-the-shelf LLM. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yun He , Kelin Yu , Matthias Zwicker

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer