English
Related papers

Related papers: daVinci-Agency: Unlocking Long-Horizon Agency Data…

200 papers

Pruning has recently been widely adopted to reduce the parameter scale and improve the inference efficiency of Large Language Models (LLMs). Mainstream pruning techniques often rely on uniform layerwise pruning strategies, which can lead to…

Computation and Language · Computer Science 2025-06-04 Yuli Chen , Bo Cheng , Jiale Han , Yingying Zhang , Yingting Li , Shuhao Zhang

As Large Language Models (LLMs) are increasingly deployed as autonomous agents, they face a critical scalability bottleneck known as the "Generalization-Specialization Dilemma." Monolithic agents equipped with extensive toolkits suffer from…

Multiagent Systems · Computer Science 2026-01-16 Sathish Sampath , Anuradha Baskaran

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

Artificial Intelligence · Computer Science 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

Explicit planning is a critical capability for LLM-based agents solving complex data-centric tasks, which require precise tool calling over external data sources. Existing strategies fall into two paradigms based on planning horizon: (1)…

Computation and Language · Computer Science 2026-05-12 Naoki Otani , Nikita Bhutani , Hannah Kim , Dan Zhang , Estevam Hruschka

Large language model (LLM) agents are constrained by limited context windows, necessitating external memory systems for long-term information understanding. Current memory-augmented agents typically depend on pre-defined instructions and…

Computation and Language · Computer Science 2025-10-01 Yu Wang , Ryuichi Takanobu , Zhiqi Liang , Yuzhen Mao , Yuanzhe Hu , Julian McAuley , Xiaojian Wu

Long-form video understanding remains challenging for Vision-Language Models (VLMs) due to the inherent tension between computational constraints and the need to capture information distributed across thousands of frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Junbo Zou , Ziheng Huang , Shengjie Zhang , Liwen Zhang , Weining Shen

Despite rapid developments and widespread applications of MLLM agents, they still struggle with long-form video understanding (LVU) tasks, which are characterized by high information density and extended temporal spans. Recent research on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Haiyang Yan , Hongyun Zhou , Peng Xu , Xiaoxue Feng , Mengyi Liu

Data science and engineering workflows often span multiple stages, from warehousing to orchestration, using tools like BigQuery, dbt, and Airbyte. As vision language models (VLMs) advance in multimodal understanding and code generation,…

Agentic AI systems use specialized agents to handle tasks within complex workflows, enabling automation and efficiency. However, optimizing these systems often requires labor-intensive, manual adjustments to refine roles, tasks, and…

Computation and Language · Computer Science 2024-12-24 Kamer Ali Yuksel , Hassan Sawaf

With Deep Reinforcement Learning (DRL) being increasingly considered for the control of real-world systems, the lack of transparency of the neural network at the core of RL becomes a concern. Programmatic Reinforcement Learning (PRL) is…

Machine Learning · Computer Science 2024-10-30 Senne Deproost , Denis Steckelmacher , Ann Nowé

Task planning for robotic manipulation with large language models (LLMs) is an emerging area. Prior approaches rely on specialized models, fine tuning, or prompt tuning, and often operate in an open loop manner without robust environmental…

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong

The efficacy of Large Vision-Language Models (LVLMs) is critically dependent on the quality of their training data, requiring a precise balance between visual fidelity and instruction-following capability. Existing datasets, however, are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Zimu Jia , Mingjie Xu , Andrew Estornell , Jiaheng Wei

Scaling vision-language-action (VLA) model pre-training requires large volumes of diverse, high-quality manipulation trajectories. Most current data is obtained via human teleoperation, which is expensive and difficult to scale.…

Robotics · Computer Science 2025-11-26 Rushuai Yang , Zhiyuan Feng , Tianxiang Zhang , Kaixin Wang , Chuheng Zhang , Li Zhao , Xiu Su , Yi Chen , Jiang Bian

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

General-purpose robots coexisting with humans in their environment must learn to relate human language to their perceptions and actions to be useful in a range of daily tasks. Moreover, they need to acquire a diverse repertoire of…

Robotics · Computer Science 2022-07-14 Oier Mees , Lukas Hermann , Erick Rosete-Beas , Wolfram Burgard

The rapid evolution of agentic AI marks a new phase in artificial intelligence, where Large Language Models (LLMs) no longer merely respond but act, reason, and adapt. This survey traces the paradigm shift in building agentic AI: from…

Artificial Intelligence · Computer Science 2025-10-28 Jitao Sang , Jinlin Xiao , Jiarun Han , Jilin Chen , Xiaoyi Chen , Shuyu Wei , Yongjie Sun , Yuhang Wang

Vision-language model (VLM) based GUI agents show promise for automating complex desktop and mobile tasks, but face significant challenges in applying reinforcement learning (RL): (1) slow multi-turn interactions with GUI environments for…

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li