English
Related papers

Related papers: Spider2-V: How Far Are Multimodal Agents From Auto…

200 papers

Molecular dynamics (MD) simulations are essential for understanding biomolecular systems but remain challenging to automate. Recent advances in large language models (LLM) have demonstrated success in automating complex scientific tasks…

Artificial Intelligence · Computer Science 2025-02-14 Quintina Campbell , Sam Cox , Jorge Medina , Brittany Watterson , Andrew D. White

Recent advances have showcased the extraordinary capabilities of Large Language Model (LLM) agents in tackling web-based information-seeking tasks. However, existing efforts mainly focus on single-fact retrieval and rely on outcome-only…

Existing evaluations of multimodal large language models (MLLMs) on spatial intelligence are typically fragmented and limited in scope. In this work, we aim to conduct a holistic assessment of the spatial understanding capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Haoning Wu , Xiao Huang , Yaohui Chen , Ya Zhang , Yanfeng Wang , Weidi Xie

Large Language Model (LLM)-powered agents have unlocked new possibilities for automating human tasks. While prior work has focused on well-defined tasks with specified goals, the capabilities of agents in creative design tasks with…

Artificial Intelligence · Computer Science 2025-04-17 Dayeon Ki , Tianyi Zhou , Marine Carpuat , Gang Wu , Puneet Mathur , Viswanathan Swaminathan

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

Despite recent advancements in Large Language Models (LLMs), complex Software Engineering (SE) tasks require more collaborative and specialized approaches. This concept paper systematically reviews the emerging paradigm of LLM-based…

Software Engineering · Computer Science 2026-01-21 Yongjian Tang , Thomas Runkler

Large language models (LLMs) can reshape information processing by handling data analysis, visualization, and interpretation in an interactive, context-aware dialogue with users, including voice interaction, while maintaining high…

Artificial Intelligence · Computer Science 2025-11-25 Mohammad Nour Al Awad , Sergey Ivanov , Olga Tikhonova , Ivan Khodnenko

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

This paper introduces a methodology based on agentic workflows for economic research that leverages Large Language Models (LLMs) and multimodal AI to enhance research efficiency and reproducibility. Our approach features autonomous and…

General Economics · Economics 2025-04-15 Herbert Dawid , Philipp Harting , Hankui Wang , Zhongli Wang , Jiachen Yi

Enterprise systems are crucial for enhancing productivity and decision-making among employees and customers. Integrating LLM based systems into enterprise systems enables intelligent automation, personalized experiences, and efficient…

Machine Learning · Computer Science 2025-11-03 Harsh Vishwakarma , Ankush Agarwal , Ojas Patil , Chaitanya Devaguptapu , Mahesh Chandran

Recently, due to the advancement of multimodal technology, people are attempting to use visual large language models (VLLMs) in industrial production. Many deep learning models (DLMs) deployed in the production environment are gradually…

Computation and Language · Computer Science 2026-01-26 Xiang Chen

Recent progress in Multimodal Large Language Models (MLLMs) has enabled mobile GUI agents capable of visual perception, cross-modal reasoning, and interactive control. However, existing benchmarks are largely English-centric and fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yang Li , Yuchen Liu , Haoyu Lu , Zhiqiang Xia , Hongzhen Wang , Kaiyang Han , Changpeng Yang , Jinyang Wu , Jiaming Xu , Runyu Shi , Ying Huang

As data continues to grow in scale and complexity, preparing, transforming, and analyzing it remains labor-intensive, repetitive, and difficult to scale. Since data contains knowledge and AI learns knowledge from it, the alignment between…

Artificial Intelligence · Computer Science 2025-10-07 Yanjie Fu , Dongjie Wang , Wangyang Ying , Xinyuan Wang , Xiangliang Zhang , Huan Liu , Jian Pei

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI…

Artificial Intelligence · Computer Science 2025-05-07 Chaoyun Zhang , Shilin He , Jiaxu Qian , Bowen Li , Liqun Li , Si Qin , Yu Kang , Minghua Ma , Guyue Liu , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Recent advances in Vision-Language Models (VLMs) have enabled mobile agents to perceive and interact with real-world mobile environments based on human instructions. However, the current fully autonomous paradigm poses potential safety…

Artificial Intelligence · Computer Science 2026-04-28 Qihang Ai , Pi Bu , Yue Cao , Yingyao Wang , Jihao Gu , Jingxuan Xing , Zekun Zhu , Wei Jiang , Zhicheng Zheng , Jun Song , Yuning Jiang

In the field of MLLM-based GUI agents, compared to smartphones, the PC scenario not only features a more complex interactive environment, but also involves more intricate intra- and inter-app workflows. To address these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haowei Liu , Xi Zhang , Haiyang Xu , Yuyang Wanyan , Junyang Wang , Ming Yan , Ji Zhang , Chunfeng Yuan , Changsheng Xu , Weiming Hu , Fei Huang

The exponential growth of scientific literature poses unprecedented challenges for researchers attempting to synthesize knowledge across rapidly evolving fields. We present \textbf{Agentic AutoSurvey}, a multi-agent framework for automated…

Information Retrieval · Computer Science 2025-09-24 Yixin Liu , Yonghui Wu , Denghui Zhang , Lichao Sun

Recent advances in foundation models, particularly Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), have facilitated the development of intelligent agents capable of performing complex tasks. By leveraging the…

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

Computation and Language · Computer Science 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

We study the use of large language model-based agents for interacting with software via web browsers. Unlike prior work, we focus on measuring the agents' ability to perform tasks that span the typical daily work of knowledge workers…