English
Related papers

Related papers: An Evaluation-Centric Paradigm for Scientific Visu…

200 papers

AI evaluation is undergoing a structural change. Large language models (LLMs) are increasingly deployed as systems that act over time through tools, environments, users, and other agents, while many evaluation practices still inherit…

Artificial Intelligence · Computer Science 2026-05-19 Keyang Xuan , Peiyang Song , Pan Lu , Pengrui Han , Wenkai Li , Zhenyu Zhang , Zexue He , Wenyue Hua , Manling Li , Jiaxuan You , Adrian Weller , Yizhong Wang , Jiaxin Pei

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-based embodied agents…

The automatic generation of visualizations is an old task that, through the years, has shown more and more interest from the research and practitioner communities. Recently, large language models (LLM) have become an interesting option for…

Human-Computer Interaction · Computer Science 2024-02-06 Luca Podo , Muhammad Ishmal , Marco Angelini

AI agents could accelerate scientific discovery by automating hypothesis formation, experiment design, coding, execution, and analysis, yet existing benchmarks probe narrow skills in simplified settings. To address this gap, we introduce…

Prominent large language models have exhibited human-level performance in many domains, even enabling the derived agents to simulate human and social interactions. While practical works have substantiated the practicability of grounding…

Computation and Language · Computer Science 2024-04-09 Chenxu Wang , Bin Dai , Huaping Liu , Baoyuan Wang

Vision Language Models (VLMs) have been applied to several specific domains and have shown strong problem-solving capabilities. However, astronomical imaging, a quite complex problem involving multidisciplinary knowledge and several…

Multiagent Systems · Computer Science 2026-04-20 Yaohui Han , Tianshuo Wang , Zixi Zhao , Zhengchun Zhu , Shuo Ren , Yiru Wang , Rongliang Fu , Tinghuan Chen , Tsung-Yi Ho

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities, however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require…

The rapid advancement of scientific progress requires innovative tools that can accelerate knowledge discovery. Although recent AI methods, particularly large language models (LLMs), have shown promise in tasks such as hypothesis generation…

Artificial Intelligence · Computer Science 2025-05-28 Haoyang Su , Renqi Chen , Shixiang Tang , Zhenfei Yin , Xinzhe Zheng , Jinzhe Li , Biqing Qi , Qi Wu , Hui Li , Wanli Ouyang , Philip Torr , Bowen Zhou , Nanqing Dong

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

Scientific progress increasingly relies on effective collaboration among researchers, a dynamic that large language models (LLMs) have only begun to emulate. While recent LLM-based scientist agents show promise in autonomous scientific…

Artificial Intelligence · Computer Science 2025-08-04 Weilun Yu , Shixiang Tang , Yonggui Huang , Nanqing Dong , Li Fan , Honggang Qi , Wei Liu , Xiaoli Diao , Xi Chen , Wanli Ouyang

Multi-view understanding, the ability to reconcile visual information across diverse viewpoints for effective navigation, manipulation, and 3D scene comprehension, is a fundamental challenge in Multi-Modal Large Language Models (MLLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Chun-Hsiao Yeh , Chenyu Wang , Shengbang Tong , Ta-Ying Cheng , Ruoyu Wang , Tianzhe Chu , Yuexiang Zhai , Yubei Chen , Shenghua Gao , Yi Ma

Large Language Model (LLM)-based agents have emerged as a new paradigm that extends LLMs' capabilities beyond text generation to dynamic interaction with external environments. By integrating reasoning with perception, memory, and tool use,…

Artificial Intelligence · Computer Science 2025-09-23 Minxing Zhang , Yi Yang , Roy Xie , Bhuwan Dhingra , Shuyan Zhou , Jian Pei

Large language model (LLM) agents have demonstrated strong capabilities across diverse domains, yet automated agent design remains a significant challenge. Current automated agent design approaches are often constrained by limited search…

Computation and Language · Computer Science 2025-11-21 Yu Li , Lehui Li , Zhihao Wu , Qingmin Liao , Jianye Hao , Kun Shao , Fengli Xu , Yong Li

Real-world data visualization (DV) requires native environmental grounding, cross-platform evolution, and proactive intent alignment. Yet, existing benchmarks often suffer from code-sandbox confinement, single-language creation-only tasks,…

Recent advances in large language models (LLMs) have enabled a new class of AI agents that automate multiple stages of the data science workflow by integrating planning, tool use, and multimodal reasoning across text, code, tables, and…

Despite their promise to perform complex reasoning, large language models (LLMs) have been shown to have limited effectiveness in end-to-end planning. This has inspired an intriguing question: if these models cannot plan well, can they…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Mohamed Aghzal , Xiang Yue , Erion Plaku , Ziyu Yao

Building generalist agents that can handle diverse tasks and evolve themselves across different environments is a long-term goal in the AI community. Large language models (LLMs) are considered a promising foundation to build such agents…

With the rapid development of deep learning technologies, the field of machine translation has witnessed significant progress, especially with the advent of large language models (LLMs) that have greatly propelled the advancement of…

Computation and Language · Computer Science 2025-04-22 Jiaxin GUO , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Zongyao Li , Hengchao Shang , Daimeng Wei , Hao Yang

Understanding and reasoning on the large-scale scientific literature is a crucial touchstone for large language model (LLM) based agents. However, existing works are mainly restricted to tool-free tasks within single papers, largely due to…

Artificial Intelligence · Computer Science 2026-02-02 Daoyu Wang , Mingyue Cheng , Shuo Yu , Zirui Liu , Ze Guo , Xin Li , Qi Liu