中文
相关论文

相关论文: CartoAgent: a multimodal large language model-powe…

200 篇论文

Preparing high-quality instructional materials remains a labor-intensive process that often requires extensive coordination among teaching faculty, instructional designers, and teaching assistants. In this work, we present Instructional…

人工智能 · 计算机科学 2026-02-03 Huaiyuan Yao , Wanpeng Xu , Justin Turnau , Nadia Kellam , Hua Wei

Although large language models (LLMs) have advanced rapidly, robust automation of complex software workflows remains an open problem. In long-horizon settings, agents frequently suffer from cascading errors and environmental stochasticity;…

人工智能 · 计算机科学 2026-03-30 Yenchia Feng , Chirag Sharma , Karime Maamari

This paper introduces SignAgent, a novel agentic framework that utilises Large Language Models (LLMs) for scalable, linguistically-grounded Sign Language (SL) annotation and dataset curation. Traditional computational methods for SLs often…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Oliver Cory , Ozge Mercanoglu Sincan , Richard Bowden

Despite recent advances in multimodal large language models (MLLMs), their ability to understand and interact with music remains limited. Music understanding requires grounded reasoning over symbolic scores and expressive performance audio,…

多媒体 · 计算机科学 2026-01-21 Qihao Zhao , Yunqi Cao , Yangyu Huang , Hui Yi Leong , Fan Zhang , Kim-Hui Yap , Wei Hu

Enhancing fuel efficiency in public transportation requires the integration of complex multimodal data into interpretable, decision-relevant insights. However, traditional analytics and visualization methods often yield fragmented outputs…

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

The evolution of Large Language Models (LLMs) from passive text processors to autonomous agents has established planning as a core component of modern intelligence. However, achieving generalized planning remains elusive, not only by the…

Effective prompt design is essential for improving the planning capabilities of large language model (LLM)-driven agents. However, existing structured prompting strategies are typically limited to single-agent, plan-only settings, and often…

人工智能 · 计算机科学 2025-07-08 Bruce Yang , Xinfeng He , Huan Gao , Yifan Cao , Xiaofan Li , David Hsu

The rapid advancement of multimodal large language models (LLMs) has opened new frontiers in artificial intelligence, enabling the integration of diverse large-scale data types such as text, images, and spatial information. In this paper,…

人工智能 · 计算机科学 2025-03-21 Long Yuan , Fengran Mo , Kaiyu Huang , Wenjie Wang , Wangyuxuan Zhai , Xiaoyu Zhu , You Li , Jinan Xu , Jian-Yun Nie

Virtual film production requires intricate decision-making processes, including scriptwriting, virtual cinematography, and precise actor positioning and actions. Motivated by recent advances in automated decision-making with language…

计算与语言 · 计算机科学 2025-01-23 Zhenran Xu , Longyue Wang , Jifang Wang , Zhouyi Li , Senbao Shi , Xue Yang , Yiyu Wang , Baotian Hu , Jun Yu , Min Zhang

Large Language Model (LLM)-based agents exhibit significant potential across various domains, operating as interactive systems that process environmental observations to generate executable actions for target tasks. The effectiveness of…

计算与语言 · 计算机科学 2024-08-20 Mengkang Hu , Tianxing Chen , Qiguang Chen , Yao Mu , Wenqi Shao , Ping Luo

With the rapid development of mobile intelligent assistant technologies, multi-modal AI assistants have become essential interfaces for daily user interactions. However, current evaluation methods face challenges including high manual…

人工智能 · 计算机科学 2025-10-22 Meiping Wang , Jian Zhong , Rongduo Han , Liming Kang , Zhengkun Shi , Xiao Liang , Xing Lin , Nan Gao , Haining Zhang

Computer-Aided Design (CAD) is an expert-level task that relies on long-horizon reasoning and coherent modeling actions. Large Language Models (LLMs) have shown remarkable advancements in enabling language agents to tackle real-world tasks.…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yifei Gong , Xing Wu , Wenda Liu , Kang Tu

Large Language Models (LLM) based agents have shown promise in autonomously completing tasks across various domains, e.g., robotics, games, and web navigation. However, these agents typically require elaborate design and expert prompts to…

人工智能 · 计算机科学 2024-11-12 Minghao Chen , Yihang Li , Yanting Yang , Shiyu Yu , Binbin Lin , Xiaofei He

The advancement of large language models (LLMs) prompts the development of multi-modal agents, which are used as a controller to call external tools, providing a feasible way to solve practical tasks. In this paper, we propose a multi-modal…

人工智能 · 计算机科学 2025-02-04 Zhi Gao , Bofei Zhang , Pengxiang Li , Xiaojian Ma , Tao Yuan , Yue Fan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

Recent advancements have highlighted that Large Language Models (LLMs) are prone to hallucinations when solving complex reasoning problems, leading to erroneous results. To tackle this issue, researchers incorporate Knowledge Graphs (KGs)…

人工智能 · 计算机科学 2025-02-19 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng , Wotao Yin

Large Language Models (LLMs) have demonstrated substantial progress in task automation and natural language understanding. However, without domain expertise in geographic information science (GIS), they continue to encounter limitations…

软件工程 · 计算机科学 2025-12-04 Qianqian Luo , Qingming Lin , Liuchang Xu , Sensen Wu , Ruichen Mao , Chao Wang , Hailin Feng , Bo Huang , Zhenhong Du

Geologic map, as a fundamental diagram in geology science, provides critical insights into the structure and composition of Earth's subsurface and surface. These maps are indispensable in various fields, including disaster detection,…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Yangyu Huang , Tianyi Gao , Haoran Xu , Qihao Zhao , Yang Song , Zhipeng Gui , Tengchao Lv , Hao Chen , Lei Cui , Scarlett Li , Furu Wei

Recent advances in AI and ML have transformed data science, yet increasing complexity and expertise requirements continue to hinder progress. Although crowd-sourcing platforms alleviate some challenges, high-level machine learning…

Large Language Model (LLM)-based UI agents show great promise for UI automation but often hallucinate in long-horizon tasks due to their lack of understanding of the global UI transition structure. To address this, we introduce AGENT+P, a…

多智能体系统 · 计算机科学 2026-01-09 Shang Ma , Xusheng Xiao , Yanfang Ye