English
Related papers

Related papers: CompAgent: An Agentic Framework for Visual Complia…

200 papers

Text-to-Visualization (Text-to-Vis) translates natural language queries into visualization query languages, enabling non-expert users to perform data analysis. However, most existing methods follow a one-shot paradigm that requires users to…

Vision-language models (VLMs) have been proven effective for detecting multi-modal misinformation on social platforms, especially in zero-shot settings with unavailable or delayed annotations. However, a single VLM's capacity falls short in…

Multimedia · Computer Science 2026-03-04 Wei Jiang , Tong Chen , Wei Yuan , Quoc Viet Hung Nguyen , Hongzhi Yin

Recent advancements in Vision Language Models (VLMs) have expanded their capabilities to interactive agent tasks, yet existing benchmarks remain limited to single-agent or text-only environments. In contrast, real-world scenarios often…

Artificial Intelligence · Computer Science 2026-04-14 Zelai Xu , Zhexuan Xu , Xiangmin Yi , Huining Yuan , Mo Guang , Kaiwen Long , Xinlei Chen , Yi Wu , Chao Yu , Yu Wang

Autonomous agents capable of navigating Graphical User Interfaces (GUIs) hold the potential to revolutionize digital productivity. However, achieving true digital autonomy extends beyond reactive element matching; it necessitates a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hongxin Li , Xiping Wang , Jingran Su , Zheng Ju , Yuntao Chen , Qing Li , Zhaoxiang Zhang

Although LLMs demonstrate proficiency in several text-based reasoning and planning tasks, their implementation in robotics control is constrained by significant deficiencies: (1) LLM agents are designed to work mainly with textual inputs…

Artificial Intelligence · Computer Science 2025-10-17 Shuang Ao , Flora D. Salim , Simon Khan

With the integration of large language models (LLMs), embodied agents have strong capabilities to understand and plan complicated natural language instructions. However, a foreseeable issue is that those embodied agents can also flawlessly…

Cryptography and Security · Computer Science 2025-11-03 Sheng Yin , Xianghe Pang , Yuanzhuo Ding , Menglan Chen , Yutong Bi , Yichen Xiong , Wenhao Huang , Zhen Xiang , Jing Shao , Siheng Chen

LMMs have shown impressive visual understanding capabilities, with the potential to be applied in agents, which demand strong reasoning and planning abilities. Nevertheless, existing benchmarks mostly assess their reasoning abilities in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Miaosen Zhang , Qi Dai , Yifan Yang , Jianmin Bao , Dongdong Chen , Kai Qiu , Chong Luo , Xin Geng , Baining Guo

With the advancement of Multimodal Large Language Models (MLLM), LLM-driven visual agents are increasingly impacting software interfaces, particularly those with graphical user interfaces. This work introduces a novel LLM-based multimodal…

Human-Computer Interaction · Computer Science 2025-09-18 Yanda Li , Chi Zhang , Wenjia Jiang , Wanqi Yang , Bin Fu , Pei Cheng , Xin Chen , Ling Chen , Yunchao Wei

Continual memory augmentation lets computer-using agents (CUAs) learn from prior interactions, but unvetted memories can encode domain-inappropriate or unsafe heuristics--spurious rules that drift from user intent and safety constraints. We…

Machine Learning · Computer Science 2025-08-11 Thong Q. Nguyen , Shubhang Desai , Raja Hasnain Anwar , Firoz Shaik , Vishwas Suryanarayanan , Vishal Chowdhary

Despite the remarkable capabilities of text-to-image (T2I) generation models, real-world applications often demand fine-grained, iterative image editing that existing methods struggle to provide. Key challenges include granular instruction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Zihan Liang , Jiahao Sun , Haoran Ma

Automated Machine Learning (AutoML) has revolutionized the development of data-driven solutions; however, traditional frameworks often function as "black boxes", lacking the flexibility and transparency required for complex, real-world…

Machine Learning · Computer Science 2026-02-17 Dat Le , Duc-Cuong Le , Anh-Son Nguyen , Tuan-Dung Bui , Thu-Trang Nguyen , Son Nguyen , Hieu Dinh Vo

LLM agents now perform strongly in software engineering, deep research, GUI automation, and various other applications, while recent agent scaffolds and models are increasingly integrating these capabilities into unified systems. Yet, most…

Finite Element Analysis (FEA) serves as the cornerstone of modern engineering design. However, its workflow is inherently complex and relies heavily on domain expertise. Although recent efforts have integrated Large Language Models (LLMs)…

Artificial Intelligence · Computer Science 2026-05-29 Jiachen Zhang , Junyi Lao , Chenghao Liu , Siyuan Liu , Shixin Wu , Linsen Zhang , Boyu Wang , Songfang Huang

Advancements in large language models (LLMs) allow them to address diverse questions using human-like interfaces. Still, limitations in their training prevent them from answering accurately in scenarios that could benefit from multiple…

Artificial Intelligence · Computer Science 2025-04-09 Yoshitaka Inoue , Tianci Song , Xinling Wang , Augustin Luna , Tianfan Fu

Multi-agent large language model (LLM) systems have shown promise for solving complex tasks through agent collaboration. However, existing frameworks assign tasks based on predefined roles without considering whether an agent can accurately…

Artificial Intelligence · Computer Science 2026-05-19 Chenyu Wang , Yang Shu

Long video understanding has emerged as an increasingly important yet challenging task in computer vision. Agent-based approaches are gaining popularity for processing long videos, as they can handle extended sequences and integrate various…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhuo Zhi , Qiangqiang Wu , Minghe shen , Wenbo Li , Yinchuan Li , Kun Shao , Kaiwen Zhou

While agentic AI and its core multimodal large language models (MLLMs) have demonstrated remarkable promise in language and visual reasoning across domains ranging from daily life to advanced scientific research, a profound gap remains…

Artificial Intelligence · Computer Science 2026-05-19 Yifan Shen , Jiawen Zhang , Jian Xu , Junho Kim , Ismini Lourentzou , Xu Cao , Meihuan Huang

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

Artificial Intelligence · Computer Science 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Medical Large Vision-Language Models (Med-LVLMs) have shown strong potential in multimodal diagnostic tasks. However, existing single-agent models struggle to generalize across diverse medical specialties, limiting their performance. Recent…

Machine Learning · Computer Science 2026-01-27 Peng Xia , Jinglu Wang , Yibo Peng , Kaide Zeng , Zihan Dong , Xian Wu , Xiangru Tang , Hongtu Zhu , Yun Li , Linjun Zhang , Shujie Liu , Yan Lu , Huaxiu Yao

Interleaved text-and-image generation represents a significant frontier for Multimodal Large Language Models (MLLMs), offering a more intuitive way to convey complex information. Current paradigms rely on either image generation or…

Artificial Intelligence · Computer Science 2026-04-01 Yinuo Liu , Zi Qian , Heng Zhou , Jiahao Zhang , Yajie Zhang , Zhihang Li , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang