English
Related papers

Related papers: BOOKAGENT: Orchestrating Safety-Aware Visual Narra…

200 papers

We present CreAgentive, an agent workflow driven multi-category creative generation engine that addresses four key limitations of contemporary large language models in writing stories, drama and other categories of creatives: restricted…

Computation and Language · Computer Science 2025-10-01 Yuyang Cheng , Linyue Cai , Changwei Peng , Yumiao Xu , Rongfang Bie , Yong Zhao

The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xinlei Yu , Chengming Xu , Zhangquan Chen , Yudong Zhang , Shilin Lu , Cheng Yang , Jiangning Zhang , Shuicheng Yan , Xiaobin Hu

The advancement of large language models (LLMs) has enabled the construction of multi-agent systems to solve complex tasks by dividing responsibilities among specialized agents, such as a planning agent for subgoal generation and a…

Computation and Language · Computer Science 2025-09-12 Minghang Zhu , Zhengliang Shi , Zhiwei Xu , Shiguang Wu , Lingjie Wang , Pengjie Ren , Zhaochun Ren , Zhumin Chen

While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been widely applied in educational contexts, their ability to generate pedagogically effective visual explanations remains limited. Most…

Artificial Intelligence · Computer Science 2025-05-29 Haonian Ji , Shi Qiu , Siyang Xin , Siwei Han , Zhaorun Chen , Dake Zhang , Hongyi Wang , Huaxiu Yao

Although numerous strategies have recently been proposed to enhance the autonomous interaction capabilities of multimodal agents in graphical user interface (GUI), their reliability remains limited when faced with complex or out-of-domain…

Computation and Language · Computer Science 2025-10-06 Pengzhou Cheng , Lingzhong Dong , Zeng Wu , Zongru Wu , Xiangru Tang , Chengwei Qin , Zhuosheng Zhang , Gongshen Liu

Story visualization has become a popular task where visual scenes are generated to depict a narrative across multiple panels. A central challenge in this setting is maintaining visual consistency, particularly in how characters and objects…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Kiymet Akdemir , Tahira Kazimi , Pinar Yanardag

Autonomous Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) enable digital automation on end-user devices. While scaling both parameters and data has yielded substantial gains, advanced methods still…

Artificial Intelligence · Computer Science 2026-04-16 Ziwei Wang , Junjie Zheng , Leyang Yang , Sheng Zhou , Xiaoxuan Tang , Zhouhua Fang , Zhiwei Liu , Dajun Chen , Yong Li , Jiajun Bu

Despite recent advances in multimodal large language models (MLLMs), their ability to understand and interact with music remains limited. Music understanding requires grounded reasoning over symbolic scores and expressive performance audio,…

Multimedia · Computer Science 2026-01-21 Qihao Zhao , Yunqi Cao , Yangyu Huang , Hui Yi Leong , Fan Zhang , Kim-Hui Yap , Wei Hu

Foundation models have become central to unifying perception and planning in robotics, yet real-world deployment exposes a mismatch between their monolithic assumption that a single model can handle all cognitive functions and the…

Robotics · Computer Science 2025-12-02 Nan Sun , Bo Mao , Yongchang Li , Chenxu Wang , Di Guo , Huaping Liu

With the rapid advancement of large language models (LLMs), Multi-agent Systems (MAS) have achieved significant progress in various application scenarios. However, substantial challenges remain in designing versatile, robust, and efficient…

Artificial Intelligence · Computer Science 2025-09-12 Weige Cai , Tong Zhu , Jinyi Niu , Ruiqi Hu , Lingyao Li , Tenglong Wang , Xiaowu Dai , Weining Shen , Liwen Zhang

Training AI models has always been challenging, especially when there is a need for custom models to provide personalized services. Algorithm engineers often face a lengthy process to iteratively develop models tailored to specific business…

Artificial Intelligence · Computer Science 2023-11-27 Haoyuan Li , Hao Jiang , Tianke Zhang , Zhelun Yu , Aoxiong Yin , Hao Cheng , Siming Fu , Yuhao Zhang , Wanggui He

Generating long-form audio-visual stories from a short user prompt remains challenging due to an intent-execution gap, where high-level narrative intent must be preserved across coherent, shot-level multimodal generation over long horizons.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Wenzhang Sun , Zhenyu Wang , Zhangchi Hu , Chunfeng Wang , Hao Li , Wei Chen

Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Open-Vocabulary Human-Object Interaction (OV-HOI) are limited by cross-modal hallucinations and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zhenlong Yuan , Yue Wang , Dapeng Zhang , Kejin Cui , Rui Chen , Jing Tang , Lei Sun , Hongwei Yu , Chengxuan Qian , Xiangxiang Chu , Shuo Li , Yuyin Zhou

While Large Language Models (LLMs) have demonstrated potential in healthcare, they often struggle with the complex, non-linear reasoning required for accurate clinical diagnosis. Existing methods typically rely on static, linear mappings…

Computation and Language · Computer Science 2026-05-28 Zhuohan Ge , Haoyang Li , Yubo Wang , Nicole Hu , Chen Jason Zhang , Qing Li

Cooperative perception has attracted wide attention given its capability to leverage shared information across connected automated vehicles (CAVs) and smart infrastructures to address sensing occlusion and range limitation issues. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zonglin Meng , Yun Zhang , Zhaoliang Zheng , Zhihao Zhao , Jiaqi Ma

Large multimodal models have enabled one-click storybook generation, where users provide a short description and receive a multi-page illustrated story. However, the underlying story state, such as characters, world settings, and page-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ayushman Sarkar , Zhenyu Yu , Wei Tang , Chu Chen , Kangning Cui , Mohd Yamani Idna Idris

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

With the rapid progress of large language models (LLMs), LLM-powered multi-agent systems (MAS) are drawing increasing interest across academia and industry. However, many current MAS frameworks struggle with reliability and scalability,…

Multiagent Systems · Computer Science 2025-11-04 Yang Li , Siqi Ping , Xiyu Chen , Xiaojian Qi , Zigan Wang , Ye Luo , Xiaowei Zhang

Large Language Models (LLMs) achieve competitive results compared to human experts in medical examinations. However, it remains a challenge to apply LLMs to complex clinical decision-making, which requires a deep understanding of medical…

Large Language Model (LLM) Agents have demonstrated remarkable capabilities in task automation and intelligent decision-making, driving the widespread adoption of agent development frameworks such as LangChain and AutoGen. However, these…

Artificial Intelligence · Computer Science 2025-10-10 Jiabin Tang , Tianyu Fan , Chao Huang