English
Related papers

Related papers: MLA-Trust: Benchmarking Trustworthiness of Multimo…

200 papers

Despite the superior capabilities of Multimodal Large Language Models (MLLMs) across diverse tasks, they still face significant trustworthiness challenges. Yet, current literature on the assessment of trustworthy MLLMs remains limited,…

Computation and Language · Computer Science 2024-12-09 Yichi Zhang , Yao Huang , Yitong Sun , Chang Liu , Zhe Zhao , Zhengwei Fang , Yifan Wang , Huanran Chen , Xiao Yang , Xingxing Wei , Hang Su , Yinpeng Dong , Jun Zhu

The rise of Large Language Models (LLMs) has revolutionized Graphical User Interface (GUI) automation through LLM-powered GUI agents, yet their ability to process sensitive data with limited human oversight raises significant privacy and…

Human-Computer Interaction · Computer Science 2025-06-06 Chaoran Chen , Zhiping Zhang , Ibrahim Khalilov , Bingcan Guo , Simret A Gebreegziabher , Yanfang Ye , Ziang Xiao , Yaxing Yao , Tianshi Li , Toby Jia-Jun Li

Recent advancements in multimodal large language models for video understanding (videoLLMs) have enhanced their capacity to process complex spatiotemporal data. However, challenges such as factual inaccuracies, harmful content, biases,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Youze Wang , Zijun Chen , Ruoyu Chen , Shishen Gu , Wenbo Hu , Jiayang Liu , Yinpeng Dong , Hang Su , Jun Zhu , Meng Wang , Richang Hong

The trustworthiness of Multimodal Large Language Models (MLLMs) remains an intense concern despite the significant progress in their capabilities. Existing evaluation and mitigation approaches often focus on narrow aspects and overlook…

Computation and Language · Computer Science 2025-08-22 Yichi Zhang , Yao Huang , Yifan Wang , Yitong Sun , Chang Liu , Zhe Zhao , Zhengwei Fang , Huanran Chen , Xiao Yang , Xingxing Wei , Hang Su , Yinpeng Dong , Jun Zhu

The integration of Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) into mobile GUI agents has significantly enhanced user efficiency and experience. However, this advancement also introduces potential security…

Cryptography and Security · Computer Science 2025-03-18 Yulong Yang , Xinshan Yang , Shuaidong Li , Chenhao Lin , Zhengyu Zhao , Chao Shen , Tianwei Zhang

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

With the rapid evolution of Large Language Models (LLMs), LLM-based agents and Multi-agent Systems (MAS) have significantly expanded the capabilities of LLM ecosystems. This evolution stems from empowering LLMs with additional modules such…

Multiagent Systems · Computer Science 2025-03-14 Miao Yu , Fanci Meng , Xinyun Zhou , Shilong Wang , Junyuan Mao , Linsey Pang , Tianlong Chen , Kun Wang , Xinfeng Li , Yongfeng Zhang , Bo An , Qingsong Wen

TThis paper argues that \textbf{a comprehensive vulnerability analysis is essential for building trustworthy Large Language Model-based Multi-Agent Systems (LLM-MAS)}. These systems, which consist of multiple LLM-powered agents working…

Cryptography and Security · Computer Science 2026-05-19 Pengfei He , Yue Xing , Juanhui Li , Shen Dong , Zhenwei Dai , Xianfeng Tang , Hui Liu , Han Xu , Zhen Xiang , Charu C. Aggarwal , Hui Liu

With the continuous development of large language models (LLMs), transformer-based models have made groundbreaking advances in numerous natural language processing (NLP) tasks, leading to the emergence of a series of agents that use LLMs as…

Artificial Intelligence · Computer Science 2024-11-15 Yuyou Gan , Yong Yang , Zhe Ma , Ping He , Rui Zeng , Yiming Wang , Qingming Li , Chunyi Zhou , Songze Li , Ting Wang , Yunjun Gao , Yingcai Wu , Shouling Ji

Large Language Model-based Multi-Agent Systems (LLM-MAS) have demonstrated strong capabilities in solving complex tasks but remain vulnerable when agents receive unreliable messages. This vulnerability stems from a fundamental gap: LLM…

Cryptography and Security · Computer Science 2026-04-15 Pengfei He , Zhenwei Dai , Xianfeng Tang , Yue Xing , Hui Liu , Jingying Zeng , Qiankun Peng , Shrivats Agrawal , Samarth Varshney , Suhang Wang , Jiliang Tang , Qi He

With the rapid development of multimodal large language models (MLLMs), they are increasingly deployed as autonomous computer-use agents capable of accomplishing complex computer tasks. However, a pressing issue arises: Can the safety risk…

Artificial Intelligence · Computer Science 2025-06-23 Jingyi Yang , Shuai Shao , Dongrui Liu , Jing Shao

AI-based systems, including Large Language Models (LLM), impact millions by supporting diverse tasks but face issues like misinformation, bias, and misuse. AI ethics is crucial as new technologies and concerns emerge, but objective,…

Computers and Society · Computer Science 2025-05-19 José Antonio Siqueira de Cerqueira , Mamia Agbese , Rebekah Rousi , Nannan Xi , Juho Hamari , Pekka Abrahamsson

Recent advancements in large language models (LLMs) have revealed their potential for achieving autonomous agents possessing human-level intelligence. However, existing benchmarks for evaluating LLM Agents either use static datasets,…

Computation and Language · Computer Science 2024-02-27 Junzhe Chen , Xuming Hu , Shuodi Liu , Shiyu Huang , Wei-Wei Tu , Zhaofeng He , Lijie Wen

Graphical User Interface (GUI) Agents have emerged as a transformative paradigm in human-computer interaction, evolving from rule-based automation scripts to sophisticated AI-driven systems capable of understanding and executing complex…

Human-Computer Interaction · Computer Science 2025-06-05 Fei Tang , Haolei Xu , Hang Zhang , Siqi Chen , Xingyu Wu , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Zeqi Tan , Yuchen Yan , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Existing benchmarks that assess Language Models (LMs) as Language Agents (LAs) for tool use primarily focus on stateless, single-turn interactions or partial evaluations, such as tool selection in a single turn, overlooking the inherent…

Computation and Language · Computer Science 2025-05-20 Hongru Wang , Wenyu Huang , Yufei Wang , Yuanhao Xi , Jianqiao Lu , Huan Zhang , Nan Hu , Zeming Liu , Jeff Z. Pan , Kam-Fai Wong

Large vision-language model (LVLM)-based web agents are emerging as powerful tools for automating complex online tasks. However, when deployed in real-world environments, they face serious security risks, motivating the design of security…

Cryptography and Security · Computer Science 2026-04-15 Zonghao Ying , Yangguang Shao , Jianle Gan , Gan Xu , Wenxin Zhang , Quanchen Zou , Junzheng Shi , Zhenfei Yin , Mingchuan Zhang , Aishan Liu , Xianglong Liu

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust…

Computers and Society · Computer Science 2024-07-22 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Kendall N. Niles , Ken Pathak , Steven Sloan

Large Language Models (LLMs) are increasingly deployed in real-world applications where users engage in extended, mixed-topic conversations that depend on prior context. Yet, their reliability under realistic multi-turn interactions remains…

Computation and Language · Computer Science 2026-03-03 Jiyoon Myung
‹ Prev 1 2 3 10 Next ›