English
Related papers

Related papers: Multi-Level Safety Continual Projection for Fine-T…

200 papers

While decoupled control schemes for legged mobile manipulators have shown robustness, learning holistic whole-body control policies for tracking global end-effector poses remains fragile against Out-of-Distribution (OOD) inputs induced by…

Robotics · Computer Science 2026-04-10 Ziyang Cheng , Haoyu Wei , Hang Yin , Xiuwei Xu , Bingyao Yu , Jie Zhou , Jiwen Lu

Aiming at the problems of computational inefficiency and insufficient interpretability faced by large models in complex tasks such as multi-round reasoning and multi-modal collaboration, this study proposes a three-layer collaboration…

Computation and Language · Computer Science 2025-09-23 Luyan Zhang

As Model Context Protocol (MCP) introduces an easy-to-use ecosystem for users and developers, it also brings underexplored safety risks. Its decentralized architecture, which separates clients and servers, poses unique challenges for…

Computation and Language · Computer Science 2025-09-30 Huihao Jing , Haoran Li , Wenbin Hu , Qi Hu , Heli Xu , Tianshu Chu , Peizhao Hu , Yangqiu Song

Improving Multi-modal Large Language Models (MLLMs) in the post-training stage typically relies on supervised fine-tuning (SFT) or reinforcement learning (RL), which require expensive and manually annotated multi-modal data--an ultimately…

Computation and Language · Computer Science 2025-10-28 Lai Wei , Yuting Li , Chen Wang , Yue Wang , Linghe Kong , Weiran Huang , Lichao Sun

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

Computation and Language · Computer Science 2026-04-21 San Kim , Gary Geunbae Lee

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in open-ended visual question answering, they remain vulnerable to hallucinations. These are outputs that contradict or misrepresent input semantics, posing a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jianjiang Yang , Yanshu li , Ziyan Huang

In this paper, a safe and learning-based control framework for model predictive control (MPC) is proposed to optimize nonlinear systems with a non-differentiable objective function under uncertain environmental disturbances. The control…

Robotics · Computer Science 2022-02-22 Lei Zheng , Rui Yang , Zhixuan Wu , Jiesen Pan , Hui Cheng

Self-improvement in multimodal large language models (MLLMs) is crucial for enhancing their reliability and robustness. However, current methods often rely heavily on MLLMs themselves as judges, leading to high computational costs and…

Computation and Language · Computer Science 2024-11-28 Shijian Deng , Wentian Zhao , Yu-Jhe Li , Kun Wan , Daniel Miranda , Ajinkya Kale , Yapeng Tian

Recent advances in natural language processing (NLP) have opened up greater opportunities to enable fine-tuned large language models (LLMs) to behave as more powerful interactive agents through improved instruction-following ability.…

Machine Learning · Computer Science 2025-10-27 Jerry Huang , Peng Lu , Qiuhao Zeng

Large vision-language models (LVLMs) achieve strong multimodal understanding, but their inference cost grows rapidly with the number of visual tokens, especially for high-resolution images and long videos. Existing attention-based methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Hongyu Lu , Feng Zhang , Wenwei Jin , Huanling Hu , Tianjun Shi , Shikai Jiang , Yao Hu , Jiawei Li

Graphical user interface (GUI) agents built on multimodal large language models (MLLMs) have recently demonstrated strong decision-making abilities in screen-based interaction tasks. However, they remain highly vulnerable to pop-up-based…

Cryptography and Security · Computer Science 2026-04-08 Zihe Yan , Jiaping Gui , Zhuosheng Zhang , Gongshen Liu

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

Cryptography and Security · Computer Science 2025-06-02 Jianwei Li , Jung-Eun Kim

Large Language Models (LLMs) deployed in high-stakes applications must simultaneously manage multiple risks, yet existing defenses are almost exclusively evaluated in isolation under a one-shot deployment assumption. In practice, providers…

Cryptography and Security · Computer Science 2026-05-15 Xiangtao Meng , Wenyu Chen , Chuanchao Zang , Xinyu Gao , Jianing Wang , Li Wang , Zheng Li , Shanqing Guo

Mitigating hallucinations in Large Language Models (LLMs) is critical for their reliable deployment. Existing methods typically fine-tune LLMs to abstain from answering questions beyond their knowledge scope. However, these methods often…

Computation and Language · Computer Science 2025-10-29 Hao An , Yang Xu

Large language models (LLMs) have achieved impressive performance in text summarization, yet their performance often falls short when applied to specialized domains that differ from their original pre-training distribution. While…

Computation and Language · Computer Science 2025-10-10 Xue-Yong Fu , Elena Khasanova , Md Tahmid Rahman Laskar , Harsh Saini , Shashi Bhushan TN

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

Cryptography and Security · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

Fine-tuning large language models (LLMs) based on human preferences, commonly achieved through reinforcement learning from human feedback (RLHF), has been effective in improving their performance. However, maintaining LLM safety throughout…

Artificial Intelligence · Computer Science 2025-02-18 Yingshui Tan , Yilei Jiang , Yanshi Li , Jiaheng Liu , Xingyuan Bu , Wenbo Su , Xiangyu Yue , Xiaoyong Zhu , Bo Zheng

While large language models (LLMs) such as Llama-2 or GPT-4 have shown impressive zero-shot performance, fine-tuning is still necessary to enhance their performance for customized datasets, domain-specific tasks, or other private needs.…

Machine Learning · Computer Science 2025-01-07 Chia-Yi Hsu , Yu-Lin Tsai , Chih-Hsun Lin , Pin-Yu Chen , Chia-Mu Yu , Chun-Ying Huang

Real-time multi-robot coordination in hazardous and adversarial environments requires fast, reliable adaptation to dynamic threats. While Large Language Models (LLMs) offer strong high-level reasoning capabilities, the lack of safety…

Robotics · Computer Science 2025-11-19 Yuwei Wu , Yuezhan Tao , Peihan Li , Guangyao Shi , Gaurav S. Sukhatme , Vijay Kumar , Lifeng Zhou