中文
相关论文

相关论文: SafeWork-R1: Coevolving Safety and Intelligence un…

200 篇论文

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversarial training, while…

人工智能 · 计算机科学 2025-12-23 A. A. Gde Yogi Pramana , Jason Ray , Anthony Jaya , Michael Wijaya

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

机器学习 · 计算机科学 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Multimodal large language models (MLLMs) are essential for building general-purpose AI assistants; however, they pose increasing safety risks. How can we ensure safety alignment of MLLMs to prevent undesired behaviors? Going further, it is…

AI systems empowered by reinforcement learning (RL) algorithms harbor the immense potential to catalyze societal advancement, yet their deployment is often impeded by significant safety concerns. Particularly in safety-critical…

机器学习 · 计算机科学 2023-05-17 Jiaming Ji , Jiayi Zhou , Borong Zhang , Juntao Dai , Xuehai Pan , Ruiyang Sun , Weidong Huang , Yiran Geng , Mickel Liu , Yaodong Yang

Aligning Vision-Language Models (VLMs) with safety standards is essential to mitigate risks arising from their multimodal complexity, where integrating vision and language unveils subtle threats beyond the reach of conventional safeguards.…

机器学习 · 计算机科学 2025-10-14 Menglan Chen , Xianghe Pang , Jingjing Dong , WenHao Wang , Yaxin Du , Siheng Chen

In the rapidly evolving field of Large Language Models (LLMs), ensuring safety is a crucial and widely discussed topic. However, existing works often overlook the geo-diversity of cultural and legal standards across the world. To…

计算与语言 · 计算机科学 2024-12-10 Da Yin , Haoyi Qiu , Kung-Hsiang Huang , Kai-Wei Chang , Nanyun Peng

We introduce Skywork R1V, a multimodal reasoning model extending the an R1-series Large language models (LLM) to visual modalities via an efficient multimodal transfer method. Leveraging a lightweight visual projector, Skywork R1V…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Yi Peng , Peiyu Wang , Xiaokun Wang , Yichen Wei , Jiangbo Pei , Weijie Qiu , Ai Jian , Yunzhuo Hao , Jiachun Pan , Tianyidan Xie , Li Ge , Rongxian Zhuang , Xuchen Song , Yang Liu , Yahui Zhou

Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have been rapidly progressing and achieving breakthrough performance on complex reasoning tasks such as mathematics and coding. However, the open-source R1 models have raised…

人工智能 · 计算机科学 2025-04-15 Yichi Zhang , Zihao Zeng , Dongbai Li , Yao Huang , Zhijie Deng , Yinpeng Dong

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

机器人学 · 计算机科学 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often…

计算与语言 · 计算机科学 2025-10-08 Kehua Feng , Keyan Ding , Yuhao Wang , Menghan Li , Fanjunduo Wei , Xinda Wang , Qiang Zhang , Huajun Chen

Large Language Models (LLMs) have achieved impressive performance across diverse natural language processing tasks, but their growing power also amplifies potential risks such as jailbreak attacks that circumvent built-in safety mechanisms.…

人工智能 · 计算机科学 2025-10-01 Qinjian Zhao , Jiaqi Wang , Zhiqiang Gao , Zhihao Dou , Belal Abuhaija , Kaizhu Huang

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Multi-modal Large Language Models (MLLMs) are increasingly deployed in interactive applications. However, their safety vulnerabilities become pronounced in multi-turn multi-modal scenarios, where harmful intent can be gradually…

计算与语言 · 计算机科学 2026-01-09 Han Zhu , Jiale Chen , Chengkun Cai , Shengjie Sun , Haoran Li , Yujin Zhou , Chi-Min Chan , Pengcheng Wen , Lei Li , Sirui Han , Yike Guo

In this position paper, we address the persistent gap between rapidly growing AI capabilities and lagging safety progress. Existing paradigms divide into ``Make AI Safe'', which applies post-hoc alignment and guardrails but remains brittle…

机器学习 · 计算机科学 2025-09-09 Youbang Sun , Xiang Wang , Jie Fu , Chaochao Lu , Bowen Zhou

While the safety risks of image-based large language models (Image LLMs) have been extensively studied, their video-based counterparts (Video LLMs) remain critically under-examined. To systematically study this problem, we introduce…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Yiwei Sun , Peiqi Jiang , Chuanbin Liu , Luohao Lin , Zhiying Lu , Hongtao Xie

We present Skywork R1V2, a next-generation multimodal reasoning model and a major leap forward from its predecessor, Skywork R1V. At its core, R1V2 introduces a hybrid reinforcement learning paradigm that jointly leverages the Mixed…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Peiyu Wang , Yichen Wei , Yi Peng , Xiaokun Wang , Weijie Qiu , Wei Shen , Tianyidan Xie , Jiangbo Pei , Jianhao Zhang , Yunzhuo Hao , Xuchen Song , Yang Liu , Yahui Zhou

The success of DeepSeek-R1 underscores the significant role of reinforcement learning (RL) in enhancing the reasoning capabilities of large language models (LLMs). In this work, we present Skywork-OR1, an effective and scalable RL…

The emergence of Large Reasoning Models (LRMs) introduces a new paradigm of explicit reasoning, enabling remarkable advances yet posing unique risks such as reasoning manipulation and information leakage. To mitigate these risks, current…

人工智能 · 计算机科学 2026-02-03 Jingnan Zheng , Jingjun Xu , Yanzhen Luo , Chenhang Cui , Gelei Deng , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

Large language model-based agents are rapidly evolving from simple conversational assistants into autonomous systems capable of performing complex, professional-level tasks in various domains. While these advancements promise significant…

‹ 上一页 1 2 3 10 下一页 ›