中文
相关论文

相关论文: Safety-Oriented Evaluation of Language Understandi…

200 篇论文

Recent years have witnessed substantial growth in adaptive traffic signal control (ATSC) methodologies that improve transportation network efficiency, especially in branches leveraging artificial intelligence based optimization and control…

系统与控制 · 电气工程与系统科学 2022-11-29 Xiaoyu Wang , Scott Sanner , Baher Abdulhai

Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provides a comprehensive overview of the full pipeline,…

计算与语言 · 计算机科学 2025-11-20 Xudong Han , Junjie Yang , Tianyang Wang , Ziqian Bi , Xinyuan Song , Junfeng Hao , Junhao Song

AI safety training and red-teaming of large language models (LLMs) are measures to mitigate the generation of unsafe content. Our work exposes the inherent cross-lingual vulnerability of these safety mechanisms, resulting from the…

计算与语言 · 计算机科学 2024-01-30 Zheng-Xin Yong , Cristina Menghini , Stephen H. Bach

Large language models (LLMs) are demonstrating increasing prowess in cybersecurity applications, creating creating inherent risks alongside their potential for strengthening defenses. In this position paper, we argue that current efforts to…

密码学与安全 · 计算机科学 2025-02-04 Kamilė Lukošiūtė , Adam Swanda

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

人工智能 · 计算机科学 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

Large Language Model (LLM) based judges form the underpinnings of key safety evaluation processes such as offline benchmarking, automated red-teaming, and online guardrailing. This widespread requirement raises the crucial question: can we…

机器学习 · 计算机科学 2025-03-07 Francisco Eiras , Eliott Zemour , Eric Lin , Vaikkunth Mugunthan

As large language models (LLMs) expose systemic security challenges in high risk applications, including privacy leaks, bias amplification, and malicious abuse, there is an urgent need for a dynamic risk assessment and collaborative defence…

密码学与安全 · 计算机科学 2026-02-05 Xiaoyan Zhang , Dongyang Lyu , Xiaoqi Li

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

计算与语言 · 计算机科学 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg

Autonomous landing is essential for drones deployed in emergency deliveries, post-disaster response, and other large-scale missions. By enabling self-docking on charging platforms, it facilitates continuous operation and significantly…

机器人学 · 计算机科学 2025-05-13 Siwei Cai , Yuwei Wu , Lifeng Zhou

Large Language Models (LLMs) are increasingly adopted in high-stakes scenarios, yet their safety mechanisms often remain fragile. Simple jailbreak prompts or even benign fine-tuning can bypass these protocols, underscoring the need to…

机器学习 · 计算机科学 2025-02-04 Ching-Chia Kao , Chia-Mu Yu , Chun-Shien Lu , Chu-Song Chen

Large Language Models (LLMs) are increasingly integrated into critical decision-making pipelines, a trend that raises the demand for robust and automated data analysis. Current approaches to dataset risk analysis are limited to manual…

人工智能 · 计算机科学 2026-05-28 Panteleimon Rodis

Large Language Models (LLMs) have demonstrated potential in cybersecurity applications but have also caused lower confidence due to problems like hallucinations and a lack of truthfulness. Existing benchmarks provide general evaluations but…

Software architecture models capture early design decisions that strongly influence system quality attributes, including security. However, architecture-level security assessment and feedback are often absent in practice, allowing security…

软件工程 · 计算机科学 2026-03-26 Mahdi Jafari , Rahul Sharma , Sami Naim , Christopher Gerking , Ralf Reussner

The volume, variety, and velocity of change in vulnerabilities and exploits have made incident threat analysis challenging with human expertise and experience along. Tactics, Techniques, and Procedures (TTPs) are to describe how and why…

人工智能 · 计算机科学 2023-08-24 Reza Fayyazi , Shanchieh Jay Yang

Large Language Models (LLMs) have shown remarkable effectiveness in various general-domain natural language processing (NLP) tasks. However, their performance in transportation safety domain tasks has been suboptimal, primarily attributed…

计算与语言 · 计算机科学 2023-07-31 Ou Zheng , Mohamed Abdel-Aty , Dongdong Wang , Chenzhu Wang , Shengxuan Ding

The safety and reliability of Automated Driving Systems (ADSs) must be validated prior to large-scale deployment. Among existing validation approaches, scenario-based testing has been regarded as a promising method to improve testing…

软件工程 · 计算机科学 2026-01-05 Yongqi Zhao , Ji Zhou , Dong Bi , Tomislav Mihalj , Jia Hu , Arno Eichberger

Fine-tuning language models is commonly believed to inevitably harm their safety, i.e., refusing to respond to harmful user requests, even when using harmless datasets, thus requiring additional safety measures. We challenge this belief…

机器学习 · 计算机科学 2025-08-19 Minseon Kim , Jin Myung Kwak , Lama Alssum , Bernard Ghanem , Philip Torr , David Krueger , Fazl Barez , Adel Bibi

Large Language Models (LLMs) are increasingly used as high level controllers for autonomous Unmanned Aerial Vehicle (UAV) missions. However, existing evaluations rarely assess whether such agents remain safe, protocol compliant, and…

系统与控制 · 电气工程与系统科学 2026-01-08 Mohamed Amine Ferrag , Abderrahmane Lakas , Merouane Debbah

With the rapid advancement of artificial intelligence, Large Language Models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), including content generation, human-computer interaction, machine translation, and…

计算与语言 · 计算机科学 2025-10-31 Songyang Liu , Chaozhuo Li , Jiameng Qiu , Xi Zhang , Feiran Huang , Litian Zhang , Yiming Hei , Philip S. Yu

While Large Language Models (LLMs) have seen widespread applications across numerous fields, their limited interpretability poses concerns regarding their safe operations from multiple aspects, e.g., truthfulness, robustness, and fairness.…

软件工程 · 计算机科学 2024-04-15 Xuan Xie , Jiayang Song , Zhehua Zhou , Yuheng Huang , Da Song , Lei Ma