English
Related papers

Related papers: STARE: Step-wise Temporal Alignment and Red-teamin…

200 papers

Existing temporal action detection (TAD) methods rely on large training data including segment-level annotations, limited to recognizing previously seen classes alone during inference. Collecting and annotating a large training set for each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Sauradip Nag , Xiatian Zhu , Yi-Zhe Song , Tao Xiang

Automated red teaming is an effective method for identifying misaligned behaviors in large language models (LLMs). Existing approaches, however, often focus primarily on improving attack success rates while overlooking the need for…

Computation and Language · Computer Science 2024-09-26 Jinchuan Zhang , Yan Zhou , Yaxin Liu , Ziming Li , Songlin Hu

Large-scale pre-trained generative models are taking the world by storm, due to their abilities in generating creative content. Meanwhile, safeguards for these generative models are developed, to protect users' rights and safety, most of…

Cryptography and Security · Computer Science 2024-10-14 Guanlin Li , Kangjie Chen , Shudong Zhang , Jie Zhang , Tianwei Zhang

AI coding assistants like GitHub Copilot are rapidly transforming software development, but their safety remains deeply uncertain-especially in high-stakes domains like cybersecurity. Current red-teaming tools often rely on fixed benchmarks…

Cryptography and Security · Computer Science 2025-08-07 Xiangzhe Xu , Guangyu Shen , Zian Su , Siyuan Cheng , Hanxi Guo , Lu Yan , Xuan Chen , Jiasheng Jiang , Xiaolong Jin , Chengpeng Wang , Zhuo Zhang , Xiangyu Zhang

Code agents must both reason over long-horizon repository state and obey strict tool-use protocols. In paired Instruct/Thinking checkpoints, these capabilities are complementary but misaligned. The Instruct model is concise and…

Software Engineering · Computer Science 2026-05-15 Mingzhi Zhu , Michele Merler , Raju Pavuluri , Stacy Patterson

Time series classification is a task of paramount importance, as this kind of data often arises in safety-critical applications. However, it is typically tackled with black-box deep learning methods, making it hard for humans to understand…

Machine Learning · Computer Science 2025-11-07 Irene Ferfoglia , Simone Silvetti , Gaia Saveri , Laura Nenzi , Luca Bortolussi

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, yet they remain vulnerable to generating toxic content, necessitating detoxification strategies to ensure safe and responsible deployment. Test-time…

Computation and Language · Computer Science 2025-10-03 Yisong Xiao , Aishan Liu , Siyuan Liang , Zonghao Ying , Xianglong Liu , Dacheng Tao

Despite extensive safety alignment, Large Language Models (LLMs) remain vulnerable to jailbreak attacks. However, existing methods generally lack the capability for continuous learning and self-evolution from interactions, limiting the…

Cryptography and Security · Computer Science 2026-04-21 Xu Liu , Yan Chen , Kan Ling , Yichi Zhu , Hengrun Zhang , Guisheng Fan , Huiqun Yu

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Current multimodal red teaming treats images as wrappers for malicious payloads via typography or adversarial noise. These attacks are structurally brittle, as standard defenses neutralize them once the payload is exposed. We introduce…

Cryptography and Security · Computer Science 2026-03-24 Yunbei Zhang , Yingqiang Ge , Weijie Xu , Yuhui Xu , Jihun Hamm , Chandan K. Reddy

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

Artificial Intelligence · Computer Science 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Scene text editing aims to modify text content within scene images while maintaining style consistency. Traditional methods achieve this by explicitly disentangling style and content from the source image and then fusing the style with the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zhengyao Fang , Pengyuan Lyu , Jingjing Wu , Chengquan Zhang , Jun Yu , Guangming Lu , Wenjie Pei

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

Robotics · Computer Science 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

Jailbreak attacks can circumvent model safety guardrails and reveal critical blind spots. Prior attacks on text-to-video (T2V) models typically add adversarial perturbations to obviously unsafe prompts, which are often easy to detect and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zonghao Ying , Moyang Chen , Nizhang Li , Zhiqiang Wang , Wenxin Zhang , Quanchen Zou , Zonglei Jing , Aishan Liu , Xianglong Liu

LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to carry out complex misuse scenarios. Existing agent misuse benchmarks largely test…

Computation and Language · Computer Science 2026-05-19 Nivya Talokar , Ayush K Tarun , Murari Mandal , Maksym Andriushchenko , Antoine Bosselut

Pathology image are essential for accurately interpreting lesion cells in cytopathology screening, but acquiring high-resolution digital slides requires specialized equipment and long scanning times. Though super-resolution (SR) techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Wenting Chen , Jie Liu , Tommy W. S. Chow , Yixuan Yuan

Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to…

Machine Learning · Computer Science 2023-07-06 Adam Ivankay , Mattia Rigotti , Pascal Frossard

We propose a method called Fast and Realistic Attacker Modeling and Evaluation (FRAME) that can reduce pessimism in static noise analysis by exploiting temporal logical correlation of attackers and using novel techniques termed envelopes…

Other Computer Science · Computer Science 2015-02-10 Sungroh Yoon , Nahmsuk Oh , Peivand Tehrani , Eui-Young Chung , Giovanni De Micheli

With the widespread deployment of deep-learning-based speech models in security-critical applications, backdoor attacks have emerged as a serious threat: an adversary who poisons a small fraction of training data can implant a hidden…

Cryptography and Security · Computer Science 2026-03-20 Kun Wang , Meng Chen , Junhao Wang , Yuli Wu , Li Lu , Chong Zhang , Peng Cheng , Jiaheng Zhang , Kui Ren

This work presents an attack-aware deepfake and image-forensics detector designed for robustness, well-calibrated probabilities, and transparent evidence under realistic deployment conditions. The method combines red-team training with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Noor Fatima , Hasan Faraz Khan , Muzammil Behzad