中文
相关论文

相关论文: Measure and Improve Robustness in NLP Models: A Su…

200 篇论文

Recent breakthroughs in machine and deep learning (ML and DL) research have provided excellent tools for leveraging enormous amounts of data and optimizing huge models with millions of parameters to obtain accurate networks for image…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Mohammadreza Amirian

This work in progress paper introduces robustness verification for autoencoder-based regression neural network (NN) models, following state-of-the-art approaches for robustness verification of image classification NNs. Despite the ongoing…

机器学习 · 计算机科学 2022-07-15 Neelanjana Pal , Taylor T Johnson

In this paper we criticize the robustness measure traditionally employed to assess the performance of machine learning models deployed in adversarial settings. To mitigate the limitations of robustness, we introduce a new measure called…

机器学习 · 计算机科学 2021-12-07 Stefano Calzavara , Lorenzo Cazzaro , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

Language models, characterized by their black-box nature, often hallucinate and display sensitivity to input perturbations, causing concerns about trust. To enhance trust, it is imperative to gain a comprehensive understanding of the…

计算与语言 · 计算机科学 2025-01-03 Vatsal Gupta , Pranshu Pandya , Tushar Kataria , Vivek Gupta , Dan Roth

Existing NLP datasets contain various biases, and models tend to quickly learn those biases, which in turn limits their robustness. Existing approaches to improve robustness against dataset biases mostly focus on changing the training…

计算与语言 · 计算机科学 2020-10-26 Nafise Sadat Moosavi , Marcel de Boer , Prasetya Ajie Utama , Iryna Gurevych

Robust control is a core approach for controlling systems with performance guarantees that are robust to modeling error, and is widely used in real-world systems. However, current robust control approaches can only handle small system…

最优化与控制 · 数学 2021-06-08 Dimitar Ho , Hoang M. Le , John C. Doyle , Yisong Yue

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

机器学习 · 计算机科学 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

Despite impressive performance on standard benchmarks, deep neural networks are often brittle when deployed in real-world systems. Consequently, recent research has focused on testing the robustness of such models, resulting in a diverse…

计算与语言 · 计算机科学 2021-01-14 Karan Goel , Nazneen Rajani , Jesse Vig , Samson Tan , Jason Wu , Stephan Zheng , Caiming Xiong , Mohit Bansal , Christopher Ré

Understanding robustness is essential for building reliable NLP systems. Unfortunately, in the context of machine translation, previous work mainly focused on documenting robustness failures or improving robustness. In contrast, we study…

计算与语言 · 计算机科学 2025-05-28 Abderrahmane Issam , Yusuf Can Semerci , Jan Scholtes , Gerasimos Spanakis

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

机器学习 · 计算机科学 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

Deep learning (DL) has demonstrated significant potential across various safety-critical applications, yet ensuring its robustness remains a key challenge. While adversarial robustness has been extensively studied in worst-case scenarios,…

机器学习 · 计算机科学 2025-03-11 Xingyu Zhao

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

机器学习 · 计算机科学 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

In recent years, the notion of local robustness (or robustness for short) has emerged as a desirable property of deep neural networks. Intuitively, robustness means that small perturbations to an input do not cause the network to perform…

编程语言 · 计算机科学 2019-05-02 Greg Anderson , Shankara Pailoor , Isil Dillig , Swarat Chaudhuri

Learning-based methods could provide solutions to many of the long-standing challenges in control. However, the neural networks (NNs) commonly used in modern learning approaches present substantial challenges for analyzing the resulting…

机器学习 · 计算机科学 2022-02-03 Michael Everett

Intensive algorithmic efforts have been made to enable the rapid improvements of certificated robustness for complex ML models recently. However, current robustness certification methods are only able to certify under a limited perturbation…

机器学习 · 计算机科学 2023-04-13 Zhuolin Yang , Zhikuan Zhao , Boxin Wang , Jiawei Zhang , Linyi Li , Hengzhi Pei , Bojan Karlas , Ji Liu , Heng Guo , Ce Zhang , Bo Li

This paper investigates the robustness of the Lur'e problem under positivity constraints, drawing on results from the positive Aizerman conjecture and robustness properties of Metzler matrices. Specifically, we consider a control system of…

系统与控制 · 电气工程与系统科学 2025-10-07 Hamidreza Montazeri Hedesh , Moh. Kamalul Wafi , Bahram Shafai , Milad Siami

Standard NLP benchmarks often fail to capture vulnerabilities stemming from dataset artifacts and spurious correlations. Contrast sets address this gap by challenging models near decision boundaries but are traditionally labor-intensive to…

计算与语言 · 计算机科学 2025-03-11 Hender Lin

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

机器学习 · 计算机科学 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer

We address robustness issues of self-triggered sampling with respect to model uncertainties, and propose a robust self-triggered sampling method. The approach is compared with existing methods in terms of sampling conservativeness and…

最优化与控制 · 数学 2015-10-05 U. Tiberi , K. H. Johansson

Neural networks (NNs) are now routinely implemented on systems that must operate in uncertain environments, but the tools for formally analyzing how this uncertainty propagates to NN outputs are not yet commonplace. Computing tight bounds…

机器学习 · 计算机科学 2020-12-08 Michael Everett , Golnaz Habibi , Jonathan P. How