中文
相关论文

相关论文: Benchmarking Robustness of Machine Reading Compreh…

200 篇论文

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Exposing diverse subword segmentations to neural machine translation (NMT) models often improves the robustness of machine translation as NMT models can experience various subword candidates. However, the diversification of subword…

计算与语言 · 计算机科学 2020-10-09 Jungsoo Park , Mujeen Sung , Jinhyuk Lee , Jaewoo Kang

This study investigates the vulnerability of semantic segmentation models to adversarial input perturbations, in the domain of off-road autonomous driving. Despite good performance in generic conditions, the state-of-the-art classifiers are…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Pankaj Deoli , Rohit Kumar , Axel Vierling , Karsten Berns

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

机器学习 · 计算机科学 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

Robustness to adversarial attacks is typically evaluated with adversarial accuracy. While essential, this metric does not capture all aspects of robustness and in particular leaves out the question of how many perturbations can be found for…

机器学习 · 计算机科学 2023-08-14 Raphael Olivier , Bhiksha Raj

Machine reading comprehension (MRC) is a long-standing topic in natural language processing (NLP). The MRC task aims to answer a question based on the given context. Recently studies focus on multi-hop MRC which is a more challenging…

计算与语言 · 计算机科学 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang

This document is an evaluation of the original "Rank-N-Contrast" (arXiv:2210.01189v2) paper published in 2023. This evaluation is done for academic purposes. Deep regression models often fail to capture the continuous nature of sample…

机器学习 · 计算机科学 2025-06-24 Valentin Six , Alexandre Chidiac , Arkin Worlikar

Despite the significant advances in deep learning over the past decade, a major challenge that limits the wide-spread adoption of deep learning has been their fragility to adversarial attacks. This sensitivity to making erroneous…

Algorithms are increasingly common components of high-impact decision-making, and a growing body of literature on adversarial examples in laboratory settings indicates that standard machine learning models are not robust. This suggests that…

机器学习 · 统计学 2018-11-28 Suproteem K. Sarkar , Kojin Oshiba , Daniel Giebisch , Yaron Singer

Deep neural networks for medical image classification often fail to generalize consistently in clinical practice due to violations of the i.i.d. assumption and opaque decision-making. This paper examines interpretability in deep neural…

Deep neural networks (DNNs) have found widespread applications in interpreting remote sensing (RS) imagery. However, it has been demonstrated in previous works that DNNs are vulnerable to different types of noises, particularly adversarial…

计算机视觉与模式识别 · 计算机科学 2023-09-18 Shaohui Mei , Jiawei Lian , Xiaofei Wang , Yuru Su , Mingyang Ma , Lap-Pui Chau

Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine. Compared with MRC on a single passage, multi-passage MRC is more challenging,…

计算与语言 · 计算机科学 2018-05-11 Yizhong Wang , Kai Liu , Jing Liu , Wei He , Yajuan Lyu , Hua Wu , Sujian Li , Haifeng Wang

There has been considerable progress on academic benchmarks for the Reading Comprehension (RC) task with State-of-the-Art models closing the gap with human performance on extractive question answering. Datasets such as SQuAD 2.0 & NQ have…

计算与语言 · 计算机科学 2021-02-25 Rishav Chakravarti , Avirup Sil

Adversarial training (AT) as a regularization method has proved its effectiveness on various tasks. Though there are successful applications of AT on some NLP tasks, the distinguishing characteristics of NLP tasks have not been exploited.…

计算与语言 · 计算机科学 2021-11-29 Ziqing Yang , Yiming Cui , Chenglei Si , Wanxiang Che , Ting Liu , Shijin Wang , Guoping Hu

Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to confuse the model into making a mistake. Such examples pose a serious threat to the applicability of machine-learning-based systems,…

机器学习 · 计算机科学 2023-10-18 Peiyu Xiong , Michael Tegegn , Jaskeerat Singh Sarin , Shubhraneel Pal , Julia Rubin

Adversarial robustness evaluation underpins every claim of trustworthy ML deployment, yet the field suffers from fragmented protocols and undetected gradient masking. We make two contributions. (1) Structured synthesis. We analyze nine…

密码学与安全 · 计算机科学 2026-04-23 Abhijit Talluri

The detection of computer-generated text is an area of rapidly increasing significance as nascent generative models allow for efficient creation of compelling human-like text, which may be abused for the purposes of spam, disinformation,…

计算与语言 · 计算机科学 2022-10-05 Evan Crothers , Nathalie Japkowicz , Herna Viktor , Paula Branco