中文
相关论文

相关论文: Frustratingly Poor Performance of Reading Comprehe…

200 篇论文

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

计算与语言 · 计算机科学 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

机器学习 · 计算机科学 2018-10-31 Alexander Matyasko , Lap-Pui Chau

Machine learning models are vulnerable to adversarial examples: small changes to images can cause computer vision models to make mistakes such as identifying a school bus as an ostrich. However, it is still an open question whether humans…

It has been shown that most machine learning algorithms are susceptible to adversarial perturbations. Slightly perturbing an image in a carefully chosen direction in the image space may cause a trained neural network model to misclassify…

计算机视觉与模式识别 · 计算机科学 2017-07-13 Jiajun Lu , Hussein Sibai , Evan Fabry , David Forsyth

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

计算与语言 · 计算机科学 2023-07-25 Neel Bhandari , Pin-Yu Chen

Deep computer vision systems being vulnerable to imperceptible and carefully crafted noise have raised questions regarding the robustness of their decisions. We take a step back and approach this problem from an orthogonal direction. We…

计算机视觉与模式识别 · 计算机科学 2019-04-18 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders , Zeynep Akata

More capable language models increasingly saturate existing task benchmarks, in some cases outperforming humans. This has left little headroom with which to measure further progress. Adversarial dataset creation has been proposed as a…

计算与语言 · 计算机科学 2021-11-17 Jason Phang , Angelica Chen , William Huang , Samuel R. Bowman

Machine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements. However, most of the neural MRC models are still far from robust and fail to generalize well in real-world…

计算与语言 · 计算机科学 2021-07-22 Hongxuan Tang , Hongyu Li , Jing Liu , Yu Hong , Hua Wu , Haifeng Wang

Congestion controllers (CCs) are critical to network performance, and yet their robustness under adverse conditions remains insufficiently understood. While recent learning-based CCs have demonstrated strong performance in controlled…

密码学与安全 · 计算机科学 2026-05-22 Zhi Chen , Shehab Sarar Ahmed , Chenkai Wang , Brighten Godfrey , Gang Wang

Asynchronous Advantage Actor Critic (A3C) is an effective Reinforcement Learning (RL) algorithm for a wide range of tasks, such as Atari games and robot control. The agent learns policies and value function through trial-and-error…

机器学习 · 计算机科学 2019-12-03 Zhaoyuan Gu , Zhenzhong Jia , Howie Choset

Machine Reading Comprehension (MRC) models tend to take advantage of spurious correlations (also known as dataset bias or annotation artifacts in the research community). Consequently, these models may perform the MRC task without fully…

计算与语言 · 计算机科学 2023-09-07 Son Quoc Tran , Matt Kretchmar

Tree ensembles are powerful models that are widely used. However, they are susceptible to adversarial examples, which are examples that purposely constructed to elicit a misprediction from the model. This can degrade performance and erode a…

机器学习 · 计算机科学 2022-06-28 Laurens Devos , Wannes Meert , Jesse Davis

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

计算与语言 · 计算机科学 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Why are classifiers in high dimension vulnerable to "adversarial" perturbations? We show that it is likely not due to information theoretic limitations, but rather it could be due to computational constraints. First we prove that, for a…

机器学习 · 统计学 2018-05-28 Sébastien Bubeck , Eric Price , Ilya Razenshteyn

Adversarial examples are carefully crafted attack points that are supposed to fool machine learning classifiers. In the last years, the field of adversarial machine learning, especially the study of perturbation-based adversarial examples,…

机器学习 · 计算机科学 2023-09-19 Roland Rauter , Martin Nocker , Florian Merkle , Pascal Schöttle

Adversarial training is a popular method to robustify models against adversarial attacks. However, it exhibits much more severe overfitting than training on clean inputs. In this work, we investigate this phenomenon from the perspective of…

机器学习 · 计算机科学 2024-12-18 Chen Liu , Zhichao Huang , Mathieu Salzmann , Tong Zhang , Sabine Süsstrunk

Deep regression models typically learn in an end-to-end fashion without explicitly emphasizing a regression-aware representation. Consequently, the learned representations exhibit fragmentation and fail to capture the continuous nature of…

机器学习 · 计算机科学 2023-10-11 Kaiwen Zha , Peng Cao , Jeany Son , Yuzhe Yang , Dina Katabi

We propose a simple and general method to regularize the fine-tuning of Transformer-based encoders for text classification tasks. Specifically, during fine-tuning we generate adversarial examples by perturbing the word embeddings of the…

计算与语言 · 计算机科学 2022-02-21 Lin Pan , Chung-Wei Hang , Avirup Sil , Saloni Potdar

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-perturbed inputs aimed to mislead classification. This work proposes a detection method based on combining non-linear dimensionality reduction and density…

机器学习 · 计算机科学 2019-05-02 Francesco Crecchi , Davide Bacciu , Battista Biggio

This work proposes a novel model-free Reinforcement Learning (RL) agent that is able to learn how to complete an unknown task having access to only a part of the input observation. We take inspiration from the concepts of visual attention…

机器学习 · 计算机科学 2023-01-16 Gonçalo Querido , Alberto Sardinha , Francisco S. Melo