中文
相关论文

相关论文: Breaking BERT: Understanding its Vulnerabilities f…

200 篇论文

Recognizing entities in texts is a central need in many information-seeking scenarios, and indeed, Named Entity Recognition (NER) is arguably one of the most successful examples of a widely adopted NLP task and corresponding NLP technology.…

计算与语言 · 计算机科学 2023-10-24 Uri Katz , Matan Vetzler , Amir DN Cohen , Yoav Goldberg

Recent developments in Natural Language Processing have led to the introduction of state-of-the-art Neural Language Models, enabled with unsupervised transferable learning, using different pretraining objectives. While these models achieve…

计算与语言 · 计算机科学 2021-03-23 Muhammad Zohaib Khan

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

密码学与安全 · 计算机科学 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

We are surprised to find that BERT's peak performance of 77% on the Argument Reasoning Comprehension Task reaches just three points below the average untrained human baseline. However, we show that this result is entirely accounted for by…

计算与语言 · 计算机科学 2019-09-17 Timothy Niven , Hung-Yu Kao

The emergence and rapid progress of the Internet have brought ever-increasing impact on financial domain. How to rapidly and accurately mine the key information from the massive negative financial texts has become one of the key issues for…

计算与语言 · 计算机科学 2020-01-16 Lingyun Zhao , Lin Li , Xinhao Zheng

Named entity recognition (NER) for identifying proper nouns in unstructured text is one of the most important and fundamental tasks in natural language processing. However, despite the widespread use of NER models, they still require a…

计算与语言 · 计算机科学 2020-12-23 Zhifeng Hao , Di Lv , Zijian Li , Ruichu Cai , Wen Wen , Boyan Xu

Recent advances in natural language processing (NLP) can be largely attributed to the advent of pre-trained language models such as BERT and RoBERTa. While these models demonstrate remarkable performance on general datasets, they can…

Estimation of semantic similarity is an important research problem both in natural language processing and the natural language understanding, and that has tremendous application on various downstream tasks such as question answering,…

计算与语言 · 计算机科学 2025-06-24 R. Prashanth

Backdoor attacks are an insidious security threat against machine learning models. Adversaries can manipulate the predictions of compromised models by inserting triggers into the training phase. Various backdoor attacks have been devised…

计算与语言 · 计算机科学 2023-05-29 Xuanli He , Jun Wang , Benjamin Rubinstein , Trevor Cohn

Recent advances in language representation using neural networks have made it viable to transfer the learned internal states of a trained model to downstream natural language processing tasks, such as named entity recognition (NER) and…

计算与语言 · 计算机科学 2020-02-28 Fábio Souza , Rodrigo Nogueira , Roberto Lotufo

Named entity recognition is a key component of Information Extraction (IE), particularly in scientific domains such as biomedicine and chemistry, where large language models (LLMs), e.g., ChatGPT, fall short. We investigate the…

计算与语言 · 计算机科学 2024-04-02 Hongyi Liu , Qingyun Wang , Payam Karisani , Heng Ji

Named Entity Recognition (NER) systems often demonstrate great performance on in-distribution data, but perform poorly on examples drawn from a shifted distribution. One way to evaluate the generalization ability of NER models is to use…

计算与语言 · 计算机科学 2022-03-22 Aaron Reich , Jiaao Chen , Aastha Agrawal , Yanzhe Zhang , Diyi Yang

Neural language representation models such as BERT, pre-trained on large-scale unstructured corpora lack explicit grounding to real-world commonsense knowledge and are often unable to remember facts required for reasoning and inference.…

计算与语言 · 计算机科学 2021-08-04 Amit Gajbhiye , Noura Al Moubayed , Steven Bradley

One of the main tasks of Natural Language Processing (NLP), is Named Entity Recognition (NER). It is used in many applications and also can be used as an intermediate step for other tasks. We present ANER, a web-based named entity…

计算与语言 · 计算机科学 2023-08-30 Abdelrahman "Boda" Sadallah , Omar Ahmed , Shimaa Mohamed , Omar Hatem , Doaa Hesham , Ahmed H. Yousef

We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper…

计算与语言 · 计算机科学 2021-01-28 Xiao Fu , Guijun Zhang

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

计算与语言 · 计算机科学 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

Transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance across various NLP tasks including the identification of offensive language and hate speech, an important problem in social media. In this…

计算与语言 · 计算机科学 2021-09-14 Diptanu Sarkar , Marcos Zampieri , Tharindu Ranasinghe , Alexander Ororbia

A typical architecture for end-to-end entity linking systems consists of three steps: mention detection, candidate generation and entity disambiguation. In this study we investigate the following questions: (a) Can all those steps be…

计算与语言 · 计算机科学 2021-01-14 Samuel Broscheit

Cross-domain NER is a practical yet challenging problem since the data scarcity in the real-world scenario. A common practice is first to learn a NER model in a rich-resource general domain and then adapt the model to specific domains. Due…

计算与语言 · 计算机科学 2024-08-09 Junhao Zheng , Haibin Chen , Qianli Ma

Existing state of the art neural entity linking models employ attention-based bag-of-words context model and pre-trained entity embeddings bootstrapped from word embeddings to assess topic level context compatibility. However, the latent…

计算与语言 · 计算机科学 2020-01-07 Shuang Chen , Jinpeng Wang , Feng Jiang , Chin-Yew Lin