English
Related papers

Related papers: Revealing the Dark Secrets of BERT

200 papers

Self-attention has greatly contributed to the success of the widely used Transformer architecture by enabling learning from data with long-range dependencies. In an effort to improve performance, a gated attention model that leverages a…

Machine Learning · Computer Science 2026-02-03 Viet Nguyen , Tuan Minh Pham , Thinh Cao , Tan Dinh , Huy Nguyen , Nhat Ho , Alessandro Rinaldo

Contextual word embedding models such as ELMo (Peters et al., 2018) and BERT (Devlin et al., 2018) have dramatically improved performance for many natural language processing (NLP) tasks in recent months. However, these models have been…

Computation and Language · Computer Science 2019-06-24 Emily Alsentzer , John R. Murphy , Willie Boag , Wei-Hung Weng , Di Jin , Tristan Naumann , Matthew B. A. McDermott

This paper studies the performances and behaviors of BERT in ranking tasks. We explore several different ways to leverage the pre-trained BERT and fine-tune it on two ranking tasks: MS MARCO passage reranking and TREC Web Track ad hoc…

Information Retrieval · Computer Science 2019-04-29 Yifan Qiao , Chenyan Xiong , Zhenghao Liu , Zhiyuan Liu

Attention mechanism has been extensively integrated within mainstream neural network architectures, such as Transformers and graph attention networks. Yet, its underlying working principles remain somewhat elusive. What is its essence? Are…

Machine Learning · Computer Science 2024-12-25 Tianyu Ruan , Shihua Zhang

Learned self-attention functions in state-of-the-art NLP models often correlate with human attention. We investigate whether self-attention in large-scale pre-trained language models is as predictive of human eye fixation patterns during…

Computation and Language · Computer Science 2022-05-23 Stephanie Brandl , Oliver Eberle , Jonas Pilot , Anders Søgaard

LLMs' performance on complex tasks is still unsatisfactory. A key issue is that presently LLMs learn in a data-driven schema, while the instructions about these complex tasks are both scarce and hard to collect or construct. On the…

Machine Learning · Computer Science 2024-10-21 Yang Zhao , Li Du , Xiao Ding , Kai Xiong , Ting Liu , Bing Qin

Transformer-based models, such as BERT and GPT, have been widely adopted in natural language processing (NLP) due to their exceptional performance. However, recent studies show their vulnerability to textual adversarial attacks where the…

Computation and Language · Computer Science 2023-12-01 Lujia Shen , Yuwen Pu , Shouling Ji , Changjiang Li , Xuhong Zhang , Chunpeng Ge , Ting Wang

Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this question in a confined problem space where there…

Computation and Language · Computer Science 2022-05-26 Honghua Zhang , Liunian Harold Li , Tao Meng , Kai-Wei Chang , Guy Van den Broeck

In recent years, large Transformer-based Pre-trained Language Models (PLM) have changed the Natural Language Processing (NLP) landscape, by pushing the performance boundaries of the state-of-the-art on a wide variety of tasks. However, this…

Computation and Language · Computer Science 2024-01-15 Thibaud Leteno , Antoine Gourru , Charlotte Laclau , Christophe Gravier

The Mixup method has proven to be a powerful data augmentation technique in Computer Vision, with many successors that perform image mixing in a guided manner. One of the interesting research directions is transferring the underlying Mixup…

Computation and Language · Computer Science 2023-09-21 Dominik Lewy , Jacek Mańdziuk

Transformers-based models, such as BERT, have been one of the most successful deep learning models for NLP. Unfortunately, one of their core limitations is the quadratic dependency (mainly in terms of memory) on the sequence length due to…

Bidirectional Encoder Representations from Transformers (BERT) has recently achieved state-of-the-art performance on a broad range of NLP tasks including sentence classification, machine translation, and question answering. The BERT model…

Computation and Language · Computer Science 2020-03-17 Zhiheng Huang , Peng Xu , Davis Liang , Ajay Mishra , Bing Xiang

Fine-tuning large pre-trained models with task-specific data has achieved great success in NLP. However, it has been demonstrated that the majority of information within the self-attention networks is redundant and not utilized effectively…

Computation and Language · Computer Science 2021-06-02 Jiaao Chen , Dinghan Shen , Weizhu Chen , Diyi Yang

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformer and graph attention network (GAT), are widely utilized…

Machine Learning · Computer Science 2021-03-02 Kyungwoo Song , Yohan Jung , Dongjun Kim , Il-Chul Moon

Contextual language models (CLMs) have pushed the NLP benchmarks to a new height. It has become a new norm to utilize CLM provided word embeddings in downstream tasks such as text classification. However, unless addressed, CLMs are prone to…

Computation and Language · Computer Science 2020-09-11 Rishabh Bhardwaj , Navonil Majumder , Soujanya Poria

Pre-trained language models have recently contributed to significant advances in NLP tasks. Recently, multi-modal versions of BERT have been developed, using heavy pre-training relying on vast corpora of aligned textual and image data,…

Computation and Language · Computer Science 2020-12-17 Thomas Scialom , Patrick Bordes , Paul-Alexis Dray , Jacopo Staiano , Patrick Gallinari

Attention based language models have become a critical component in state-of-the-art natural language processing systems. However, these models have significant computational requirements, due to long training times, dense operations and…

Computation and Language · Computer Science 2021-06-11 Ivan Chelombiev , Daniel Justus , Douglas Orr , Anastasia Dietrich , Frithjof Gressmann , Alexandros Koliousis , Carlo Luschi

Pretrained language models (PLMs) form the basis of most state-of-the-art NLP technologies. Nevertheless, they are essentially black boxes: Humans do not have a clear understanding of what knowledge is encoded in different parts of the…

Computation and Language · Computer Science 2023-11-15 Tanja Baeumel , Soniya Vijayakumar , Josef van Genabith , Guenter Neumann , Simon Ostermann

Transformers are emerging as the new workhorse of NLP, showing great success across tasks. Unlike LSTMs, transformers process input sequences entirely through self-attention. Previous work has suggested that the computational capabilities…

Computation and Language · Computer Science 2021-06-28 Michael Hahn

While large-scale pre-trained language models like BERT have advanced the state-of-the-art in IR, its application in query performance prediction (QPP) is so far based on pointwise modeling of individual queries. Meanwhile, recent studies…

Information Retrieval · Computer Science 2022-04-26 Xiaoyang Chen , Ben He , Le Sun