English
Related papers

Related papers: BERT Cannot Align Characters

200 papers

While multilingual language models can improve NLP performance on low-resource languages by leveraging higher-resource languages, they also reduce average performance on all languages (the 'curse of multilinguality'). Here we show another…

Computation and Language · Computer Science 2023-04-14 Isabel Papadimitriou , Kezia Lopez , Dan Jurafsky

The BERT family of neural language models have become highly popular due to their ability to provide sequences of text with rich context-sensitive token encodings which are able to generalise well to many NLP tasks. We introduce gaBERT, a…

Computation and Language · Computer Science 2022-06-29 James Barry , Joachim Wagner , Lauren Cassidy , Alan Cowap , Teresa Lynn , Abigail Walsh , Mícheál J. Ó Meachair , Jennifer Foster

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

Analogies play a central role in human commonsense reasoning. The ability to recognize analogies such as "eye is to seeing what ear is to hearing", sometimes referred to as analogical proportions, shape how we structure knowledge and…

Computation and Language · Computer Science 2022-09-12 Asahi Ushio , Luis Espinosa-Anke , Steven Schockaert , Jose Camacho-Collados

Article prediction is a task that has long defied accurate linguistic description. As such, this task is ideally suited to evaluate models on their ability to emulate native-speaker intuition. To this end, we compare the performance of…

Computation and Language · Computer Science 2022-06-10 Harish Tayyar Madabushi , Dagmar Divjak , Petar Milin

Machine based text comprehension has always been a significant research field in natural language processing. Once a full understanding of the text context and semantics is achieved, a deep learning model can be trained to solve a large…

Computation and Language · Computer Science 2020-09-03 Omar Mossad , Amgad Ahmed , Anandharaju Raju , Hari Karthikeyan , Zayed Ahmed

In this paper, we explore the idea of analysing the historical bias of contextual language models based on BERT by measuring their adequacy with respect to Early Modern (EME) and Modern (ME) English. In our preliminary experiments, we…

Computation and Language · Computer Science 2024-02-08 Miriam Cuscito , Alfio Ferrara , Martin Ruskov

Multiple neural language models have been developed recently, e.g., BERT and XLNet, and achieved impressive results in various NLP tasks including sentence classification, question answering and document ranking. In this paper, we explore…

Information Retrieval · Computer Science 2020-04-29 Zhuolin Jiang , Amro El-Jaroudi , William Hartmann , Damianos Karakos , Lingjun Zhao

We show that BERT (Devlin et al., 2018) is a Markov random field language model. This formulation gives way to a natural procedure to sample sentences from BERT. We generate from BERT and find that it can produce high-quality, fluent…

Computation and Language · Computer Science 2019-04-11 Alex Wang , Kyunghyun Cho

Recently, multilingual BERT works remarkably well on cross-lingual transfer tasks, superior to static non-contextualized word embeddings. In this work, we provide an in-depth experimental study to supplement the existing literature of…

Computation and Language · Computer Science 2020-10-22 Chi-Liang Liu , Tsung-Yuan Hsu , Yung-Sung Chuang , Hung-yi Lee

The latest work on language representations carefully integrates contextualized features into language model training, which enables a series of success especially in various machine reading comprehension and natural language inference…

Computation and Language · Computer Science 2020-02-05 Zhuosheng Zhang , Yuwei Wu , Hai Zhao , Zuchao Li , Shuailiang Zhang , Xi Zhou , Xiang Zhou

In this work, we induce character-level noise in various forms when fine-tuning BERT to enable zero-shot cross-lingual transfer to unseen dialects and languages. We fine-tune BERT on three sentence-level classification tasks and evaluate…

Computation and Language · Computer Science 2023-04-03 Aarohi Srivastava , David Chiang

Low-resource languages, such as Baltic languages, benefit from Large Multilingual Models (LMs) that possess remarkable cross-lingual transfer performance capabilities. This work is an interpretation and analysis study into cross-lingual…

Computation and Language · Computer Science 2022-08-16 Maksym Del , Mark Fishel

In this review, we describe the application of one of the most popular deep learning-based language models - BERT. The paper describes the mechanism of operation of this model, the main areas of its application to the tasks of text…

Computation and Language · Computer Science 2021-03-23 M. V. Koroteev

Detecting fine-grained differences in content conveyed in different languages matters for cross-lingual NLP and multilingual corpora analysis, but it is a challenging machine learning problem since annotation is expensive and hard to scale.…

Computation and Language · Computer Science 2020-10-09 Eleftheria Briakou , Marine Carpuat

Reverse dictionary is the task to find the proper target word given the word description. In this paper, we tried to incorporate BERT into this task. However, since BERT is based on the byte-pair-encoding (BPE) subword encoding, it is…

Computation and Language · Computer Science 2020-10-01 Hang Yan , Xiaonan Li , Xipeng Qiu

Word order variances generally exist in different languages. In this paper, we hypothesize that cross-lingual models that fit into the word order of the source language might fail to handle target languages. To verify this hypothesis, we…

Computation and Language · Computer Science 2020-12-09 Zihan Liu , Genta Indra Winata , Samuel Cahyawijaya , Andrea Madotto , Zhaojiang Lin , Pascale Fung

Estimation of semantic similarity is an important research problem both in natural language processing and the natural language understanding, and that has tremendous application on various downstream tasks such as question answering,…

Computation and Language · Computer Science 2025-06-24 R. Prashanth

Language Models (LMs) such as BERT, have been shown to perform well on the task of identifying Named Entities (NE) in text. A BERT LM is typically used as a classifier to classify individual tokens in the input text, or to classify spans of…

Computation and Language · Computer Science 2024-03-04 Edward Whittaker , Ikuo Kitagishi

Token embeddings in multilingual BERT (m-BERT) contain both language and semantic information. We find that the representation of a language can be obtained by simply averaging the embeddings of the tokens of the language. Given this…

Computation and Language · Computer Science 2021-11-02 Chi-Liang Liu , Tsung-Yuan Hsu , Yung-Sung Chuang , Chung-Yi Li , Hung-yi Lee