English
Related papers

Related papers: Do NLP Models Know Numbers? Probing Numeracy in Em…

200 papers

Neural language models learn word representations that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models. We show that translation-based embeddings outperform…

Computation and Language · Computer Science 2014-11-14 Felix Hill , KyungHyun Cho , Sebastien Jean , Coline Devin , Yoshua Bengio

Numerical reasoning over text (NRoT) presents unique challenges that are not well addressed by existing pre-training objectives. We explore five sequential training schedules that adapt a pre-trained T5 model for NRoT. Our final model is…

Computation and Language · Computer Science 2021-05-17 Peng-Jian Yang , Ying Ting Chen , Yuechan Chen , Daniel Cer

Pre-trained Transformer-based models have achieved state-of-the-art performance for various Natural Language Processing (NLP) tasks. However, these models often have billions of parameters, and, thus, are too resource-hungry and…

Machine Learning · Computer Science 2021-09-29 Prakhar Ganesh , Yao Chen , Xin Lou , Mohammad Ali Khan , Yin Yang , Hassan Sajjad , Preslav Nakov , Deming Chen , Marianne Winslett

We evaluate named entity representations of BERT-based NLP models by investigating their robustness to replacements from the same typed class in the input. We highlight that on several tasks while such perturbations are natural, state of…

Computation and Language · Computer Science 2020-07-15 Sriram Balasubramanian , Naman Jain , Gaurav Jindal , Abhijeet Awasthi , Sunita Sarawagi

Neural machine translation has achieved remarkable empirical performance over standard benchmark datasets, yet recent evidence suggests that the models can still fail easily dealing with substandard inputs such as misspelled words, To…

Computation and Language · Computer Science 2020-10-21 Haohan Wang , Peiyan Zhang , Eric P. Xing

Off-the-shelf pre-trained language models have become the de facto standard in NLP pipelines for a multitude of downstream tasks. However, the inability of these models to properly encode numerals limits their performance on tasks requiring…

Computation and Language · Computer Science 2024-08-09 Mandar Sharma , Rutuja Murlidhar Taware , Pravesh Koirala , Nikhil Muralidhar , Naren Ramakrishnan

Recent work incorporates pre-trained word embeddings such as BERT embeddings into Neural Topic Models (NTMs), generating highly coherent topics. However, with high-quality contextualized document representations, do we really need…

Computation and Language · Computer Science 2022-04-22 Zihan Zhang , Meng Fang , Ling Chen , Mohammad-Reza Namazi-Rad

Recognizing entities in texts is a central need in many information-seeking scenarios, and indeed, Named Entity Recognition (NER) is arguably one of the most successful examples of a widely adopted NLP task and corresponding NLP technology.…

Computation and Language · Computer Science 2023-10-24 Uri Katz , Matan Vetzler , Amir DN Cohen , Yoav Goldberg

Transformer-based models have pushed state of the art in many areas of NLP, but our understanding of what is behind their success is still limited. This paper is the first survey of over 150 studies of the popular BERT model. We review the…

Computation and Language · Computer Science 2020-11-10 Anna Rogers , Olga Kovaleva , Anna Rumshisky

Uncontextualized word embeddings are reliable feature representations of words used to obtain high quality results for various NLP applications. Given the historical success of word embeddings in NLP, we propose a retrospective on some of…

Computation and Language · Computer Science 2019-12-02 Edward Newell , Kian Kenyon-Dean , Jackie Chi Kit Cheung

Text-to-image generative models are capable of producing high-quality images that often faithfully depict concepts described using natural language. In this work, we comprehensively evaluate a range of text-to-image models on numerical…

Machine Learning · Computer Science 2025-02-07 Ivana Kajić , Olivia Wiles , Isabela Albuquerque , Matthias Bauer , Su Wang , Jordi Pont-Tuset , Aida Nematzadeh

Neural word representations have proven useful in Natural Language Processing (NLP) tasks due to their ability to efficiently model complex semantic and syntactic word relationships. However, most techniques model only one representation…

Computation and Language · Computer Science 2015-11-23 Andrew Trask , Phil Michalak , John Liu

From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text…

Computation and Language · Computer Science 2022-06-01 Sowmya S Sundaram , Sairam Gurajada , Marco Fisichella , Deepak P , Savitha Sam Abraham

Telecom services are at the core of today's societies' everyday needs. The availability of numerous online forums and discussion platforms enables telecom providers to improve their services by exploring the views of their customers to…

Computation and Language · Computer Science 2025-04-21 Hesham Abdelmotaleb , Craig McNeile , Malgorzata Wojtys

Evaluating model robustness is critical when developing trustworthy models not only to gain deeper understanding of model behavior, strengths, and weaknesses, but also to develop future models that are generalizable and robust across…

Computation and Language · Computer Science 2021-04-27 Maria Glenski , Ellyn Ayton , Robin Cosbey , Dustin Arendt , Svitlana Volkova

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

Computation and Language · Computer Science 2024-07-16 Parag Jain , Mirella Lapata

Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this question in a confined problem space where there…

Computation and Language · Computer Science 2022-05-26 Honghua Zhang , Liunian Harold Li , Tao Meng , Kai-Wei Chang , Guy Van den Broeck

Neural language models learn word representations, or embeddings, that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models, a recently-developed class of neural…

Computation and Language · Computer Science 2015-04-06 Felix Hill , Kyunghyun Cho , Sebastien Jean , Coline Devin , Yoshua Bengio

Transformers are widely used in NLP tasks. However, current approaches to leveraging transformers to understand language expose one weak spot: Number understanding. In some scenarios, numbers frequently occur, especially in semi-structured…

Computation and Language · Computer Science 2023-03-17 Hongwei Han , Jialiang Xu , Mengyu Zhou , Yijia Shao , Shi Han , Dongmei Zhang

Most state-of-the-art approaches for named-entity recognition (NER) use semi supervised information in the form of word clusters and lexicons. Recently neural network-based language models have been explored, as they as a byproduct generate…

Computation and Language · Computer Science 2014-04-23 Alexandre Passos , Vineet Kumar , Andrew McCallum