English
Related papers

Related papers: Enhancing Translation Language Models with Word Em…

200 papers

Recent approaches to cross-lingual word embedding have generally been based on linear transformations between the sets of embedding vectors in the two languages. In this paper, we propose an approach that instead expresses the two…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Xuezhe Ma , Di Wang , Graham Neubig

Word embeddings are an essential instrument in many NLP tasks. Most available resources are trained on general language from Web corpora or Wikipedia dumps. However, word embeddings for domain-specific language are rare, in particular for…

Computation and Language · Computer Science 2023-02-14 Ricardo Schiffers , Dagmar Kern , Daniel Hienert

Word embeddings have been widely used in biomedical Natural Language Processing (NLP) applications as they provide vector representations of words capturing the semantic properties of words and the linguistic relationship between words.…

Information Retrieval · Computer Science 2018-07-20 Yanshan Wang , Sijia Liu , Naveed Afzal , Majid Rastegar-Mojarad , Liwei Wang , Feichen Shen , Paul Kingsbury , Hongfang Liu

This paper proposes a novel Recurrent Neural Network (RNN) language model that takes advantage of character information. We focus on character n-grams based on research in the field of word embedding construction (Wieting et al. 2016). Our…

Computation and Language · Computer Science 2019-06-14 Sho Takase , Jun Suzuki , Masaaki Nagata

Millions of repetitive code snippets are submitted to code repositories every day. To search from these large codebases using simple natural language queries would allow programmers to ideate, prototype, and develop easier and faster.…

Despite interest in using cross-lingual knowledge to learn word embeddings for various tasks, a systematic comparison of the possible approaches is lacking in the literature. We perform an extensive evaluation of four popular approaches of…

Computation and Language · Computer Science 2016-06-09 Shyam Upadhyay , Manaal Faruqui , Chris Dyer , Dan Roth

While neural network approaches are achieving breakthrough performance in the natural language related fields, there have been few similar attempts at mathematical language related tasks. In this study, we explore the potential of applying…

Information Retrieval · Computer Science 2017-08-30 Liangcai Gao , Zhuoren Jiang , Yue Yin , Ke Yuan , Zuoyu Yan , Zhi Tang

Neural networks are among the state-of-the-art techniques for language modeling. Existing neural language models typically map discrete words to distributed, dense vector representations. After information processing of the preceding…

Computation and Language · Computer Science 2016-10-14 Yunchuan Chen , Lili Mou , Yan Xu , Ge Li , Zhi Jin

Assessing the degree of semantic relatedness between words is an important task with a variety of semantic applications, such as ontology learning for the Semantic Web, semantic search or query expansion. To accomplish this in an automated…

Computation and Language · Computer Science 2017-05-25 Thomas Niebler , Martin Becker , Christian Pölitz , Andreas Hotho

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

Providing access to information across languages has been a goal of Information Retrieval (IR) for decades. While progress has been made on Cross Language IR (CLIR) where queries are expressed in one language and documents in another, the…

Information Retrieval · Computer Science 2023-02-10 Dawn Lawrie , Eugene Yang , Douglas W. Oard , James Mayfield

Text embeddings are essential for many tasks, such as document retrieval, clustering, and semantic similarity assessment. In this paper, we study how to contrastively train text embedding models in a compute-optimal fashion, given a suite…

Machine Learning · Computer Science 2024-11-22 Alicja Ziarko , Albert Q. Jiang , Bartosz Piotrowski , Wenda Li , Mateja Jamnik , Piotr Miłoś

The advent of Large Language Models (LLMs) heralds a pivotal shift in online user interactions with information. Traditional Information Retrieval (IR) systems primarily relied on query-document matching, whereas LLMs excel in comprehending…

Information Retrieval · Computer Science 2023-11-22 Samira Ghodratnama , Mehrdad Zakershahrak

Relation extraction (RE) seeks to detect and classify semantic relationships between entities, which provides useful information for many NLP applications. Since the state-of-the-art RE models require large amounts of manually annotated…

Computation and Language · Computer Science 2019-11-13 Jian Ni , Radu Florian

Despite advances in neural machine translation, cross-lingual retrieval tasks in which queries and documents live in different natural language spaces remain challenging. Although neural translation models may provide an intuitive approach…

Information Retrieval · Computer Science 2021-07-30 Zhizhong Chen , Carsten Eickhoff

Analyzing the pattern of semantic variation in long real-world texts such as books or transcripts is interesting from the stylistic, cognitive, and linguistic perspectives. It is also useful for applications such as text segmentation,…

Computation and Language · Computer Science 2023-08-10 Deven M. Mistry , Ali A. Minai

Semantic textual similarity is one of the open research challenges in the field of Natural Language Processing. Extensive research has been carried out in this field and near-perfect results are achieved by recent transformer-based models…

Computation and Language · Computer Science 2021-07-13 Dhivya Chandrasekaran , Vijay Mago

Distributed word representations have been demonstrated to be effective in capturing semantic and syntactic regularities. Unsupervised representation learning from large unlabeled corpora can learn similar representations for those words…

Computation and Language · Computer Science 2015-12-01 Chunting Zhou , Chonglin Sun , Zhiyuan Liu , Francis C. M. Lau

Deep learning based techniques have been recently used with promising results for data integration problems. Some methods directly use pre-trained embeddings that were trained on a large corpus such as Wikipedia. However, they may not…

Databases · Computer Science 2020-09-04 Riccardo Cappuzzo , Paolo Papotti , Saravanan Thirumuruganathan

We propose semantic smoothing, a smoothing method for language models that uses embeddings to share statistical observations across semantically similar contexts. The starting point is a decomposition of log-perplexity that motivates…

Information Theory · Computer Science 2026-05-11 Haricharan Balasundaram , Swathi Shree Narashiman , Pranay Mathur , Andrew Thangaraj