中文
相关论文

相关论文: Corpus-based Method for Automatic Identification o…

200 篇论文

Lemmatization is a natural language processing (NLP) task which consists of producing, from a given inflected word, its canonical form or lemma. Lemmatization is one of the basic tasks that facilitate downstream NLP applications, and is of…

计算与语言 · 计算机科学 2023-10-23 Olia Toporkov , Rodrigo Agerri

Robust language processing systems are becoming increasingly important given the recent awareness of dangerous situations where brittle machine learning models can be easily broken with the presence of noises. In this paper, we introduce a…

计算与语言 · 计算机科学 2019-11-25 Zhiwei Wang , Hui Liu , Jiliang Tang , Songfan Yang , Gale Yan Huang , Zitao Liu

This paper introduces a named entity recognition approach in textual corpus. This Named Entity (NE) can be a named: location, person, organization, date, time, etc., characterized by instances. A NE is found in texts accompanied by…

信息检索 · 计算机科学 2011-03-01 Wahiba Ben Abdessalem Karaa

One major deficiency of most semantic representation techniques is that they usually model a word type as a single point in the semantic space, hence conflating all the meanings that the word can have. Addressing this issue by learning…

计算与语言 · 计算机科学 2016-08-08 Mohammad Taher Pilehvar , Nigel Collier

As the first step in automated natural language processing, representing words and sentences is of central importance and has attracted significant research attention. Different approaches, from the early one-hot and bag-of-words…

计算与语言 · 计算机科学 2019-11-06 Wenye Li , Senyue Hao

In this study, we propose a method that distils representations of word meaning in context from a pre-trained masked language model in both monolingual and crosslingual settings. Word representations are the basis for context-aware lexical…

计算与语言 · 计算机科学 2024-09-16 Yuki Arase , Tomoyuki Kajiwara

In settings from fact-checking to question answering, we frequently want to know whether a collection of evidence (premises) entails a hypothesis. Existing methods primarily focus on the end-to-end discriminative version of this task, but…

计算与语言 · 计算机科学 2022-10-31 Kaj Bostrom , Zayne Sprague , Swarat Chaudhuri , Greg Durrett

Tokenization - the practice of converting strings of characters from an alphabet into sequences of tokens over a vocabulary - is a critical step in the NLP pipeline. The use of token representations is widely credited with increased model…

计算与语言 · 计算机科学 2025-04-04 Juan Luis Gastaldi , John Terilla , Luca Malagutti , Brian DuSell , Tim Vieira , Ryan Cotterell

Revealing the implicit semantic relation between the constituents of a noun-compound is important for many NLP applications. It has been addressed in the literature either as a classification task to a set of pre-defined relations or by…

计算与语言 · 计算机科学 2018-05-08 Vered Shwartz , Ido Dagan

Slang is a common type of informal language, but its flexible nature and paucity of data resources present challenges for existing natural language systems. We take an initial step toward machine generation of slang by developing a…

计算与语言 · 计算机科学 2021-05-25 Zhewei Sun , Richard Zemel , Yang Xu

We present a token-level decision summarization framework that utilizes the latent topic structures of utterances to identify "summary-worthy" words. Concretely, a series of unsupervised topic models is explored and experimental results…

计算与语言 · 计算机科学 2016-06-28 Lu Wang , Claire Cardie

The verbalizer, which serves to map label words to class labels, is an essential component of prompt-tuning. In this paper, we present a novel approach to constructing verbalizers. While existing methods for verbalizer construction mainly…

计算与语言 · 计算机科学 2024-07-16 Yong Ma , Senlin Luo , Yu-Ming Shang , Zhengjun Li , Yong Liu

Despite the great development of document summarisation techniques nowadays, factual inconsistencies between the generated summaries and the original texts still occur from time to time. This study explores the possibility of adopting…

计算与语言 · 计算机科学 2023-05-18 Chen Chen , Wei Emma Zhang , Alireza Seyed Shakeri , Makhmoor Fiza

English verbs have multiple forms. For instance, talk may also appear as talks, talked or talking, depending on the context. The NLP task of lemmatization seeks to map these diverse forms back to a canonical one, known as the lemma. We…

计算与语言 · 计算机科学 2024-05-29 Chaitanya Malaviya , Shijie Wu , Ryan Cotterell

This paper presents an incremental method for the tagging of proper names in German newspaper texts. The tagging is performed by the analysis of the syntactic and textual contexts of proper names together with a morphological analysis. The…

cmp-lg · 计算机科学 2008-02-03 Christine Thielen

There are several linguistic claims about situations where words are more likely to be used as metaphors. However, few studies have sought to verify such claims with large corpora. This study entails a large-scale, corpus-based analysis of…

计算与语言 · 计算机科学 2024-04-02 Kotaro Aono , Ryohei Sasano , Koichi Takeda

Framing involves the positive or negative presentation of an argument or issue depending on the audience and goal of the speaker (Entman 1983). Differences in lexical framing, the focus of our work, can have large effects on peoples'…

计算与语言 · 计算机科学 2021-04-13 Tuhin Chakrabarty , Christopher Hidey , Smaranda Muresan

Nowadays, search engine users commonly rely on query suggestions to improve their initial inputs. Current systems are very good at recommending lexical adaptations or spelling corrections to users' queries. However, they often struggle to…

信息检索 · 计算机科学 2023-01-24 Jorge Gabín , M. Eduardo Ares , Javier Parapar

Modern language models are typically trained over subword sequences, but ultimately define probabilities over character-strings. Ideally, the choice of the tokeniser -- which maps character-strings to subwords -- should not affect the…

计算与语言 · 计算机科学 2025-06-04 Pietro Lesci , Clara Meister , Thomas Hofmann , Andreas Vlachos , Tiago Pimentel

Distributional models are derived from co-occurrences in a corpus, where only a small proportion of all possible plausible co-occurrences will be observed. This results in a very sparse vector space, requiring a mechanism for inferring…

计算与语言 · 计算机科学 2016-08-25 Thomas Kober , Julie Weeds , Jeremy Reffin , David Weir