中文
相关论文

相关论文: Text Segmentation Based on Similarity between Word…

200 篇论文

With the increasing number of texts made available on the Internet, many applications have relied on text mining tools to tackle a diversity of problems. A relevant model to represent texts is the so-called word adjacency (co-occurrence)…

计算与语言 · 计算机科学 2019-02-25 Henrique F. de Arruda , Vanessa Q. Marinho , Luciano da F. Costa , Diego R. Amancio

Lexical chain consists of cohesion words in a document, which implies the underlying structure of a text, and thus facilitates downstream NLP tasks. Nevertheless, existing work focuses on detecting the simple surface lexicons with shallow…

计算与语言 · 计算机科学 2020-09-22 Bobo Li , Hao Fei , Yafeng Ren , Donghong Ji

Text segmentation is important for signaling a document's structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend the text, let alone find important information. The problem…

计算与语言 · 计算机科学 2022-11-01 Sangwoo Cho , Kaiqiang Song , Xiaoyang Wang , Fei Liu , Dong Yu

Most conventional sentence similarity methods only focus on similar parts of two input sentences, and simply ignore the dissimilar parts, which usually give us some clues and semantic meanings about the sentences. In this work, we propose a…

计算与语言 · 计算机科学 2017-07-18 Zhiguo Wang , Haitao Mi , Abraham Ittycheriah

Topic segmentation is important in understanding scientific documents since it can not only provide better readability but also facilitate downstream tasks such as information retrieval and question answering by creating appropriate…

计算与语言 · 计算机科学 2023-01-06 Jeonghwan Lee , Jiyeong Han , Sunghoon Baek , Min Song

This paper introduces a new statistical approach to partitioning text automatically into coherent segments. Our approach enlists both short-range and long-range language models to help it sniff out likely sites of topic changes in text. To…

cmp-lg · 计算机科学 2008-02-03 Doug Beeferman , Adam Berger , John Lafferty

Identifying texts with a given semantics is central for many information seeking scenarios. Similarity search over vector embeddings appear to be central to this ability, yet the similarity reflected in current text embeddings is…

计算与语言 · 计算机科学 2024-07-25 Shauli Ravfogel , Valentina Pyatkin , Amir DN Cohen , Avshalom Manevich , Yoav Goldberg

Text alignment finds application in tasks such as citation recommendation and plagiarism detection. Existing alignment methods operate at a single, predefined level and cannot learn to align texts at, for example, sentence and document…

计算与语言 · 计算机科学 2020-10-06 Xuhui Zhou , Nikolaos Pappas , Noah A. Smith

Modeling the structure of coherent texts is a key NLP problem. The task of coherently organizing a given set of sentences has been commonly used to build and evaluate models that understand such structure. We propose an end-to-end…

计算与语言 · 计算机科学 2017-12-25 Lajanugen Logeswaran , Honglak Lee , Dragomir Radev

Document and discourse segmentation are two fundamental NLP tasks pertaining to breaking up text into constituents, which are commonly used to help downstream tasks such as information retrieval or text summarization. In this work, we…

计算与语言 · 计算机科学 2020-12-08 Michal Lukasik , Boris Dadachev , Gonçalo Simões , Kishore Papineni

Many real systems have been modelled in terms of network concepts, and written texts are a particular example of information networks. In recent years, the use of network methods to analyze language has allowed the discovery of several…

计算与语言 · 计算机科学 2016-06-28 Henrique F. de Arruda , Luciano da F. Costa , Diego R. Amancio

When dealing with document similarity many methods exist today, like cosine similarity. More complex methods are also available based on the semantic analysis of textual information, which are computationally expensive and rarely used in…

信息检索 · 计算机科学 2015-05-18 Giancarlo Crocetti

In this paper, we propose a novel deep coherence model (DCM) using a convolutional neural network architecture to capture the text coherence. The text coherence problem is investigated with a new perspective of learning sentence…

计算与语言 · 计算机科学 2017-10-24 Baiyun Cui , Yingming Li , Yaqing Zhang , Zhongfei Zhang

In this work, we propose a novel hybrid method for scene text detection namely Correlation Propagation Network (CPN). It is an end-to-end trainable framework engined by advanced Convolutional Neural Networks. Our CPN predicts text objects…

计算机视觉与模式识别 · 计算机科学 2018-10-02 Zichuan Liu , Guosheng Lin , Wang Ling Goh , Fayao Liu , Chunhua Shen , Xiaokang Yang

Text segmentation aims to divide text into contiguous, semantically coherent segments, while segment labeling deals with producing labels for each segment. Past work has shown success in tackling segmentation and labeling for documents and…

计算与语言 · 计算机科学 2022-09-29 Hakan Inan , Rashi Rungta , Yashar Mehdad

Coherence is an important aspect of text quality, and various approaches have been applied to coherence modeling. However, existing methods solely focus on a single document's coherence patterns, ignoring the underlying correlation between…

计算与语言 · 计算机科学 2023-06-13 Wei Liu , Xiyan Fu , Michael Strube

The technology of automatic document summarization is maturing and may provide a solution to the information overload problem. Nowadays, document summarization plays an important role in information retrieval. With a large volume of…

信息检索 · 计算机科学 2012-04-10 Mohsen Pourvali , Mohammad Saniee Abadeh

Word embeddings are effective intermediate representations for capturing semantic regularities between words, when learning the representations of text sequences. We propose to view text classification as a label-word joint embedding…

计算与语言 · 计算机科学 2018-05-14 Guoyin Wang , Chunyuan Li , Wenlin Wang , Yizhe Zhang , Dinghan Shen , Xinyuan Zhang , Ricardo Henao , Lawrence Carin

Similarity is a comparative-subjective measure that varies with the domain within which it is considered. In several NLP applications such as document classification, pattern recognition, chatbot question-answering, sentiment analysis,…

机器学习 · 计算机科学 2021-11-11 Manuela Nayantara Jeyaraj , Dharshana Kasthurirathna

There exist several methods of calculating a similarity curve, or a sequence of similarity values, representing the lexical cohesion of successive text constituents, e.g., paragraphs. Methods for deciding the locations of fragment…

计算与语言 · 计算机科学 2007-05-23 Oskari Heinonen