English
Related papers

Related papers: MinWikiSplit: A Sentence Splitting Corpus with Min…

200 papers

This paper provides a detailed description of the sentence segmentation system first introduced in cmp-lg/9411022. It provides results of systematic experiments involving sentence boundary determination, including context size, lexicon…

cmp-lg · Computer Science 2016-08-31 David D. Palmer

In this paper, we propose a novel strategy which is designed to enhance the accuracy of the parser by simplifying complex sentences before parsing. This approach involves the separate parsing of the constituent sub-sentences within a…

cmp-lg · Computer Science 2008-02-03 Peh Li Shiuan , Christopher Ting Hian Ann

This paper presents a graph cascade for sentence segmentation of XML documents. Our proposal offers sentences inside sentences for cases introduced by quotation marks and hyphens, and also pays particular attention to situations involving…

Computation and Language · Computer Science 2024-07-30 Sandrine Ollinger , Denis Maurel

Word segmentation is the first step of any tasks in Vietnamese language processing. This paper reviews stateof-the-art approaches and systems for word segmentation in Vietnamese. To have an overview of all stages from building corpora to…

Computation and Language · Computer Science 2019-06-19 Song Nguyen Duc Cong , Quoc Hung Ngo , Rachsuda Jiamthapthaksin

Many recent successes in sentence representation learning have been achieved by simply fine-tuning on the Natural Language Inference (NLI) datasets with triplet loss or siamese loss. Nevertheless, they share a common weakness: sentences in…

Computation and Language · Computer Science 2022-02-01 Dejiao Zhang , Shang-Wen Li , Wei Xiao , Henghui Zhu , Ramesh Nallapati , Andrew O. Arnold , Bing Xiang

The first step in discourse analysis involves dividing a text into segments. We annotate the first high-quality small-scale medical corpus in English with discourse segments and analyze how well news-trained segmenters perform on this…

Computation and Language · Computer Science 2019-04-16 Elisa Ferracane , Titan Page , Junyi Jessy Li , Katrin Erk

We present a system that allows a user to search a large linguistically annotated corpus using syntactic patterns over dependency graphs. In contrast to previous attempts to this effect, we introduce a light-weight query language that does…

Computation and Language · Computer Science 2020-06-05 Micah Shlain , Hillel Taub-Tabib , Shoval Sadde , Yoav Goldberg

Large sense-annotated datasets are increasingly necessary for training deep supervised systems in Word Sense Disambiguation. However, gathering high-quality sense-annotated data for as many instances as possible is a laborious and expensive…

Computation and Language · Computer Science 2020-03-16 Tommaso Pasini , Jose Camacho-Collados

Text coherence is a fundamental problem in natural language generation and understanding. Organizing sentences into an order that maximizes coherence is known as sentence ordering. This paper is proposing a new approach based on the graph…

Computation and Language · Computer Science 2022-03-15 Melika Golestani , Zeinab Borhanifard , Farnaz Tahmasebian , Heshaam Faili

In a knowledge discovery process, interpretation and evaluation of the mined results are indispensable in practice. In the case of data clustering, however, it is often difficult to see in what aspect each cluster has been formed. This…

Artificial Intelligence · Computer Science 2011-09-01 Yoshitaka Kameya , Satoru Nakamura , Tatsuya Iwasaki , Taisuke Sato

This paper presents a model-based, unsupervised algorithm for recovering word boundaries in a natural-language text from which they have been deleted. The algorithm is derived from a probability model of the source that generated the text.…

Computation and Language · Computer Science 2007-05-23 Michael R. Brent

We describe a new sense-tagged corpus for word sense disambiguation. The corpus is constituted of instances of 20 French polysemous verbs. Each verb instance is annotated with three sense labels: (1) the actual translation of the verb in…

Computation and Language · Computer Science 2026-05-28 Myriam Rakho , Eric Laporte , Matthieu Constant

We introduce SentEval, a toolkit for evaluating the quality of universal sentence representations. SentEval encompasses a variety of tasks, including binary and multi-class classification, natural language inference and sentence similarity.…

Computation and Language · Computer Science 2018-03-16 Alexis Conneau , Douwe Kiela

The authors of (Cho et al., 2014a) have shown that the recently introduced neural network translation systems suffer from a significant drop in translation quality when translating long sentences, unlike existing phrase-based translation…

Computation and Language · Computer Science 2014-10-08 Jean Pouget-Abadie , Dzmitry Bahdanau , Bart van Merrienboer , Kyunghyun Cho , Yoshua Bengio

Sentence simplification reduces semantic complexity to benefit people with language impairments. Previous simplification studies on the sentence level and word level have achieved promising results but also meet great challenges. For…

Computation and Language · Computer Science 2017-04-10 Yaoyuan Zhang , Zhenxu Ye , Yansong Feng , Dongyan Zhao , Rui Yan

Fusing sentences containing disparate content is a remarkable human ability that helps create informative and succinct summaries. Such a simple task for humans has remained challenging for modern abstractive summarizers, substantially…

Computation and Language · Computer Science 2020-06-11 Logan Lebanoff , John Muchovej , Franck Dernoncourt , Doo Soon Kim , Lidan Wang , Walter Chang , Fei Liu

News Discourse Profiling seeks to scrutinize the event-related role of each sentence in a news article and has been proven useful across various downstream applications. Specifically, within the context of a given news discourse, each…

Computation and Language · Computer Science 2023-09-22 Ming Li , Ruihong Huang

We present COSTRA 1.0, a dataset of complex sentence transformations. The dataset is intended for the study of sentence-level embeddings beyond simple word alternations or standard paraphrasing. This first version of the dataset is limited…

Computation and Language · Computer Science 2020-04-17 Petra Barancikova , Ondrej Bojar

An approximate textual retrieval algorithm for searching sources with high levels of defects is presented. It considers splitting the words in a query into two overlapping segments and subsequently building composite regular expressions…

Information Retrieval · Computer Science 2007-05-23 Pere Constans

This paper presents a pipeline designed to transform raw Wikimedia dumps into quality textual corpora for seven South Slavic languages. The work is divided into two major phases. The first involves extracting and cleaning text from raw…

Computation and Language · Computer Science 2026-05-18 Mihailo Škorić , Cosimo Palma