English
Related papers

Related papers: Standardizing linguistic data: method and tools fo…

200 papers

This paper presents the preliminary works to put online a French oral corpus and its transcription. This corpus is the Socio-Linguistic Survey in Orleans, realized in 1968. First, we numerized the corpus, then we handwritten transcribed it…

Computation and Language · Computer Science 2011-11-15 Iris Eshkol , D. Maurel , Nathalie Friburger

Data preparation is a critical step in enhancing the usability of tabular data and thus boosts downstream data-driven tasks. Traditional methods often face challenges in capturing the intricate relationships within tables and adapting to…

Artificial Intelligence · Computer Science 2025-08-05 Mengshi Chen , Yuxiang Sun , Tengchao Li , Jianwei Wang , Kai Wang , Xuemin Lin , Ying Zhang , Wenjie Zhang

Large language models (LLMs) have shown promise in synthetic tabular data generation, yet existing methods struggle to preserve complex feature dependencies, particularly among categorical variables. This work introduces a…

Machine Learning · Computer Science 2025-05-07 Andrey Sidorenko

Machine learning approaches for building task-oriented dialogue systems require large conversational datasets with labels to train on. We are interested in building task-oriented dialogue systems from human-human conversations, which may be…

Computation and Language · Computer Science 2019-07-09 Shachi Paul , Rahul Goel , Dilek Hakkani-Tür

Researchers often rely on humans to code (label, annotate, etc.) large sets of texts. This kind of human coding forms an important part of social science research, yet the coding process is both resource intensive and highly variable from…

Artificial Intelligence · Computer Science 2023-06-06 Christopher Michael Rytting , Taylor Sorensen , Lisa Argyle , Ethan Busby , Nancy Fulda , Joshua Gubler , David Wingate

At a time when the quantity of - more or less freely - available data is increasing significantly, thanks to digital corpora, editions or libraries, the development of data mining tools or deep learning methods allows researchers to build a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Jean-Baptiste Camps , Gilles Guilhem Couffignal

Evaluating the quality of arguments is a crucial aspect of any system leveraging argument mining. However, it is a challenge to obtain reliable and consistent annotations regarding argument quality, as this usually requires domain-specific…

Computation and Language · Computer Science 2024-04-16 Nailia Mirzakhmedova , Marcel Gohsen , Chia Hao Chang , Benno Stein

This paper presents an experiment consisting in the comparison of six models to identify a state-of-the-art morphosyntactic parser and lemmatizer for Ancient Greek capable of annotating according to the Ancient Greek Dependency Treebank…

Computation and Language · Computer Science 2024-10-17 Giuseppe G. A. Celano

Linguistic resources such as part-of-speech (POS) tags have been extensively used in statistical machine translation (SMT) frameworks and have yielded better performances. However, usage of such linguistic annotations in neural machine…

Computation and Language · Computer Science 2017-08-04 Jan Niehues , Eunah Cho

Natural-language processing of historical documents is complicated by the abundance of variant spellings and lack of annotated data. A common approach is to normalize the spelling of historical words to modern forms. We explore the…

Computation and Language · Computer Science 2016-10-26 Marcel Bollmann , Anders Søgaard

Unstructured data have to be parsed in order to become usable. The complexity of grammar notations and the difficulty of grammar debugging limit the use of parsers for data preprocessing. We introduce a notation in which grammars are…

Formal Languages and Automata Theory · Computer Science 2015-11-04 Alexander Sakharov , Timothy Sakharov

There is an increasing interest and effort in preserving and documenting endangered languages. Language data are valuable only when they are well-cataloged, indexed and searchable. Many language data, particularly those of lesser-spoken…

Digital Libraries · Computer Science 2009-02-19 Artem Chebotko , Shiyong Lu , Farshad Fotouhi , Anthony Aristar

Human annotation for syntactic parsing is expensive, and large resources are available only for a fraction of languages. A question we ask is whether one can leverage abundant unlabeled texts to improve syntactic parsers, beyond just using…

Computation and Language · Computer Science 2019-02-22 Caio Corro , Ivan Titov

Textual data annotation, the process of labeling or tagging text with relevant information, is typically costly, time-consuming, and labor-intensive. While large language models (LLMs) have demonstrated their potential as direct…

Computation and Language · Computer Science 2025-08-12 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

Large language models (LLMs) are increasingly used for text analysis tasks, such as named entity recognition or error detection. Unlike encoder-based models, however, generative architectures lack an explicit mechanism to refer to specific…

Computation and Language · Computer Science 2026-01-26 Danil Semin , Ondřej Dušek , Zdeněk Kasner

Sarcasm fundamentally alters meaning through tone and context, yet detecting it in speech remains a challenge due to data scarcity. In addition, existing detection systems often rely on multimodal data, limiting their applicability in…

Computation and Language · Computer Science 2026-04-21 Zhu Li , Yuqing Zhang , Xiyuan Gao , Shekhar Nayak , Matt Coler

Span annotation - annotating specific text features at the span level - can be used to evaluate texts where single-score metrics fail to provide actionable feedback. Until recently, span annotation was done by human annotators or fine-tuned…

In essence, embedding algorithms work by optimizing the distance between a word and its usual context in order to generate an embedding space that encodes the distributional representation of words. In addition to single words or word…

Computation and Language · Computer Science 2021-04-14 Andres Garcia-Silva , Ronald Denaux , Jose Manuel Gomez-Perez

One of the most pressing problems in the automated analysis of historical documents is the availability of annotated training data. The problem is that labeling samples is a time-consuming task because it requires human expertise and thus,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Christian Bartz , Hendrik Raetz , Jona Otholt , Christoph Meinel , Haojin Yang

Certain forms of linguistic annotation, like part of speech and semantic tagging, can be automated with high accuracy. However, manual annotation is still necessary for complex pragmatic and discursive features that lack a direct mapping to…

Computation and Language · Computer Science 2024-12-10 Danni Yu , Luyang Li , Hang Su , Matteo Fuoli