English
Related papers

Related papers: Know thy corpus! Robust methods for digital curati…

200 papers

We present the HPLT (High Performance Language Technologies) language resources, a new massive multilingual dataset including both monolingual and bilingual corpora extracted from CommonCrawl and previously unused web crawls from the…

It is tempting to treat frequency trends from the Google Books data sets as indicators of the "true" popularity of various words and phrases. Doing so allows us to draw quantitatively strong conclusions about the evolution of cultural…

Physics and Society · Physics 2020-05-28 Eitan Adam Pechenick , Christopher M. Danforth , Peter Sheridan Dodds

Online communities provide a unique way for individuals to access information from those in similar circumstances, which can be critical for health conditions that require daily and personalized management. As these groups and topics often…

Social and Information Networks · Computer Science 2019-08-13 Mohammad Akbari , Kunal Relia , Anas Elghafari , Rumi Chunara

Natural language processing (NLP) is a promising approach for analyzing large volumes of climate-change and infrastructure-related scientific literature. However, best-in-practice NLP techniques require large collections of relevant…

Detecting controversy in general web pages is a daunting task, but increasingly essential to efficiently moderate discussions and effectively filter problematic content. Unfortunately, controversies occur across many topics and domains,…

Information Retrieval · Computer Science 2018-12-04 Jasper Linmans , Bob van de Velde , Evangelos Kanoulas

In this paper we propose a general framework for topic-specific summarization of large text corpora and illustrate how it can be used for the analysis of news databases. Our framework, concise comparative summarization (CCS), is built on…

Computation and Language · Computer Science 2014-04-30 Jinzhu Jia , Luke Miratrix , Bin Yu , Brian Gawalt , Laurent El Ghaoui , Luke Barnesmoore , Sophie Clavier

Parallel corpora are a valuable resource for machine translation, but at present their availability and utility is limited by genre- and domain-specificity, licensing restrictions, and the basic difficulty of locating parallel texts in all…

cmp-lg · Computer Science 2007-05-23 Philip Resnik

In order to address increasing demands of real-world applications, the research for knowledge-intensive NLP (KI-NLP) should advance by capturing the challenges of a truly open-domain environment: web-scale knowledge, lack of structure,…

Technical documents contain a fair amount of unnatural language, such as tables, formulas, pseudo-codes, etc. Unnatural language can be an important factor of confusing existing NLP tools. This paper presents an effective method of…

Information Retrieval · Computer Science 2017-03-20 Myungha Jang , Jinho D. Choi , James Allan

Having a quality annotated corpus is essential especially for applied research. Despite the recent focus of Web science community on researching about cyberbullying, the community dose not still have standard benchmarks. In this paper, we…

Computation and Language · Computer Science 2018-05-25 Mohammadreza Rezvan , Saeedeh Shekarpour , Lakshika Balasuriya , Krishnaprasad Thirunarayan , Valerie Shalin , Amit Sheth

Researchers and practitioners in natural language processing and computational linguistics frequently observe and analyze the real language usage in large-scale corpora. For that purpose, they often employ off-the-shelf pattern-matching…

Computation and Language · Computer Science 2025-03-06 Hiroyuki Deguchi , Go Kamoda , Yusuke Matsushita , Chihiro Taguchi , Kohei Suenaga , Masaki Waga , Sho Yokoi

Insightful findings in political science often require researchers to analyze documents of a certain subject or type, yet these documents are usually contained in large corpora that do not distinguish between pertinent and non-pertinent…

Computation and Language · Computer Science 2019-10-29 Shrey Desai , Barea Sinno , Alex Rosenfeld , Junyi Jessy Li

This paper reports on the preliminary phase of our ongoing research towards developing an intelligent tutoring environment for Turkish grammar. One of the components of this environment is a corpus search tool which, among other aspects of…

cmp-lg · Computer Science 2016-08-31 H. Altay Guvenir , Kemal Oflazer

We present work in progress on the temporal progression of compositionality in noun-noun compounds. Previous work has proposed computational methods for determining the compositionality of compounds. These methods try to automatically…

Computation and Language · Computer Science 2019-06-13 Prajit Dhar , Janis Pagel , Lonneke van der Plas

We survey clinical document corpora, with focus on German textual data. Due to rigid data privacy legislation in Germany these resources, with only few exceptions, are stored in safe clinical data spaces and locked against clinic-external…

Computation and Language · Computer Science 2025-02-20 Udo Hahn

The algorithm of the creation texts parallel corpora was presented. The algorithm is based on the use of "key words" in text documents, and on the means of their automated translation. Key words were singled out by means of using Russian…

Computation and Language · Computer Science 2008-07-03 D. V. Lande , V. V. Zhygalo

The growing complexity of legal cases has lead to an increasing interest in legal information retrieval systems that can effectively satisfy user-specific information needs. However, such downstream systems typically require documents to be…

Computation and Language · Computer Science 2021-05-18 Dennis Aumiller , Satya Almasian , Sebastian Lackner , Michael Gertz

Text articles with false claims, especially news, have recently become aggravating for the Internet users. These articles are in wide circulation and readers face difficulty discerning fact from fiction. Previous work on credibility…

Computation and Language · Computer Science 2024-03-08 Nurendra Choudhary , Rajat Singh , Ishita Bindlish , Manish Shrivastava

Language corpora are the foundation of most natural language processing research, yet they often reproduce structural inequalities. One such inequality is gender discrimination in how actors are represented, which can distort analyses and…

Computation and Language · Computer Science 2025-10-10 Stefanie Urchs , Veronika Thurner , Matthias Aßenmacher , Christian Heumann , Stephanie Thiemichen

Automatic quality evaluation of Web information is a task with many fields of applications and of great relevance, especially in critical domains like the medical one. We move from the intuition that the quality of content of medical Web…

Information Retrieval · Computer Science 2016-03-08 Vittoria Cozza , Marinella Petrocchi , Angelo Spognardi