English
Related papers

Related papers: User-Generated Text Corpus for Evaluating Japanese…

200 papers

Natural language generation (NLG) systems are computer software systems that produce texts in English and other human languages, often from non-linguistic input data. NLG systems, like most AI systems, need substantial amounts of knowledge.…

Computation and Language · Computer Science 2011-06-28 E. Reiter , R. Robertson , S. G. Sripada

We present a new parallel corpus, JHU FLuency-Extended GUG corpus (JFLEG) for developing and evaluating grammatical error correction (GEC). Unlike other corpora, it represents a broad range of language proficiency levels and uses holistic…

Computation and Language · Computer Science 2017-02-15 Courtney Napoles , Keisuke Sakaguchi , Joel Tetreault

Knowledge of syntax includes knowledge of rare, idiosyncratic constructions. LLMs must overcome frequency biases in order to master such constructions. In this study, I prompt GPT-3 to give acceptability judgments on the English-language…

Computation and Language · Computer Science 2023-02-07 Kyle Mahowald

With powerful large language models (LLMs) demonstrating superhuman reasoning capabilities, a critical question arises: Do LLMs genuinely reason, or do they merely recall answers from their extensive, web-scraped training datasets? Publicly…

Computation and Language · Computer Science 2025-04-28 Haowei Lin , Xiangyu Wang , Ruilin Yan , Baizhou Huang , Haotian Ye , Jianhua Zhu , Zihao Wang , James Zou , Jianzhu Ma , Yitao Liang

This study presents a Long Short-Term Memory (LSTM) neural network approach to Japanese word segmentation (JWS). Previous studies on Chinese word segmentation (CWS) succeeded in using recurrent neural networks such as LSTM and gated…

Computation and Language · Computer Science 2018-09-28 Yoshiaki Kitagawa , Mamoru Komachi

Large language models (LLMs) have demonstrated significant progress in various natural language generation and understanding tasks. However, their linguistic generalization capabilities remain questionable, raising doubts about whether…

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

Computation and Language · Computer Science 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

We present JNV (Japanese Nonverbal Vocalizations) corpus, a corpus of Japanese nonverbal vocalizations (NVs) with diverse phrases and emotions. Existing Japanese NV corpora lack phrase or emotion diversity, which makes it difficult to…

Sound · Computer Science 2023-05-23 Detai Xin , Shinnosuke Takamichi , Hiroshi Saruwatari

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. Recent research has…

Computation and Language · Computer Science 2024-12-05 Sergio E. Zanotto , Segun Aroyehun

In grammatical error correction (GEC), automatic evaluation is an important factor for research and development of GEC systems. Previous studies on automatic evaluation have demonstrated that quality estimation models built from datasets…

Computation and Language · Computer Science 2022-01-21 Daisuke Suzuki , Yujin Takahashi , Ikumi Yamashita , Taichi Aida , Tosho Hirasawa , Michitaka Nakatsuji , Masato Mita , Mamoru Komachi

Large Language Models (LLMs) have recently emerged, attracting considerable attention due to their ability to generate highly natural, human-like text. This study compares the latent community structures of LLM-generated text and…

Computation and Language · Computer Science 2025-01-03 Mose Park , Yunjin Choi , Jong-June Jeon

This study pioneers the use of synthetically generated data for training generative models in document-level text simplification of German texts. We demonstrate the effectiveness of our approach with real-world online texts. Addressing the…

Computation and Language · Computer Science 2024-02-19 Lars Klöser , Mika Beele , Jan-Niklas Schagen , Bodo Kraft

Methods for learning word representations using large text corpora have received much attention lately due to their impressive performance in numerous natural language processing (NLP) tasks such as, semantic similarity measurement, and…

Computation and Language · Computer Science 2015-11-23 Danushka Bollegala , Alsuhaibani Mohammed , Takanori Maehara , Ken-ichi Kawarabayashi

The rise of large language models (LLMs) has led to more diverse and higher-quality machine-generated text. However, their high expressive power makes it difficult to control outputs based on specific business instructions. In response,…

Computation and Language · Computer Science 2025-01-28 Kentaro Kurihara , Masato Mita , Peinan Zhang , Shota Sasaki , Ryosuke Ishigami , Naoaki Okazaki

Neural natural language generation (NNLG) from structured meaning representations has become increasingly popular in recent years. While we have seen progress with generating syntactically correct utterances that preserve semantics, various…

Computation and Language · Computer Science 2019-06-18 Shereen Oraby , Vrindavan Harrison , Abteen Ebrahimi , Marilyn Walker

We present a new English-French test set for the evaluation of Machine Translation (MT) for informal, written bilingual dialogue. The test set contains 144 spontaneous dialogues (5,700+ sentences) between native English and French speakers,…

Computation and Language · Computer Science 2019-06-03 Rachel Bawden , Sophie Rosset , Thomas Lavergne , Eric Bilinski

English verbs have multiple forms. For instance, talk may also appear as talks, talked or talking, depending on the context. The NLP task of lemmatization seeks to map these diverse forms back to a canonical one, known as the lemma. We…

Computation and Language · Computer Science 2024-05-29 Chaitanya Malaviya , Shijie Wu , Ryan Cotterell

Lemmatization is a Natural Language Processing (NLP) technique used to normalize text by changing morphological derivations of words to their root forms. It is used as a core pre-processing step in many NLP tasks including text indexing,…

Computation and Language · Computer Science 2023-08-04 Shafie Abdi Mohamed , Muhidin Abdullahi Mohamed

The conventional process of building Ontologies and Knowledge Graphs (KGs) heavily relies on human domain experts to define entities and relationship types, establish hierarchies, maintain relevance to the domain, fill the ABox (or populate…

Computation and Language · Computer Science 2024-03-14 Vamsi Krishna Kommineni , Birgitta König-Ries , Sheeba Samuel

Large Language Models (LLMs) show remarkable performance on a wide variety of tasks. Most LLMs split text into multi-character tokens and process them as atomic units without direct access to individual characters. This raises the question:…

Computation and Language · Computer Science 2024-10-03 Lukas Edman , Helmut Schmid , Alexander Fraser