English
Related papers

Related papers: A New Tool for Efficiently Generating Quality Esti…

200 papers

This paper proposes an approach to cross-language sentence selection in a low-resource setting. It uses data augmentation and negative sampling techniques on noisy parallel sentence data to directly learn a cross-lingual embedding-based…

Computation and Language · Computer Science 2021-06-07 Yanda Chen , Chris Kedzie , Suraj Nair , Petra Galuščáková , Rui Zhang , Douglas W. Oard , Kathleen McKeown

We present a recurrent neural network based system for automatic quality estimation of natural language generation (NLG) outputs, which jointly learns to assign numerical ratings to individual outputs and to provide pairwise rankings of two…

Computation and Language · Computer Science 2019-10-11 Ondřej Dušek , Karin Sevegnani , Ioannis Konstas , Verena Rieser

State-of-the-art multilingual models depend on vocabularies that cover all of the languages the model will expect to see at inference time, but the standard methods for generating those vocabularies are not ideal for massively multilingual…

Computation and Language · Computer Science 2020-10-27 Hyung Won Chung , Dan Garrette , Kiat Chuan Tan , Jason Riesa

This paper presents a new tool learning dataset Seal-Tools, which contains self-instruct API-like tools. Seal-Tools not only offers a large number of tools, but also includes instances which demonstrate the practical application of tools.…

Computation and Language · Computer Science 2024-05-15 Mengsong Wu , Tong Zhu , Han Han , Chuanyuan Tan , Xiang Zhang , Wenliang Chen

Supplying data augmentation to conversational question answering (CQA) can effectively improve model performance. However, there is less improvement from single-turn datasets in CQA due to the distribution gap between single-turn and…

Computation and Language · Computer Science 2023-12-29 Baokui Li , Sen Zhang , Wangshu Zhang , Yicheng Chen , Changlin Yang , Sen Hu , Teng Xu , Siye liu , Jiwei Li

With the increasing capabilities of machine learning systems and their potential use in safety-critical systems, ensuring high-quality data is becoming increasingly important. In this paper we present a novel approach for the assurance of…

Machine Learning · Computer Science 2023-07-18 Christian Sieberichs , Simon Geerkens , Alexander Braun , Thomas Waschulzik

In English education tutoring, teacher feedback is essential for guiding students. Recently, AI-based tutoring systems have emerged to assist teachers; however, these systems require high-quality and large-scale teacher feedback data, which…

Artificial Intelligence · Computer Science 2025-08-15 Hyein Seo , Taewook Hwang , Yohan Lee , sangkeun Jung

This paper describes our submission to the shared task on word/phrase level Quality Estimation (QE) in the First Conference on Statistical Machine Translation (WMT16). The objective of the shared task was to predict if the given word/phrase…

Computation and Language · Computer Science 2016-10-25 Raj Nath Patel , Sasikumar M

Question answering (QA) tasks have been posed using a variety of formats, such as extractive span selection, multiple choice, etc. This has led to format-specialized models, and even to an implicit division in the QA community. We argue…

Computation and Language · Computer Science 2020-10-08 Daniel Khashabi , Sewon Min , Tushar Khot , Ashish Sabharwal , Oyvind Tafjord , Peter Clark , Hannaneh Hajishirzi

We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic error categories and we gather for each of them a set of…

Computation and Language · Computer Science 2019-10-17 Avramidis Eleftherios , Vivien Macketanz , Arle Lommel , Hans Uszkoreit

Generative commonsense reasoning is the capability of a language model to generate a sentence with a given concept-set that is based on commonsense knowledge. However, generative language models still struggle to provide outputs, and the…

Computation and Language · Computer Science 2021-11-02 Jaehyung Seo , Chanjun Park , Sugyeong Eo , Hyeonseok Moon , Heuiseok Lim

Question answering (QA) has achieved promising progress recently. However, answering a question in real-world scenarios like the medical domain is still challenging, due to the requirement of external knowledge and the insufficient quantity…

Artificial Intelligence · Computer Science 2019-12-10 Sheng Shen , Yaliang Li , Nan Du , Xian Wu , Yusheng Xie , Shen Ge , Tao Yang , Kai Wang , Xingzheng Liang , Wei Fan

Generating high-quality speech efficiently remains a key challenge for generative models in speech synthesis. This paper introduces VQalAttent, a lightweight model designed to generate fake speech with tunable performance and…

Machine Learning · Computer Science 2024-11-25 Armani Rodriguez , Silvija Kokalj-Filipovic

Data is a cornerstone of empirical software engineering (ESE) research and practice. Data underpin numerous process and project management activities, including the estimation of development effort and the prediction of the likely location…

Software Engineering · Computer Science 2020-12-22 Michael F. Bosu , Stephen G. MacDonell

In this paper we propose to exploit the automatic Quality Estimation (QE) of ASR hypotheses to perform the unsupervised adaptation of a deep neural network modeling acoustic probabilities. Our hypothesis is that significant improvements can…

Computation and Language · Computer Science 2017-02-07 Daniele Falavigna , Marco Matassoni , Shahab Jalalvand , Matteo Negri , Marco Turchi

Leveraging multilingual parallel texts to automatically generate paraphrases has drawn much attention as size of high-quality paraphrase corpus is limited. Round-trip translation, also known as the pivoting method, is a typical approach to…

Computation and Language · Computer Science 2019-11-12 Yinpeng Guo , Yi Liao , Xin Jiang , Qing Zhang , Yibo Zhang , Qun Liu

Speech enhancement (SE) improves degraded speech's quality, with generative models like flow matching gaining attention for their outstanding perceptual quality. However, the flow-based model requires multiple numbers of function…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-26 Jiahe Wang , Hongyu Wang , Wei Wang , Lei Yang , Chenda Li , Wangyou Zhang , Lufen Tan , Yanmin Qian

Automatic survey generation has emerged as a key task in scientific document processing. While large language models (LLMs) have shown promise in generating survey texts, the lack of standardized evaluation datasets critically hampers…

Computation and Language · Computer Science 2025-08-26 Tong Bao , Mir Tafseer Nayeem , Davood Rafiei , Chengzhi Zhang

Question generation (QG) is to generate natural and grammatical questions that can be answered by a specific answer for a given context. Previous sequence-to-sequence models suffer from a problem that asking high-quality questions requires…

Computation and Language · Computer Science 2021-06-22 Xin Jia , Hao Wang , Dawei Yin , Yunfang Wu

Within the evolving landscape of deep learning, the dilemma of data quantity and quality has been a long-standing problem. The recent advent of Large Language Models (LLMs) offers a data-centric solution to alleviate the limitations of…

Computation and Language · Computer Science 2024-06-24 Lin Long , Rui Wang , Ruixuan Xiao , Junbo Zhao , Xiao Ding , Gang Chen , Haobo Wang