English
Related papers

Related papers: Analysing Data-To-Text Generation Benchmarks

200 papers

Existing data-to-text generation efforts mainly focus on generating a coherent text from non-linguistic input data, such as tables and attribute-value pairs, but overlook that different application scenarios may require texts of different…

Computation and Language · Computer Science 2023-05-08 Liqiang Jing , Xuemeng Song , Xuming Lin , Zhongzhou Zhao , Wei Zhou , Liqiang Nie

Speech datasets are crucial for training Speech Language Technologies (SLT); however, the lack of diversity of the underlying training data can lead to serious limitations in building equitable and robust SLT products, especially along…

Current publicly available knowledge work data collections lack diversity, extensive annotations, and contextual information about the users and their documents. These issues hinder objective and comparable data-driven evaluations and…

Artificial Intelligence · Computer Science 2024-10-25 Desiree Heim , Christian Jilek , Adrian Ulges , Andreas Dengel

The goal of text generation is to make machines express in human language. It is one of the most important yet challenging tasks in natural language processing (NLP). Since 2014, various neural encoder-decoder models pioneered by Seq2Seq…

Computation and Language · Computer Science 2022-01-25 Wenhao Yu , Chenguang Zhu , Zaitang Li , Zhiting Hu , Qingyun Wang , Heng Ji , Meng Jiang

Transfer tasks in text-to-speech (TTS) synthesis - where one or more aspects of the speech of one set of speakers is transferred to another set of speakers that do not feature these aspects originally - remains a challenging task. One of…

Recent neural models for data-to-document generation have achieved remarkable progress in producing fluent and informative texts. However, large proportions of generated texts do not actually conform to the input data. To address this…

Computation and Language · Computer Science 2018-08-21 Feng Nie , Hailin Chen , Jinpeng Wang , Jin-Ge Yao , Chin-Yew Lin , Rong Pan

Text segmentation tasks have a very wide range of application values, such as image editing, style transfer, watermark removal, etc.However, existing public datasets are of poor quality of pixel-level labels that have been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Yibo Wang , Yunhu Ye , Yuanpeng Mao , Yanwei Yu , Yuanping Song

When training powerful AI systems to perform complex tasks, it may be challenging to provide training signals which are robust to optimization. One concern is \textit{measurement tampering}, where the AI system manipulates multiple…

Machine Learning · Computer Science 2023-10-02 Fabien Roger , Ryan Greenblatt , Max Nadeau , Buck Shlegeris , Nate Thomas

Data augmentation has attracted a lot of research attention in the deep learning era for its ability in alleviating data sparseness. The lack of labeled data for unseen evaluation databases is exactly the major challenge for cross-domain…

Computation and Language · Computer Science 2022-11-16 Kun Wu , Lijie Wang , Zhenghua Li , Ao Zhang , Xinyan Xiao , Hua Wu , Min Zhang , Haifeng Wang

The adaptation capability to a wide range of domains is crucial for scene text spotting models when deployed to real-world conditions. However, existing state-of-the-art (SOTA) approaches usually incorporate scene text detection and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Alloy Das , Sanket Biswas , Ayan Banerjee , Josep Lladós , Umapada Pal , Saumik Bhattacharya

Text-to-SQL allows experts to use databases without in-depth knowledge of them. However, real-world tasks have both query and data ambiguities. Most works on Text-to-SQL focused on query ambiguities and designed chat interfaces for experts…

Databases · Computer Science 2023-10-31 Zezhou Huang , Pavan Kalyan Damalapati , Eugene Wu

The widespread adoption of Large Language Models (LLMs) has made the detection of AI-Generated text a pressing and complex challenge. Although many detection systems report high benchmark accuracy, their reliability in real-world settings…

Computation and Language · Computer Science 2026-04-23 Shushanta Pudasaini , Luis Miralles-Pechuán , David Lillis , Marisa Llorens Salvador

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

Recent advancements in Large Language Models (LLMs) have led to high-quality Machine-Generated Text (MGT), giving rise to countless new use cases and applications. However, easy access to LLMs is posing new challenges due to misuse. To…

Computation and Language · Computer Science 2024-04-15 Areg Mikael Sarvazyan , José Ángel González , Marc Franco-Salvador

Generating video stories from text prompts is a complex task. In addition to having high visual quality, videos need to realistically adhere to a sequence of text prompts whilst being consistent throughout the frames. Creating a benchmark…

Data-to-text generation systems aim to generate text descriptions based on input data (often represented in the tabular form). A typical system uses huge training samples for learning the correspondence between tables and texts. However,…

Computation and Language · Computer Science 2021-12-07 Shailza Jolly , Zi Xuan Zhang , Andreas Dengel , Lili Mou

A core step in statistical data-to-text generation concerns learning correspondences between structured data representations (e.g., facts in a database) and associated texts. In this paper we aim to bootstrap generators from large scale…

Computation and Language · Computer Science 2019-12-20 Laura Perez-Beltrachini , Mirella Lapata

In this work, we explore a useful but often neglected methodology for robustness analysis of text generation evaluation metrics: stress tests with synthetic data. Basically, we design and synthesize a wide range of potential errors and…

Computation and Language · Computer Science 2023-05-22 Tianxing He , Jingyu Zhang , Tianle Wang , Sachin Kumar , Kyunghyun Cho , James Glass , Yulia Tsvetkov

The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment. Researchers have recently…

Computation and Language · Computer Science 2023-10-16 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ming Yin

This work delves into the expanding role of large language models (LLMs) in generating artificial data. LLMs are increasingly employed to create a variety of outputs, including annotations, preferences, instruction prompts, simulated…