English
Related papers

Related papers: Chart-to-Text: Generating Natural Language Descrip…

200 papers

In recent years, the task of text-to-SQL translation, which converts natural language questions into executable SQL queries, has gained significant attention for its potential to democratize data access. Despite its promise, challenges such…

Computation and Language · Computer Science 2024-05-28 Adrián Bazaga , Pietro Liò , Gos Micklem

Charts provide visual representations of data and are widely used for analyzing information, addressing queries, and conveying insights to others. Various chart-related downstream tasks have emerged recently, such as question-answering and…

Computation and Language · Computer Science 2024-03-15 Ahmed Masry , Mehrad Shahmohammadi , Md Rizwan Parvez , Enamul Hoque , Shafiq Joty

Data-to-text systems are powerful in generating reports from data automatically and thus they simplify the presentation of complex data. Rather than presenting data using visualisation techniques, data-to-text systems use natural (human)…

Computation and Language · Computer Science 2016-10-27 Dimitra Gkatzia

How to generate descriptions from structured data organized in tables? Existing approaches using neural encoder-decoder models often suffer from lacking diversity. We claim that an open set of templates is crucial for enriching the phrase…

Computation and Language · Computer Science 2020-02-14 Rong Ye , Wenxian Shi , Hao Zhou , Zhongyu Wei , Lei Li

Neural data-to-text generation models have achieved significant advancement in recent years. However, these models have two shortcomings: the generated texts tend to miss some vital information, and they often generate descriptions that are…

Computation and Language · Computer Science 2020-04-21 Kai Chen , Fayuan Li , Baotian Hu , Weihua Peng , Qingcai Chen , Hong Yu

Existing neural generation approaches create multi-sentence text as a single sequence. In this paper we propose a structured convolutional decoder that is guided by the content structure of target summaries. We compare our model with…

Computation and Language · Computer Science 2019-06-12 Laura Perez-Beltrachini , Yang Liu , Mirella Lapata

Transcribing structured data into natural language descriptions has emerged as a challenging task, referred to as "data-to-text". These structures generally regroup multiple elements, as well as their attributes. Most attempts rely on…

Computation and Language · Computer Science 2019-12-23 Clément Rebuffel , Laure Soulier , Geoffrey Scoutheeten , Patrick Gallinari

In this paper, we present a model for generating summaries of text documents with respect to a query. This is known as query-based summarization. We adapt an existing dataset of news article summaries for the task and train a…

Computation and Language · Computer Science 2017-12-19 Johan Hasselqvist , Niklas Helmertz , Mikael Kågebäck

Visualizations, such as charts, are crucial for interpreting complex data. However, they are often provided as raster images, which are not compatible with assistive technologies for people with blindness and visual impairments, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Omar Moured , Sara Alzalabny , Anas Osman , Thorsten Schwarz , Karin Muller , Rainer Stiefelhagen

Web-based data visualizations have become very popular for exploring data and communicating insights. Newspapers, journals, and reports regularly publish visualizations to tell compelling stories with data. Unfortunately, most…

Human-Computer Interaction · Computer Science 2023-02-16 Md Zubair Ibne Alam , Shehnaz Islam , Enamul Hoque

Text generation from semantic graphs is traditionally performed with deterministic methods, which generate a unique description given an input graph. However, the generation problem admits a range of acceptable textual outputs, exhibiting…

Computation and Language · Computer Science 2021-08-16 Jiuzhou Han , Daniel Beck , Trevor Cohn

Text generation from a knowledge base aims to translate knowledge triples to natural language descriptions. Most existing methods ignore the faithfulness between a generated text description and the original table, leading to generated…

Computation and Language · Computer Science 2021-03-03 Zhenyi Wang , Xiaoyang Wang , Bang An , Dong Yu , Changyou Chen

How can we best encode structured data into sequential form for use in large language models (LLMs)? In this work, we introduce a parameter-efficient method to explicitly represent structured data for LLMs. Our method, GraphToken, learns an…

Machine Learning · Computer Science 2024-02-09 Bryan Perozzi , Bahare Fatemi , Dustin Zelle , Anton Tsitsulin , Mehran Kazemi , Rami Al-Rfou , Jonathan Halcrow

Data visualization in the form of charts plays a pivotal role in data analysis, offering critical insights and aiding in informed decision-making. Automatic chart understanding has witnessed significant advancements with the rise of large…

Computation and Language · Computer Science 2024-12-06 Kung-Hsiang Huang , Hou Pong Chan , Yi R. Fung , Haoyi Qiu , Mingyang Zhou , Shafiq Joty , Shih-Fu Chang , Heng Ji

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya

Pre-trained sequence-to-sequence language models have led to widespread success in many natural language generation tasks. However, there has been relatively less work on analyzing their ability to generate structured outputs such as…

Computation and Language · Computer Science 2022-04-12 Swarnadeep Saha , Prateek Yadav , Mohit Bansal

Data-to-text (D2T) generation aims to transform structured data into natural language text. Data-to-text pre-training has proved to be powerful in enhancing D2T generation and yields impressive performances. However, previous pre-training…

Computation and Language · Computer Science 2024-01-03 Shujie Li , Liang Li , Ruiying Geng , Min Yang , Binhua Li , Guanghu Yuan , Wanwei He , Shao Yuan , Can Ma , Fei Huang , Yongbin Li

Structured data summarization involves generation of natural language summaries from structured input data. In this work, we consider summarizing structured data occurring in the form of tables as they are prevalent across a wide variety of…

Computation and Language · Computer Science 2019-07-16 Parag Jain , Anirban Laha , Karthik Sankaranarayanan , Preksha Nema , Mitesh M. Khapra , Shreyas Shetty

Recent developments in transformer-based language models have allowed them to capture a wide variety of world knowledge that can be adapted to downstream tasks with limited resources. However, what pieces of information are understood in…

Computation and Language · Computer Science 2024-01-31 Shrayani Mondal , Rishabh Garodia , Arbaaz Qureshi , Taesung Lee , Youngja Park

In this paper, we propose a novel pretraining-based encoder-decoder framework, which can generate the output sequence based on the input sequence in a two-stage manner. For the encoder of our model, we encode the input sequence into context…

Computation and Language · Computer Science 2019-10-16 Haoyu Zhang , Jianjun Xu , Ji Wang