English
Related papers

Related papers: Self-Compositional Data Augmentation for Scientifi…

200 papers

Keyphrase generation is the task of predicting a set of lexical units that conveys the main content of a source text. Existing datasets for keyphrase generation are only readily available for the scholarly domain and include non-expert…

Information Retrieval · Computer Science 2019-12-02 Ygor Gallina , Florian Boudin , Béatrice Daille

Drawing causal conclusions from observational data requires making assumptions about the true data-generating process. Causal inference research typically considers low-dimensional data, such as categorical or numerical fields in structured…

Computation and Language · Computer Science 2021-02-11 Zach Wood-Doughty , Ilya Shpitser , Mark Dredze

The rapid advancement of generative models, such as Stable Diffusion, raises a key question: how can synthetic data from these models enhance predictive modeling? While they can generate vast amounts of datasets, only a subset meaningfully…

Machine Learning · Statistics 2025-05-09 Jialong Jiang , Wenkang Hu , Jian Huang , Yuling Jiao , Xu Liu

Compositional generalization, the ability to predict complex meanings from training on simpler sentences, poses challenges for powerful pretrained seq2seq models. In this paper, we show that data augmentation methods that sample MRs and…

Computation and Language · Computer Science 2024-01-19 Yuekun Yao , Alexander Koller

Keyphrase Generation (KG) is the task of generating central topics from a given document or literary work, which captures the crucial information necessary to understand the content. Documents such as scientific literature contain rich…

Computation and Language · Computer Science 2020-12-15 Yichao Luo , Zhengyan Li , Bingning Wang , Xiaoyu Xing , Qi Zhang , Xuanjing Huang

Despite significant advancements in multi-label text classification, the ability of existing models to generalize to novel and seldom-encountered complex concepts, which are compositions of elementary ones, remains underexplored. This…

Computation and Language · Computer Science 2023-12-21 Yuyang Chai , Zhuang Li , Jiahui Liu , Lei Chen , Fei Li , Donghong Ji , Chong Teng

While the abundance of rich and vast datasets across numerous fields has facilitated the advancement of natural language processing, sectors in need of specialized data types continue to struggle with the challenge of finding quality data.…

Computation and Language · Computer Science 2026-02-06 Hyeonseok Kang , Hyein Seo , Jeesu Jung , Sangkeun Jung , Du-Seong Chang , Riwoo Chung

Data augmentation is commonly used for generating additional data from the available training data to achieve a robust estimation of the parameters of complex models like the one for speaker verification (SV), especially for under-resourced…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-29 Achintya Kumar Sarkar , Himangshu Sarma , Priyanka Dwivedi , Zheng-Hua Tan

In Biomedical Natural Language Processing (BioNLP) tasks, such as Relation Extraction, Named Entity Recognition, and Text Classification, the scarcity of high-quality data remains a significant challenge. This limitation poisons large…

Computation and Language · Computer Science 2025-04-01 Zhengyi Zhao , Shubo Zhang , Bin Liang , Binyang Li , Kam-Fai Wong

We propose a simple data augmentation protocol aimed at providing a compositional inductive bias in conditional and unconditional sequence models. Under this protocol, synthetic training examples are constructed by taking real training…

Computation and Language · Computer Science 2020-05-20 Jacob Andreas

This paper provides a detailed survey of synthetic data techniques. We first discuss the expected goals of using synthetic data in data augmentation, which can be divided into four parts: 1) Improving Diversity, 2) Data Balancing, 3)…

Machine Learning · Computer Science 2024-07-08 Hsin-Yu Chang , Pei-Yu Chen , Tun-Hsiang Chou , Chang-Sheng Kao , Hsuan-Yun Yu , Yen-Ting Lin , Yun-Nung Chen

Confusing-words are commonly encountered in real-life keyword spotting applications, which causes severe degradation of performance due to complex spoken terms and various kinds of words that sound similar to the predefined keywords. To…

Machine Learning · Computer Science 2020-11-04 Yan Jia , Zexin Cai , Murong Ma , Zeqing Zhao , Xuyang Wang , Junjie Wang , Ming Li

Keyphrase prediction aims to generate phrases (keyphrases) that highly summarizes a given document. Recently, researchers have conducted in-depth studies on this task from various perspectives. In this paper, we comprehensively summarize…

Computation and Language · Computer Science 2023-05-05 Binbin Xie , Jia Song , Liangying Shao , Suhang Wu , Xiangpeng Wei , Baosong Yang , Huan Lin , Jun Xie , Jinsong Su

Keyphrases are capable of providing semantic metadata characterizing documents and producing an overview of the content of a document. Since keyphrase extraction is able to facilitate the management, categorization, and retrieval of…

Computation and Language · Computer Science 2020-02-14 Funan Mu , Zhenting Yu , LiFeng Wang , Yequan Wang , Qingyu Yin , Yibo Sun , Liqun Liu , Teng Ma , Jing Tang , Xing Zhou

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally,…

Computation and Language · Computer Science 2026-05-29 Heydar Soudani , Roxana Petcu , Evangelos Kanoulas , Faegheh Hasibi

With the proliferation of increasingly complicated Deep Learning architectures, data synthesis is a highly promising technique to address the demand of data-hungry models. However, reliably assessing the quality of a 'synthesiser' model's…

Machine Learning · Computer Science 2025-05-05 Julia A. Meister , Khuong An Nguyen

Synthetic data augmentation has emerged as a promising solution when pre-training is constrained by data rather than compute. We study how to design synthetic data algorithms that achieve better loss scaling: not only lowering loss at…

Machine Learning · Computer Science 2026-03-20 Konwoo Kim , Suhas Kotha , Yejin Choi , Tatsunori Hashimoto , Nick Haber , Percy Liang

We propose Composition Sampling, a simple but effective method to generate diverse outputs for conditional generation of higher quality compared to previous stochastic decoding strategies. It builds on recently proposed plan-based neural…

Computation and Language · Computer Science 2022-03-30 Shashi Narayan , Gonçalo Simões , Yao Zhao , Joshua Maynez , Dipanjan Das , Michael Collins , Mirella Lapata

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

Computation and Language · Computer Science 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

Multi-modal keyphrase generation aims to produce a set of keyphrases that represent the core points of the input text-image pair. In this regard, dominant methods mainly focus on multi-modal fusion for keyphrase generation. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yifan Dong , Suhang Wu , Fandong Meng , Jie Zhou , Xiaoli Wang , Jianxin Lin , Jinsong Su