English
Related papers

Related papers: Synthetic Data Generation for Training Diversified…

200 papers

Generative Commonsense Reasoning (GCR) requires a model to reason about a situation using commonsense knowledge, while generating coherent sentences. Although the quality of the generated sentences is crucial, the diversity of the…

Computation and Language · Computer Science 2024-09-30 Tianhui Zhang , Bei Peng , Danushka Bollegala

Generative commonsense reasoning (GCR) in natural language is to reason about the commonsense while generating coherent text. Recent years have seen a surge of interest in improving the generation quality of commonsense reasoning tasks.…

Computation and Language · Computer Science 2022-03-15 Wenhao Yu , Chenguang Zhu , Lianhui Qin , Zhihan Zhang , Tong Zhao , Meng Jiang

Humans use commonsense reasoning (CSR) implicitly to produce natural and coherent responses in conversations. Aiming to close the gap between current response generation (RG) models and human communication abilities, we want to understand…

Computation and Language · Computer Science 2021-09-13 Pei Zhou , Pegah Jandaghi , Bill Yuchen Lin , Justin Cho , Jay Pujara , Xiang Ren

Story generation, namely generating a reasonable story from a leading context, is an important but challenging task. In spite of the success in modeling fluency and local coherence, existing neural language generation models (e.g., GPT-2)…

Computation and Language · Computer Science 2020-01-16 Jian Guan , Fei Huang , Zhihao Zhao , Xiaoyan Zhu , Minlie Huang

Training models on synthetic data has emerged as an increasingly important strategy for improving the performance of generative AI. This approach is particularly helpful for large multimodal models (LMMs) due to the relative scarcity of…

Artificial Intelligence · Computer Science 2026-01-13 Gabriela Ben Melech Stan , Estelle Aflalo , Avinash Madasu , Vasudev Lal , Phillip Howard

Generative commonsense reasoning is the capability of a language model to generate a sentence with a given concept-set that is based on commonsense knowledge. However, generative language models still struggle to provide outputs, and the…

Computation and Language · Computer Science 2021-11-02 Jaehyung Seo , Chanjun Park , Sugyeong Eo , Hyeonseok Moon , Heuiseok Lim

Stories generated with neural language models have shown promise in grammatical and stylistic consistency. However, the generated stories are still lacking in common sense reasoning, e.g., they often contain sentences deprived of world…

Machine Learning · Computer Science 2020-03-02 Huanru Henry Mao , Bodhisattwa Prasad Majumder , Julian McAuley , Garrison W. Cottrell

Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and CommonsenseQA) mainly focus on the discriminative task of choosing…

Computation and Language · Computer Science 2021-09-23 Pei Zhou , Karthik Gopalakrishnan , Behnam Hedayatnia , Seokhwan Kim , Jay Pujara , Xiang Ren , Yang Liu , Dilek Hakkani-Tur

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

Generative commonsense reasoning requires machines to generate sentences describing an everyday scenario given several concepts, which has attracted much attention recently. However, existing models cannot perform as well as humans, since…

Computation and Language · Computer Science 2021-12-16 Xin Liu , Dayiheng Liu , Baosong Yang , Haibo Zhang , Junwei Ding , Wenqing Yao , Weihua Luo , Haiying Zhang , Jinsong Su

Data synthesis for training large reasoning models offers a scalable alternative to limited, human-curated datasets, enabling the creation of high-quality data. However, existing approaches face several challenges: (i) indiscriminate…

Artificial Intelligence · Computer Science 2026-05-11 Yongxian Wei , Yilin Zhao , Zixuan Hu , Li Shen , Xinrui Chen , Runxi Cheng , Sinan Du , Hao Yu , Chun Yuan , Dian Li

The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To…

Computation and Language · Computer Science 2025-02-11 Sathya Krishnan Suresh , Wu Mengjun , Tushar Pranav , Eng Siong Chng

Question generation (QG) is to generate natural and grammatical questions that can be answered by a specific answer for a given context. Previous sequence-to-sequence models suffer from a problem that asking high-quality questions requires…

Computation and Language · Computer Science 2021-06-22 Xin Jia , Hao Wang , Dawei Yin , Yunfang Wu

Recent advances in commonsense reasoning depend on large-scale human-annotated training data to achieve peak performance. However, manual curation of training examples is expensive and has been shown to introduce annotation artifacts that…

Despite the success of generative pre-trained language models on a series of text generation tasks, they still suffer in cases where reasoning over underlying commonsense knowledge is required during generation. Existing approaches that…

Computation and Language · Computer Science 2020-09-25 Haozhe Ji , Pei Ke , Shaohan Huang , Furu Wei , Xiaoyan Zhu , Minlie Huang

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

While commonsense knowledge acquisition and reasoning has traditionally been a core research topic in the knowledge representation and reasoning community, recent years have seen a surge of interest in the natural language processing…

Computation and Language · Computer Science 2022-02-01 Prajjwal Bhargava , Vincent Ng

High-quality data is essential for conversational recommendation systems and serves as the cornerstone of the network architecture development and training strategy design. Existing works contribute heavy human efforts to manually labeling…

Computation and Language · Computer Science 2023-06-19 Yu Lu , Junwei Bao , Zichen Ma , Xiaoguang Han , Youzheng Wu , Shuguang Cui , Xiaodong He

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally,…

Computation and Language · Computer Science 2026-05-29 Heydar Soudani , Roxana Petcu , Evangelos Kanoulas , Faegheh Hasibi

Within the evolving landscape of deep learning, the dilemma of data quantity and quality has been a long-standing problem. The recent advent of Large Language Models (LLMs) offers a data-centric solution to alleviate the limitations of…

Computation and Language · Computer Science 2024-06-24 Lin Long , Rui Wang , Ruixuan Xiao , Junbo Zhao , Xiao Ding , Gang Chen , Haobo Wang
‹ Prev 1 2 3 10 Next ›