English
Related papers

Related papers: Retrieval Enhanced Model for Commonsense Generatio…

200 papers

Reading comprehension QA tasks have seen a recent surge in popularity, yet most works have focused on fact-finding extractive QA. We instead focus on a more challenging multi-hop generative task (NarrativeQA), which requires the model to…

Computation and Language · Computer Science 2019-06-04 Lisa Bauer , Yicheng Wang , Mohit Bansal

Commonsense reasoning is intuitive for humans but has been a long-term challenge for artificial intelligence (AI). Recent advancements in pretrained language models have shown promising results on several commonsense benchmark datasets.…

Computation and Language · Computer Science 2021-06-03 Shikhar Singh , Nuan Wen , Yu Hou , Pegah Alipoormolabashi , Te-Lin Wu , Xuezhe Ma , Nanyun Peng

In order to facilitate natural language understanding, the key is to engage commonsense or background knowledge. However, how to engage commonsense effectively in question answering systems is still under exploration in both research…

Computation and Language · Computer Science 2020-11-06 Qianglong Chen , Feng Ji , Haiqing Chen , Yin Zhang

Memorizing and utilizing speakers' personas is a common practice for response generation in long-term conversations. Yet, human-authored datasets often provide uninformative persona sentences that hinder response quality. This paper…

Computation and Language · Computer Science 2024-02-13 Hana Kim , Kai Tzu-iunn Ong , Seoyeon Kim , Dongha Lee , Jinyoung Yeo

Commonsense explanation generation aims to empower the machine's sense-making capability by generating plausible explanations to statements against commonsense. While this task is easy to human, the machine still struggles to generate…

Computation and Language · Computer Science 2020-09-25 Haozhe Ji , Pei Ke , Shaohan Huang , Furu Wei , Minlie Huang

Effective conversational search demands a deep understanding of user intent across multiple dialogue turns. Users frequently use abbreviations and shift topics in the middle of conversations, posing challenges for conventional retrievers.…

Information Retrieval · Computer Science 2025-09-25 Seunghan Yang , Juntae Lee , Jihwan Bang , Kyuhong Shim , Minsoo Kim , Simyung Chang

When the world changes, so does the text that humans write about it. How do we build language models that can be easily updated to reflect these changes? One popular approach is retrieval-augmented generation, in which new documents are…

Computation and Language · Computer Science 2024-06-18 Belinda Z. Li , Emmy Liu , Alexis Ross , Abbas Zeitoun , Graham Neubig , Jacob Andreas

Recent advances in general purpose pre-trained language models have shown great potential in commonsense reasoning. However, current works still perform poorly on standard commonsense reasoning benchmarks including the Com2Sense Dataset. We…

Computation and Language · Computer Science 2023-10-11 Yu Zhou , Yunqiu Han , Hanyu Zhou , Yulun Wu

Code comment generation aims to generate high-quality comments from source code automatically and has been studied for years. Recent studies proposed to integrate information retrieval techniques with neural generation models to tackle this…

Software Engineering · Computer Science 2024-08-08 Hanzhen Lu , Zhongxin Liu

Generating commonsense assertions within a given story context remains a difficult task for modern language models. Previous research has addressed this problem by aligning commonsense inferences with stories and training language…

Computation and Language · Computer Science 2024-10-04 Pedro Colon-Hernandez , Nanxi Liu , Chelsea Joe , Peter Chin , Claire Yin , Henry Lieberman , Yida Xin , Cynthia Breazeal

We propose an unsupervised approach for sarcasm generation based on a non-sarcastic input sentence. Our method employs a retrieve-and-edit framework to instantiate two major characteristics of sarcasm: reversal of valence and semantic…

Computation and Language · Computer Science 2020-06-18 Tuhin Chakrabarty , Debanjan Ghosh , Smaranda Muresan , Nanyun Peng

Unit testing validates the correctness of the units of the software system under test and serves as the cornerstone in improving software quality and reliability. To reduce manual efforts in writing unit tests, some techniques have been…

Software Engineering · Computer Science 2025-02-25 Quanjun Zhang , Chunrong Fang , Yi Zheng , Yaxin Zhang , Yuan Zhao , Rubing Huang , Jianyi Zhou , Yun Yang , Tao Zheng , Zhenyu Chen

Recently, commonsense reasoning in text generation has attracted much attention. Generative commonsense reasoning is the task that requires machines, given a group of keywords, to compose a single coherent sentence with commonsense…

Computation and Language · Computer Science 2023-10-31 Yunxiang Zhang , Xiaojun Wan

We motivate and propose a suite of simple but effective improvements for concept-to-text generation called SAPPHIRE: Set Augmentation and Post-hoc PHrase Infilling and REcombination. We demonstrate their effectiveness on generative…

Computation and Language · Computer Science 2021-12-03 Steven Y. Feng , Jessica Huynh , Chaitanya Narisetty , Eduard Hovy , Varun Gangal

Knowledge retrieval is one of the major challenges in building a knowledge-grounded dialogue system. A common method is to use a neural retriever with a distributed approximate nearest-neighbor database to quickly find the relevant…

Information Retrieval · Computer Science 2024-05-09 Nhat Tran , Diane Litman

Retrieval-augmented generation resorts to content retrieved from external sources in order to leverage the performance of large language models in downstream tasks. The excessive volume of retrieved content, the possible dispersion of its…

Computation and Language · Computer Science 2024-07-08 João Rodrigues , António Branco

A hyperbole is an intentional and creative exaggeration not to be taken literally. Despite its ubiquity in daily life, the computational explorations of hyperboles are scarce. In this paper, we tackle the under-explored and challenging…

Computation and Language · Computer Science 2021-09-14 Yufei Tian , Arvind krishna Sridhar , Nanyun Peng

In the field of language modeling, models augmented with retrieval components have emerged as a promising solution to address several challenges faced in the natural language processing (NLP) field, including knowledge grounding,…

Machine Learning · Computer Science 2024-10-22 To Eun Kim , Alireza Salemi , Andrew Drozdov , Fernando Diaz , Hamed Zamani

Commonsense knowledge has proven to be beneficial to a variety of application areas, including question answering and natural language understanding. Previous work explored collecting commonsense knowledge triples automatically from text to…

Computation and Language · Computer Science 2021-02-02 Zhicheng Liang , Deborah L. McGuinness

Retrieval-augmented generation can improve audio captioning by incorporating relevant audio-text pairs from a knowledge base. Existing methods typically rely solely on the input audio as a unimodal retrieval query. In contrast, we propose…

Sound · Computer Science 2025-06-11 Choi Changin , Lim Sungjun , Rhee Wonjong