English
Related papers

Related papers: Retrieval Enhanced Model for Commonsense Generatio…

200 papers

Relation triple extraction, which outputs a set of triples from long sentences, plays a vital role in knowledge acquisition. Large language models can accurately extract triples from simple sentences through few-shot learning or fine-tuning…

Computation and Language · Computer Science 2024-04-16 Zepeng Ding , Wenhao Huang , Jiaqing Liang , Deqing Yang , Yanghua Xiao

Generative retrieval stands out as a promising new paradigm in text retrieval that aims to generate identifier strings of relevant passages as the retrieval target. This generative paradigm taps into powerful generative language models,…

Computation and Language · Computer Science 2023-12-19 Yongqi Li , Nan Yang , Liang Wang , Furu Wei , Wenjie Li

Commonsense question answering is a crucial task that requires machines to employ reasoning according to commonsense. Previous studies predominantly employ an extracting-and-modeling paradigm to harness the information in KG, which first…

Machine Learning · Computer Science 2024-11-12 Boci Peng , Yongchao Liu , Xiaohe Bo , Sheng Tian , Baokun Wang , Chuntao Hong , Yan Zhang

We propose a novel generative model to explore both local and global context for joint learning topics and topic-specific word embeddings. In particular, we assume that global latent topics are shared across documents, a word is generated…

Computation and Language · Computer Science 2020-08-12 Lixing Zhu , Yulan He , Deyu Zhou

The integration of retrieved passages and large language models (LLMs), such as ChatGPTs, has significantly contributed to improving open-domain question answering. However, there is still a lack of exploration regarding the optimal…

Information Retrieval · Computer Science 2024-04-09 Ye Liu , Semih Yavuz , Rui Meng , Meghana Moorthy , Shafiq Joty , Caiming Xiong , Yingbo Zhou

Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Cheng Tan , Jingxuan Wei , Linzhuang Sun , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retrievers requires large…

Computation and Language · Computer Science 2023-09-14 Chao-Wei Huang , Chen-Yu Hsu , Tsu-Yuan Hsu , Chen-An Li , Yun-Nung Chen

Developing an efficient retriever to retrieve knowledge from a large-scale knowledge base (KB) is critical for task-oriented dialogue systems to effectively handle localized and specialized tasks. However, widely used generative models such…

Computation and Language · Computer Science 2023-10-23 Weizhou Shen , Yingqi Gao , Canbin Huang , Fanqi Wan , Xiaojun Quan , Wei Bi

Large language models can now directly generate answers to many factual questions without referencing external sources. Unfortunately, relatively little attention has been paid to methods for evaluating the quality and correctness of these…

Information Retrieval · Computer Science 2024-01-11 Negar Arabzadeh , Amin Bigdeli , Charles L. A. Clarke

We study the problem of generating inferential texts of events for a variety of commonsense like \textit{if-else} relations. Existing approaches typically use limited evidence from training examples and learn for each relation individually.…

Computation and Language · Computer Science 2020-04-16 Daya Guo , Akari Asai , Duyu Tang , Nan Duan , Ming Gong , Linjun Shou , Daxin Jiang , Jian Yin , Ming Zhou

Relation extraction is an important but challenging task that aims to extract all hidden relational facts from the text. With the development of deep language models, relation extraction methods have achieved good performance on various…

Computation and Language · Computer Science 2022-08-17 Sheng Zhang , Patrick Ng , Zhiguo Wang , Bing Xiang

Retrieval-augmented generation have become central in natural language processing due to their efficacy in generating factual content. While traditional methods employ single-time retrieval, more recent approaches have shifted towards…

Computation and Language · Computer Science 2024-02-20 Yujia Zhou , Zheng Liu , Jiajie Jin , Jian-Yun Nie , Zhicheng Dou

In specialized fields like the scientific domain, constructing large-scale human-annotated datasets poses a significant challenge due to the need for domain expertise. Recent methods have employed large language models to generate synthetic…

Information Retrieval · Computer Science 2025-02-18 SeongKu Kang , Bowen Jin , Wonbin Kweon , Yu Zhang , Dongha Lee , Jiawei Han , Hwanjo Yu

Prompt learning is an effective paradigm that bridges gaps between the pre-training tasks and the corresponding downstream applications. Approaches based on this paradigm have achieved great transcendent results in various applications.…

Information Retrieval · Computer Science 2022-09-26 Zhigang Kan , Linhui Feng , Zhangyue Yin , Linbo Qiao , Xipeng Qiu , Dongsheng Li

The growing proliferation of customized and pretrained generative models has made it infeasible for a user to be fully cognizant of every model in existence. To address this need, we introduce the task of content-based model search: given a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Daohan Lu , Sheng-Yu Wang , Nupur Kumari , Rohan Agarwal , Mia Tang , David Bau , Jun-Yan Zhu

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's…

Artificial Intelligence · Computer Science 2020-10-21 Mo Yu , Xiaoxiao Guo , Yufei Feng , Xiaodan Zhu , Michael Greenspan , Murray Campbell

Retrieval-Augmented Generation (RAG) improves factual grounding in large language models but suffers from substantial latency due to synchronous retrieval. While recent work explores asynchronous retrieval, existing approaches rely on…

Computation and Language · Computer Science 2026-05-19 Wuyang Zhang , Shichao Pei

Recently, pretrained language models (e.g., BERT) have achieved great success on many downstream natural language understanding tasks and exhibit a certain level of commonsense reasoning ability. However, their performance on commonsense…

Artificial Intelligence · Computer Science 2023-02-17 Shiyang Li , Jianshu Chen , Dian Yu

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text prompts or spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

Existing summarization systems mostly generate summaries purely relying on the content of the source document. However, even for humans, we usually need some references or exemplars to help us fully understand the source document and write…

Computation and Language · Computer Science 2021-12-14 Chenxin An , Ming Zhong , Zhichao Geng , Jianqiang Yang , Xipeng Qiu