中文
相关论文

相关论文: Augmenting Transformers with KNN-Based Composite M…

200 篇论文

Dialog systems have achieved significant progress and have been widely used in various scenarios. The previous researches mainly focused on designing dialog generation models in a single scenario, while comprehensive abilities are required…

人工智能 · 计算机科学 2022-06-20 Yu Zhao , Xinshuo Hu , Yunxin Li , Baotian Hu , Dongfang Li , Sichao Chen , Xiaolong Wang

Retrieval is a widely adopted approach for improving language models leveraging external information. As the field moves towards multi-modal large language models, it is important to extend the pure text based methods to incorporate other…

Knowledge-grounded conversation (KGC) shows excellent potential to deliver an engaging and informative response. However, existing approaches emphasize selecting one golden knowledge given a particular dialogue context, overlooking the…

计算与语言 · 计算机科学 2022-10-25 Xueliang Zhao , Tingchen Fu , Chongyang Tao , Rui Yan

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

计算与语言 · 计算机科学 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained language model with…

计算与语言 · 计算机科学 2020-10-20 Xueliang Zhao , Wei Wu , Can Xu , Chongyang Tao , Dongyan Zhao , Rui Yan

Knowledge representation learning has been commonly adopted to incorporate knowledge graph (KG) into various online services. Although existing knowledge representation learning methods have achieved considerable performance improvement,…

机器学习 · 计算机科学 2022-05-18 Binbin Hu , Zhiyang Hu , Zhiqiang Zhang , Jun Zhou , Chuan Shi

Statistical signal processing based speech enhancement methods adopt expert knowledge to design the statistical models and linear filters, which is complementary to the deep neural network (DNN) based methods which are data-driven. In this…

音频与语音处理 · 电气工程与系统科学 2021-04-19 Wei Xue , Gang Quan , Chao Zhang , Guohong Ding , Xiaodong He , Bowen Zhou

Large Language Models face significant challenges in maintaining coherent interactions over extended dialogues due to their limited contextual memory. This limitation often leads to fragmented exchanges and reduced relevance in responses,…

机器学习 · 计算机科学 2025-06-24 Haseeb Ullah Khan Shinwari , Muhammad Usama

Question Answering (QA) is a task that entails reasoning over natural language contexts, and many relevant works augment language models (LMs) with graph neural networks (GNNs) to encode the Knowledge Graph (KG) information. However, most…

计算与语言 · 计算机科学 2023-04-26 Jinyoung Park , Hyeong Kyu Choi , Juyeon Ko , Hyeonjin Park , Ji-Hoon Kim , Jisu Jeong , Kyungmin Kim , Hyunwoo J. Kim

End-to-End intelligent neural dialogue systems suffer from the problems of generating inconsistent and repetitive responses. Existing dialogue models pay attention to unilaterally incorporating personal knowledge into the dialog while…

计算与语言 · 计算机科学 2021-07-19 Yajing Sun , Yue Hu , Luxi Xing , Yuqiang Xie , Xiangpeng Wei

Current Open-Domain Question Answering (ODQA) model paradigm often contains a retrieving module and a reading module. Given an input question, the reading module predicts the answer from the relevant passages which are retrieved by the…

计算与语言 · 计算机科学 2022-06-07 Donghan Yu , Chenguang Zhu , Yuwei Fang , Wenhao Yu , Shuohang Wang , Yichong Xu , Xiang Ren , Yiming Yang , Michael Zeng

In open-domain dialogue intelligent agents should exhibit the use of knowledge, however there are few convincing demonstrations of this to date. The most popular sequence to sequence models typically "generate and hope" generic utterances…

计算与语言 · 计算机科学 2019-02-25 Emily Dinan , Stephen Roller , Kurt Shuster , Angela Fan , Michael Auli , Jason Weston

In this paper, we propose an unsupervised query enhanced approach for knowledge-intensive conversations, namely QKConv. There are three modules in QKConv: a query generator, an off-the-shelf knowledge selector, and a response generator.…

计算与语言 · 计算机科学 2023-05-29 Mingzhu Cai , Siqi Bao , Xin Tian , Huang He , Fan Wang , Hua Wu

We propose novel AI-empowered chat bots for learning as conversation where a user does not read a passage but gains information and knowledge through conversation with a teacher bot. Our information-acquisition-oriented dialogue system…

计算与语言 · 计算机科学 2022-05-31 Pengshan Cai , Hui Wan , Fei Liu , Mo Yu , Hong Yu , Sachindra Joshi

Real-world Knowledge Graphs (KGs) often suffer from incompleteness, which limits their potential performance. Knowledge Graph Completion (KGC) techniques aim to address this issue. However, traditional KGC methods are computationally…

计算与语言 · 计算机科学 2023-11-03 Alla Chepurova , Aydar Bulatov , Yuri Kuratov , Mikhail Burtsev

There have been many attempts to build multimodal dialog systems that can respond to a question about given audio-visual information, and the representative task for such systems is the Audio Visual Scene-Aware Dialog (AVSD). Most…

计算与语言 · 计算机科学 2022-02-22 Yoshihiro Yamazaki , Shota Orihashi , Ryo Masumura , Mihiro Uchida , Akihiko Takashima

We present a memory-augmented approach to condition an autoregressive language model on a knowledge graph. We represent the graph as a collection of relation triples and retrieve relevant relations for a given context to improve text…

计算与语言 · 计算机科学 2022-01-25 Qi Liu , Dani Yogatama , Phil Blunsom

In recent years, the generation of conversation content based on deep neural networks has attracted many researchers. However, traditional neural language models tend to generate general replies, lacking logical and emotional factors. This…

计算与语言 · 计算机科学 2019-04-18 Jia Li , Xiao Sun , Xing Wei , Changliang Li , Jianhua Tao

In this paper we propose augmenting Vision Transformer models with learnable memory tokens. Our approach allows the model to adapt to new tasks, using few parameters, while optionally preserving its capabilities on previously learned tasks.…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Mark Sandler , Andrey Zhmoginov , Max Vladymyrov , Andrew Jackson

Neural dialog models have exhibited strong performance, however their end-to-end nature lacks a representation of the explicit structure of dialog. This results in a loss of generalizability, controllability and a data-hungry nature.…

计算与语言 · 计算机科学 2019-07-24 Shikib Mehri , Tejas Srinivasan , Maxine Eskenazi