English
Related papers

Related papers: Fusing Context Into Knowledge Graph for Commonsens…

200 papers

Commonsense reasoning is an important aspect of building robust AI systems and is receiving significant attention in the natural language understanding, computer vision, and knowledge graphs communities. At present, a number of valuable…

Artificial Intelligence · Computer Science 2020-06-24 Filip Ilievski , Pedro Szekely , Jingwei Cheng , Fu Zhang , Ehsan Qasemi

Question Answering (QA) is a task that entails reasoning over natural language contexts, and many relevant works augment language models (LMs) with graph neural networks (GNNs) to encode the Knowledge Graph (KG) information. However, most…

Computation and Language · Computer Science 2023-04-26 Jinyoung Park , Hyeong Kyu Choi , Juyeon Ko , Hyeonjin Park , Ji-Hoon Kim , Jisu Jeong , Kyungmin Kim , Hyunwoo J. Kim

Knowledge models are fundamental to dialogue systems for enabling conversational interactions, which require handling domain-specific knowledge. Ensuring effective communication in information-providing conversations entails aligning user…

Computation and Language · Computer Science 2024-08-13 Phillip Schneider , Nektarios Machner , Kristiina Jokinen , Florian Matthes

Knowledge Graphs (KG) act as a great tool for holding distilled information from large natural language text corpora. The problem of natural language querying over knowledge graphs is essential for the human consumption of this information.…

Machine Learning · Computer Science 2021-12-22 Aayushee Gupta , K. M. Annervaz , Ambedkar Dukkipati , Shubhashis Sengupta

Question answering models commonly have access to two sources of "knowledge" during inference time: (1) parametric knowledge - the factual knowledge encoded in the model weights, and (2) contextual knowledge - external knowledge (e.g., a…

Computation and Language · Computer Science 2022-11-11 Ella Neeman , Roee Aharoni , Or Honovich , Leshem Choshen , Idan Szpektor , Omri Abend

It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting,…

Computation and Language · Computer Science 2022-09-30 Jiacheng Liu , Alisa Liu , Ximing Lu , Sean Welleck , Peter West , Ronan Le Bras , Yejin Choi , Hannaneh Hajishirzi

While conversing with chatbots, humans typically tend to ask many questions, a significant portion of which can be answered by referring to large-scale knowledge graphs (KG). While Question Answering (QA) and dialog systems have been…

Computation and Language · Computer Science 2018-10-05 Amrita Saha , Vardaan Pahuja , Mitesh M. Khapra , Karthik Sankaranarayanan , Sarath Chandar

Commonsense generation aims at generating plausible everyday scenario description based on a set of provided concepts. Digging the relationship of concepts from scratch is non-trivial, therefore, we retrieve prototypes from external…

Computation and Language · Computer Science 2020-12-02 Zhihao Fan , Yeyun Gong , Zhongyu Wei , Siyuan Wang , Yameng Huang , Jian Jiao , Xuanjing Huang , Nan Duan , Ruofei Zhang

While multi-modal models have successfully integrated information from image, video, and audio modalities, integrating graph modality into large language models (LLMs) remains unexplored. This discrepancy largely stems from the inherent…

Computation and Language · Computer Science 2023-10-13 Yuanchun Shen , Ruotong Liao , Zhen Han , Yunpu Ma , Volker Tresp

Knowledge-based recommendation models effectively alleviate the data sparsity issue leveraging the side information in the knowledge graph, and have achieved considerable performance. Nevertheless, the knowledge graphs used in previous…

Information Retrieval · Computer Science 2024-03-28 Shenghao Yang , Weizhi Ma , Peijie Sun , Min Zhang , Qingyao Ai , Yiqun Liu , Mingchen Cai

Grounded language models use external sources of information, such as knowledge graphs, to meet some of the general challenges associated with pre-training. By extending previous work on compositional generalization in semantic parsing, we…

Computation and Language · Computer Science 2024-06-10 Sondre Wold , Étienne Simon , Lucas Georges Gabriel Charpentier , Egor V. Kostylev , Erik Velldal , Lilja Øvrelid

Commonsense question-answering (QA) tasks, in the form of benchmarks, are constantly being introduced for challenging and comparing commonsense QA systems. The benchmarks provide question sets that systems' developers can use to train and…

Artificial Intelligence · Computer Science 2020-12-23 Henrique Santos , Minor Gordon , Zhicheng Liang , Gretchen Forbush , Deborah L. McGuinness

Answer selection, which is involved in many natural language processing applications such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the…

Computation and Language · Computer Science 2021-04-13 Yang Deng , Yuexiang Xie , Yaliang Li , Min Yang , Wai Lam , Ying Shen

We propose a method to make natural language understanding models more parameter efficient by storing knowledge in an external knowledge graph (KG) and retrieving from this KG using a dense index. Given (possibly multilingual) downstream…

Computation and Language · Computer Science 2022-06-28 Ningyuan Huang , Yash R. Deshpande , Yibo Liu , Houda Alberts , Kyunghyun Cho , Clara Vania , Iacer Calixto

In a conversational system, dynamically generating follow-up questions based on context can help users explore information and provide a better user experience. Humans are usually able to ask questions that involve some general life…

Artificial Intelligence · Computer Science 2025-06-30 Jianyu Liu , Yi Huang , Sheng Bi , Junlan Feng , Guilin Qi

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

Knowledge graphs (KGs) such as DBpedia, Freebase, YAGO, Wikidata, and NELL were constructed to store large-scale, real-world facts as (subject, predicate, object) triples -- that can also be modeled as a graph, where a node (a subject or an…

Databases · Computer Science 2023-05-25 Arijit Khan

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

Answering complex questions often requires reasoning over knowledge graphs (KGs). State-of-the-art methods often utilize entities in questions to retrieve local subgraphs, which are then fed into KG encoder, e.g. graph neural networks…

Computation and Language · Computer Science 2023-05-31 Shiyang Li , Yifan Gao , Haoming Jiang , Qingyu Yin , Zheng Li , Xifeng Yan , Chao Zhang , Bing Yin

Automatic KB completion for commonsense knowledge graphs (e.g., ATOMIC and ConceptNet) poses unique challenges compared to the much studied conventional knowledge bases (e.g., Freebase). Commonsense knowledge graphs use free-form text to…

Computation and Language · Computer Science 2019-12-23 Chaitanya Malaviya , Chandra Bhagavatula , Antoine Bosselut , Yejin Choi