English
Related papers

Related papers: Instilling Type Knowledge in Language Models via M…

200 papers

Commonsense question answering (QA) requires a model to grasp commonsense and factual knowledge to answer questions about world events. Many prior methods couple language modeling with knowledge graphs (KG). However, although a KG contains…

Computation and Language · Computer Science 2021-08-04 Yichong Xu , Chenguang Zhu , Ruochen Xu , Yang Liu , Michael Zeng , Xuedong Huang

We introduce the task of entity-centric query refinement. Given an input query whose answer is a (potentially large) collection of entities, the task output is a small set of query refinements meant to assist the user in efficient domain…

Computation and Language · Computer Science 2022-09-19 David Wadden , Nikita Gupta , Kenton Lee , Kristina Toutanova

A backbone of knowledge graphs are their class membership relations, which assign entities to a given class. As part of the knowledge engineering process, we propose a new method for evaluating the quality of these relations by processing…

Computation and Language · Computer Science 2024-04-29 Bradley P. Allen , Paul T. Groth

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

Recently, it has been shown that the incorporation of structured knowledge into Large Language Models significantly improves the results for a variety of NLP tasks. In this paper, we propose a method for exploring pre-trained Text-to-Text…

Computation and Language · Computer Science 2023-10-04 Mikhail Salnikov , Hai Le , Prateek Rajput , Irina Nikishina , Pavel Braslavski , Valentin Malykh , Alexander Panchenko

As large language models (LLMs) grow larger and more sophisticated, assessing their "reasoning" capabilities in natural language grows more challenging. Recent question answering (QA) benchmarks that attempt to assess reasoning are often…

Computation and Language · Computer Science 2022-12-01 Matthew Ho , Aditya Sharma , Justin Chang , Michael Saxon , Sharon Levy , Yujie Lu , William Yang Wang

Knowledge-Based Visual Question Answering (KBVQA) is a bi-modal task requiring external world knowledge in order to correctly answer a text question and associated image. Recent single modality text work has shown knowledge injection into…

Computation and Language · Computer Science 2022-05-30 Diego Garcia-Olano , Yasumasa Onoe , Joydeep Ghosh

Datasets for data-to-text generation typically focus either on multi-domain, single-sentence generation or on single-domain, long-form generation. In this work, we cast generating Wikipedia sections as a data-to-text generation task and…

Computation and Language · Computer Science 2021-06-03 Mingda Chen , Sam Wiseman , Kevin Gimpel

Most of previous work in knowledge base (KB) completion has focused on the problem of relation extraction. In this work, we focus on the task of inferring missing entity type instances in a KB, a fundamental task for KB competition yet…

Computation and Language · Computer Science 2015-04-28 Arvind Neelakantan , Ming-Wei Chang

Knowledge-Based Visual Question Answering (KB-VQA) requires models to answer questions about an image by integrating external knowledge, posing significant challenges due to noisy retrieval and the structured, encyclopedic nature of the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shan Ning , Longtian Qiu , Xuming He

Recent studies have shown that multilingual pretrained language models can be effectively improved with cross-lingual alignment information from Wikipedia entities. However, existing methods only exploit entity information in pretraining…

Computation and Language · Computer Science 2022-03-31 Ryokan Ri , Ikuya Yamada , Yoshimasa Tsuruoka

We study the problem of automatically building hypernym taxonomies from textual and visual data. Previous works in taxonomy induction generally ignore the increasingly prominent visual data, which encode important perceptual semantics.…

Computation and Language · Computer Science 2016-06-30 Hao Zhang , Zhiting Hu , Yuntian Deng , Mrinmaya Sachan , Zhicheng Yan , Eric P. Xing

Understanding searchers' queries is an essential component of semantic search systems. In many cases, search queries involve specific attributes of an entity in a knowledge base (KB), which can be further used to find query answers. In this…

Information Retrieval · Computer Science 2018-09-25 Arash Dargahi Nobari , Arian Askari , Faegheh Hasibi , Mahmood Neshati

Knowledge discovery and collection are intelligence-intensive tasks that traditionally require significant human effort to ensure high-quality outputs. Recent research has explored multi-agent frameworks for automating Wikipedia-style…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Zhongyu Yang , Jun Chen , Dannong Xu , Junjie Fei , Xiaoqian Shen , Liangbing Zhao , Chun-Mei Feng , Mohamed Elhoseiny

How much knowledge do pretrained language models hold? Recent research observed that pretrained transformers are adept at modeling semantics but it is unclear to what degree they grasp human knowledge, or how to ensure they do so. In this…

Computation and Language · Computer Science 2021-02-05 Corby Rosset , Chenyan Xiong , Minh Phan , Xia Song , Paul Bennett , Saurabh Tiwary

Entity type tagging is the task of assigning category labels to each mention of an entity in a document. While standard systems focus on a small set of types, recent work (Ling and Weld, 2012) suggests that using a large fine-grained label…

Computation and Language · Computer Science 2016-08-03 Dan Gillick , Nevena Lazic , Kuzman Ganchev , Jesse Kirchner , David Huynh

Interacting with relational databases through natural language helps users of any background easily query and analyze a vast amount of data. This requires a system that understands users' questions and converts them to SQL queries…

Computation and Language · Computer Science 2018-04-27 Tao Yu , Zifan Li , Zilin Zhang , Rui Zhang , Dragomir Radev

Recent research has shown great progress on fine-grained entity typing. Most existing methods require pre-defining a set of types and training a multi-class classifier from a large labeled data set based on multi-level linguistic features.…

Computation and Language · Computer Science 2016-03-11 Lifu Huang , Jonathan May , Xiaoman Pan , Heng Ji

Language model (LM) pretraining can learn various knowledge from text corpora, helping downstream tasks. However, existing methods such as BERT model a single document, and do not capture dependencies or knowledge that span across…

Computation and Language · Computer Science 2022-03-31 Michihiro Yasunaga , Jure Leskovec , Percy Liang