English
Related papers

Related papers: Self-supervised Knowledge Triplet Learning for Zer…

200 papers

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

Computation and Language · Computer Science 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Few-shot Knowledge Graph (KG) Relational Reasoning aims to predict unseen triplets (i.e., query triplets) for rare relations in KGs, given only several triplets of these relations as references (i.e., support triplets). This task has gained…

Computation and Language · Computer Science 2024-06-25 Haochen Liu , Song Wang , Chen Chen , Jundong Li

With the advance of natural language inference (NLI), a rising demand for NLI is to handle scientific texts. Existing methods depend on pre-trained models (PTM) which lack domain-specific knowledge. To tackle this drawback, we introduce a…

Computation and Language · Computer Science 2022-10-31 Chenglin Wang , Yucheng Zhou , Guodong Long , Xiaodong Wang , Xiaowei Xu

Knowledge Graph (KG) and its variant of ontology have been widely used for knowledge representation, and have shown to be quite effective in augmenting Zero-shot Learning (ZSL). However, existing ZSL methods that utilize KGs all neglect the…

Artificial Intelligence · Computer Science 2022-06-09 Yuxia Geng , Jiaoyan Chen , Wen Zhang , Yajing Xu , Zhuo Chen , Jeff Z. Pan , Yufeng Huang , Feiyu Xiong , Huajun Chen

This paper studies aligning knowledge graphs from different sources or languages. Most existing methods train supervised methods for the alignment, which usually require a large number of aligned knowledge triplets. However, such a large…

Machine Learning · Computer Science 2019-07-09 Meng Qu , Jian Tang , Yoshua Bengio

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties…

Computation and Language · Computer Science 2024-03-05 Rohan Kumar , Youngmin Kim , Sunitha Ravi , Haitian Sun , Christos Faloutsos , Ruslan Salakhutdinov , Minji Yoon

Machine Learning has been the quintessential solution for many AI problems, but learning is still heavily dependent on the specific training data. Some learning models can be incorporated with a prior knowledge in the Bayesian set up, but…

Computation and Language · Computer Science 2018-05-22 K M Annervaz , Somnath Basu Roy Chowdhury , Ambedkar Dukkipati

Knowledge tracing (KT), a key component of an intelligent tutoring system, is a machine learning technique that estimates the mastery level of a student based on his/her past performance. The objective of KT is to predict a student's…

Artificial Intelligence · Computer Science 2019-09-19 Heonseok Ha , Uiwon Hwang , Yongjun Hong , Jahee Jang , Sungroh Yoon

We propose a simple method to generate multilingual question and answer pairs on a large scale through the use of a single generative model. These synthetic samples can be used to improve the zero-shot performance of multilingual QA models…

Computation and Language · Computer Science 2021-06-01 Siamak Shakeri , Noah Constant , Mihir Sanjay Kale , Linting Xue

Natural language understanding involves reading between the lines with implicit background knowledge. Current systems either rely on pre-trained language models as the sole implicit source of world knowledge, or resort to external knowledge…

Computation and Language · Computer Science 2020-09-17 Vered Shwartz , Peter West , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

Question answering over knowledge bases (KBQA) aims to answer factoid questions with a given knowledge base (KB). Due to the large scale of KB, annotated data is impossible to cover all fact schemas in KB, which poses a challenge to the…

Computation and Language · Computer Science 2023-05-24 Chuanyuan Tan , Yuehe Chen , Wenbiao Shao , Wenliang Chen

Vision-Language Models (VLMs) demonstrate remarkable zero-shot generalization to unseen tasks, but fall short of the performance of supervised methods in generalizing to downstream tasks with limited data. Prompt learning is emerging as a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Marco Mistretta , Alberto Baldrati , Marco Bertini , Andrew D. Bagdanov

In this paper, we focus on a novel knowledge reuse scenario where the knowledge in the source schema needs to be translated to a semantically heterogeneous target schema. We refer to this task as "knowledge translation" (KT). Unlike data…

Artificial Intelligence · Computer Science 2015-07-14 Shangpu Jiang , Daniel Lowd , Dejing Dou

Question generation (QG) is to generate natural and grammatical questions that can be answered by a specific answer for a given context. Previous sequence-to-sequence models suffer from a problem that asking high-quality questions requires…

Computation and Language · Computer Science 2021-06-22 Xin Jia , Hao Wang , Dawei Yin , Yunfang Wu

Knowledge graph simple question answering (KGSQA), in its standard form, does not take into account that human-curated question answering training data only cover a small subset of the relations that exist in a Knowledge Graph (KG), or even…

Computation and Language · Computer Science 2020-05-26 Georgios Sidiropoulos , Nikos Voskarides , Evangelos Kanoulas

Deep learning algorithms are often said to be data hungry. The performance of such algorithms generally improve as more and more annotated data is fed into the model. While collecting unlabelled data is easier (as they can be scraped easily…

Machine Learning · Computer Science 2024-01-04 Abhishek Sinha , Shreya Singh

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

Incorporating external knowledge to Visual Question Answering (VQA) has become a vital practical need. Existing methods mostly adopt pipeline approaches with different components for knowledge matching and extraction, feature learning,…

Artificial Intelligence · Computer Science 2021-10-19 Zhuo Chen , Jiaoyan Chen , Yuxia Geng , Jeff Z. Pan , Zonggang Yuan , Huajun Chen

Knowledge Distillation (KD) is a common knowledge transfer algorithm used for model compression across a variety of deep learning based natural language processing (NLP) solutions. In its regular manifestations, KD requires access to the…

Computation and Language · Computer Science 2021-01-01 Ahmad Rashid , Vasileios Lioutas , Abbas Ghaddar , Mehdi Rezagholizadeh