English
Related papers

Related papers: Image-embodied Knowledge Representation Learning

200 papers

We present KBLRN, a framework for end-to-end learning of knowledge base representations from latent, relational, and numerical features. KBLRN integrates feature types with a novel combination of neural representation learning and…

Artificial Intelligence · Computer Science 2018-06-12 Alberto Garcia-Duran , Mathias Niepert

Encoding facts as representations of entities and binary relationships between them, as learned by knowledge graph representation models, is useful for various tasks, including predicting new facts, question answering, fact checking and…

Machine Learning · Computer Science 2022-02-01 Ivana Balažević

Previous models for learning entity and relationship embeddings of knowledge graphs such as TransE, TransH, and TransR aim to explore new links based on learned representations. However, these models interpret relationships as simple…

Machine Learning · Computer Science 2018-04-02 Feipeng Zhao , Martin Renqiang Min , Chen Shen , Amit Chakraborty

Entity linking (EL) aligns textual mentions with their corresponding entities in a knowledge base, facilitating various applications such as semantic search and question answering. Recent advances in multimodal entity linking (MEL) have…

Information Retrieval · Computer Science 2025-04-22 Juyeon Kim , Geon Lee , Taeuk Kim , Kijung Shin

We propose a novel approach to improve a visual-semantic embedding model by incorporating concept representations captured from an external structured knowledge base. We investigate its performance on image classification under both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Mirantha Jayathilaka , Tingting Mu , Uli Sattler

Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an entity into its…

Computation and Language · Computer Science 2023-10-19 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

Geometric shape features have been widely used as strong predictors for image classification. Nevertheless, most existing classifiers such as deep neural networks (DNNs) directly leverage the statistical correlations between these shape…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Tonmoy Hossain , Jing Ma , Jundong Li , Miaomiao Zhang

Knowledge embeddings (KE) represent a knowledge graph (KG) by embedding entities and relations into continuous vector spaces. Existing methods are mainly structure-based or description-based. Structure-based methods learn representations…

Computation and Language · Computer Science 2023-06-30 Xintao Wang , Qianyu He , Jiaqing Liang , Yanghua Xiao

Knowledge graphs have emerged as an important model for studying complex multi-relational data. This has given rise to the construction of numerous large scale but incomplete knowledge graphs encoding information extracted from various…

Machine Learning · Computer Science 2018-07-24 Rakshit Trivedi , Bunyamin Sisman , Jun Ma , Christos Faloutsos , Hongyuan Zha , Xin Luna Dong

Human knowledge provides a formal understanding of the world. Knowledge graphs that represent structural relations between entities have become an increasingly popular research direction towards cognition and human-level intelligence. In…

Computation and Language · Computer Science 2021-04-02 Shaoxiong Ji , Shirui Pan , Erik Cambria , Pekka Marttinen , Philip S. Yu

Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or…

Machine Learning · Computer Science 2022-06-08 Vince Jankovics , Michael Garcia Ortiz , Eduardo Alonso

Human-curated knowledge graphs provide critical supportive information to various natural language processing tasks, but these graphs are usually incomplete, urging auto-completion of them. Prevalent graph embedding approaches, e.g.,…

Computation and Language · Computer Science 2021-02-25 Bo Wang , Tao Shen , Guodong Long , Tianyi Zhou , Yi Chang

Knowledge graphs (KGs) have gained prominence for their ability to learn representations for uni-relational facts. Recently, research has focused on modeling hyper-relational facts, which move beyond the restriction of uni-relational facts…

Machine Learning · Computer Science 2022-08-31 Harry Shomer , Wei Jin , Juanhui Li , Yao Ma , Jiliang Tang

Knowledge tracing (KT) is a popular approach for modeling students' learning progress over time, which can enable more personalized and adaptive learning. However, existing KT approaches face two major limitations: (1) they rely heavily on…

Machine Learning · Computer Science 2025-03-14 Yilmazcan Ozyurt , Stefan Feuerriegel , Mrinmaya Sachan

This paper introduces a new in-context learning (ICL) mechanism called In-Image Learning (I$^2$L) that combines demonstration examples, visual cues, and chain-of-thought reasoning into an aggregated image to enhance the capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Lei Wang , Wanyu Xu , Zhiqiang Hu , Yihuai Lan , Shan Dong , Hao Wang , Roy Ka-Wei Lee , Ee-Peng Lim

Embedding learning, a.k.a. representation learning, has been shown to be able to model large-scale semantic knowledge graphs. A key concept is a mapping of the knowledge graph to a tensor representation whose entries are predicted by models…

Machine Learning · Computer Science 2015-12-23 Cristóbal Esteban , Volker Tresp , Yinchong Yang , Stephan Baier , Denis Krompaß

Representation learning of knowledge graphs aims to embed entities and relations into low-dimensional vectors. Most existing works only consider the direct relations or paths between an entity pair. It is considered that such approaches…

Computation and Language · Computer Science 2022-10-24 Sirui Li , Kok Wai Wong , Dengya Zhu , Chun Che Fung

Many Knowledege Graphs (KGs) are frequently updated, forcing their Knowledge Graph Embeddings (KGEs) to adapt to these changes. To address this problem, continual learning techniques for KGEs incorporate embeddings for new entities while…

Machine Learning · Computer Science 2026-05-29 Gerard Pons , Besim Bilalli , Anna Queralt

Representation learning is the foundation of natural language processing (NLP). This work presents new methods to employ visual information as assistant signals to general NLP tasks. For each sentence, we first retrieve a flexible number of…

Computation and Language · Computer Science 2023-01-10 Zhuosheng Zhang , Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita , Zuchao Li , Hai Zhao

Multilingual knowledge graph (KG) embeddings provide latent semantic representations of entities and structured knowledge with cross-lingual inferences, which benefit various knowledge-driven cross-lingual NLP tasks. However, precisely…

Artificial Intelligence · Computer Science 2018-06-19 Muhao Chen , Yingtao Tian , Kai-Wei Chang , Steven Skiena , Carlo Zaniolo