English
Related papers

Related papers: Knowledge-enhanced Transformer for Multivariate Lo…

200 papers

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Knowledge Graph Embedding (KGE) has proven to be an effective approach to solving the Knowledge Graph Completion (KGC) task. Relational patterns which refer to relations with specific semantics exhibiting graph patterns are an important…

Artificial Intelligence · Computer Science 2023-08-16 Long Jin , Zhen Yao , Mingyang Chen , Huajun Chen , Wen Zhang

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

Computation and Language · Computer Science 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Knowledge graph embedding (KGE) has become a fundamental technique for representation learning on multi-relational data. Many seminal models, such as TransE, operate in an unbounded Euclidean space, which presents inherent limitations in…

Machine Learning · Computer Science 2025-11-05 Xuan-Truong Quan , Xuan-Son Quan , Duc Do Minh , Vinh Nguyen Van

Knowledge Graph embedding provides a versatile technique for representing knowledge. These techniques can be used in a variety of applications such as completion of knowledge graph to predict missing information, recommender systems,…

Information Retrieval · Computer Science 2021-07-19 Shivani Choudhary , Tarun Luthra , Ashima Mittal , Rajat Singh

Multivariate Time Series Forecasting (MTSF) has long been a key research focus. Traditionally, these studies assume a fixed number of variables, but in real-world applications, Cyber-Physical Systems often expand as new sensors are…

Machine Learning · Computer Science 2025-06-03 Minbo Ma , Kai Tang , Huan Li , Fei Teng , Dalin Zhang , Tianrui Li

Knowledge graph completion is the task of inferring missing facts based on existing data in a knowledge graph. Temporal knowledge graph completion (TKGC) is an extension of this task to temporal knowledge graphs, where each fact is…

Machine Learning · Computer Science 2021-09-21 Johannes Messner , Ralph Abboud , İsmail İlkan Ceylan

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

Machine Learning · Computer Science 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality,…

Machine Learning · Computer Science 2025-06-17 Hans Krupakar , Kandappan V A

In recent years, knowledge graphs have gained interest and witnessed widespread applications in various domains, such as information retrieval, question-answering, recommendation systems, amongst others. Large-scale knowledge graphs to this…

Machine Learning · Computer Science 2024-10-29 Arnab Sharma , N'Dah Jean Kouagou , Axel-Cyrille Ngonga Ngomo

Accurate multivariate time series forecasting hinges on inter-series correlations, which often evolve in complex ways across different temporal scales. Existing methods are limited in modeling these multi-scale dependencies and struggle to…

Machine Learning · Computer Science 2026-01-27 Shaoxun Wang , Xingjun Zhang , Qianyang Li , Jiawei Cao , Zhendong Tan

Many Knowledege Graphs (KGs) are frequently updated, forcing their Knowledge Graph Embeddings (KGEs) to adapt to these changes. To address this problem, continual learning techniques for KGEs incorporate embeddings for new entities while…

Machine Learning · Computer Science 2026-05-29 Gerard Pons , Besim Bilalli , Anna Queralt

The cascade of 2D geometric transformations were exploited to model relations between entities in a knowledge graph (KG), leading to an effective KG embedding (KGE) model, CompoundE. Furthermore, the rotation in the 3D space was proposed as…

Artificial Intelligence · Computer Science 2023-04-04 Xiou Ge , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Real-world Knowledge Graphs (KGs) often suffer from incompleteness, which limits their potential performance. Knowledge Graph Completion (KGC) techniques aim to address this issue. However, traditional KGC methods are computationally…

Computation and Language · Computer Science 2023-11-03 Alla Chepurova , Aydar Bulatov , Yuri Kuratov , Mikhail Burtsev

In knowledge graph embedding, leveraging relation specific entity transformation has markedly enhanced performance. However, the consistency of embedding differences before and after transformation remains unaddressed, risking the loss of…

Computation and Language · Computer Science 2025-06-16 Junsik Kim , Jinwook Park , Kangil Kim

Knowledge Graphs (KGs) provide a structured representation of knowledge but often suffer from challenges of incompleteness. To address this, link prediction or knowledge graph completion (KGC) aims to infer missing new facts based on…

Machine Learning · Computer Science 2025-01-03 Wenkai Tu , Guojia Wan , Zhengchun Shang , Bo Du

Temporal Knowledge Graphs (TKGs) represent dynamic facts as timestamped relations between entities. TKG completion involves forecasting missing or future links, requiring models to reason over time-evolving structure. While LLMs show…

Machine Learning · Computer Science 2025-05-26 Ömer Faruk Akgül , Feiyu Zhu , Yuxin Yang , Rajgopal Kannan , Viktor Prasanna

Time series forecasting is a crucial challenge with significant applications in areas such as weather prediction, stock market analysis, and scientific simulations. This paper introduces an embedded decomposed transformer, 'EDformer', for…

Machine Learning · Computer Science 2024-12-18 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz

Federated Knowledge Graph Embedding (FKGE) aims to facilitate collaborative learning of entity and relation embeddings from distributed Knowledge Graphs (KGs) across multiple clients, while preserving data privacy. Training FKGE models with…

Artificial Intelligence · Computer Science 2026-01-13 Xiaoxiong Zhang , Zhiwei Zeng , Xin Zhou , Chunyan Miao

Recent advances in Knowledge Graph Embedding (KGE) allow for representing entities and relations in continuous vector spaces. Some traditional KGE models leveraging additional type information can improve the representation of entities…

Computation and Language · Computer Science 2020-10-07 Guanglin Niu , Bo Li , Yongfei Zhang , Shiliang Pu , Jingyang Li