English
Related papers

Related papers: Conditional Attention Networks for Distilling Know…

200 papers

Heterogeneous information network has been widely used to alleviate sparsity and cold start problems in recommender systems since it can model rich context information in user-item interactions. Graph neural network is able to encode this…

Information Retrieval · Computer Science 2021-06-22 Yifan Wang , Suyao Tang , Yuntong Lei , Weiping Song , Sheng Wang , Ming Zhang

In this paper, we propose a novel graph neural network-based recommendation model called KGLN, which leverages Knowledge Graph (KG) information to enhance the accuracy and effectiveness of personalized recommendations. We first use a…

Information Retrieval · Computer Science 2024-02-06 Chaoyang Zhang , Yanan Li , Shen Chen , Siwei Fan , Wei Li

Knowledge graph (KG) plays an increasingly important role in recommender systems. A recent technical trend is to develop end-to-end models founded on graph neural networks (GNNs). However, existing GNN-based models are coarse-grained in…

Information Retrieval · Computer Science 2021-02-16 Xiang Wang , Tinglin Huang , Dingxian Wang , Yancheng Yuan , Zhenguang Liu , Xiangnan He , Tat-Seng Chua

Incorporating Knowledge Graphs into Recommendation has attracted growing attention in industry, due to the great potential of KG in providing abundant supplementary information and interpretability for the underlying models. However, simply…

Information Retrieval · Computer Science 2024-06-03 Ding Zou , Wei Wei , Feida Zhu , Chuanyu Xu , Tao Zhang , Chengfu Huo

This paper studies recommender systems with knowledge graphs, which can effectively address the problems of data sparsity and cold start. Recently, a variety of methods have been developed for this problem, which generally try to learn…

Information Retrieval · Computer Science 2022-01-10 Weiping Song , Zhijian Duan , Ziqing Yang , Hao Zhu , Ming Zhang , Jian Tang

Knowledge Distillation (KD) aims at transferring knowledge from a larger well-optimized teacher network to a smaller learnable student network.Existing KD methods have mainly considered two types of knowledge, namely the individual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Sheng Zhou , Yucheng Wang , Defang Chen , Jiawei Chen , Xin Wang , Can Wang , Jiajun Bu

We propose a novel technique to enhance Knowledge Graph Reasoning by combining Graph Convolution Neural Network (GCN) with the Attention Mechanism. This approach utilizes the Attention Mechanism to examine the relationships between entities…

Information Retrieval · Computer Science 2025-03-24 Meera Gupta , Ravi Khanna , Divya Choudhary , Nandini Rao

To alleviate data sparsity and cold-start problems of traditional recommender systems (RSs), incorporating knowledge graphs (KGs) to supplement auxiliary information has attracted considerable attention recently. However, simply integrating…

Information Retrieval · Computer Science 2022-01-04 Yankai Chen , Yaming Yang , Yujing Wang , Jing Bai , Xiangchen Song , Irwin King

\textit{Knowledge-aware} recommendation methods (KGR) based on \textit{graph neural networks} (GNNs) and \textit{contrastive learning} (CL) have achieved promising performance. However, they fall short in modeling fine-grained user…

Information Retrieval · Computer Science 2024-03-26 Taotian Pang , Xingyu Lou , Fei Zhao , Zhen Wu , Kuiyao Dong , Qiuying Peng , Yue Qi , Xinyu Dai

Incorporating knowledge graph into recommender systems has attracted increasing attention in recent years. By exploring the interlinks within a knowledge graph, the connectivity between users and items can be discovered as paths, which…

Information Retrieval · Computer Science 2018-11-13 Xiang Wang , Dingxian Wang , Canran Xu , Xiangnan He , Yixin Cao , Tat-Seng Chua

Transformer attracts much attention because of its ability to learn global relations and superior performance. In order to achieve higher performance, it is natural to distill complementary knowledge from Transformer to convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Yufan Liu , Jiajiong Cao , Bing Li , Weiming Hu , Jingting Ding , Liang Li

Knowledge graphs capture structured information and relations between a set of entities or items. As such knowledge graphs represent an attractive source of information that could help improve recommender systems. However, existing…

Machine Learning · Computer Science 2019-06-17 Hongwei Wang , Fuzheng Zhang , Mengdi Zhang , Jure Leskovec , Miao Zhao , Wenjie Li , Zhongyuan Wang

The goal of representation learning of knowledge graph is to encode both entities and relations into a low-dimensional embedding spaces. Many recent works have demonstrated the benefits of knowledge graph embedding on knowledge graph…

Artificial Intelligence · Computer Science 2019-10-11 Wenqiang Liu , Hongyun Cai , Xu Cheng , Sifa Xie , Yipeng Yu , Hanyu Zhang

In recent years, the use of edge information provided by knowledge graphs together with the advantages of higher-order connectivity in graph neural networks for recommendation systems has become an important research direction. However,…

Information Retrieval · Computer Science 2026-05-12 Zhifei Hu , Feng Xia

Knowledge Distillation (KD) is a strategy for the definition of a set of transferability gangways to improve the efficiency of Convolutional Neural Networks. Feature-based Knowledge Distillation is a subfield of KD that relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Juan C. SanMiguel

To provide more accurate, diverse, and explainable recommendation, it is compulsory to go beyond modeling user-item interactions and take side information into account. Traditional methods like factorization machine (FM) cast it as a…

Machine Learning · Computer Science 2019-06-11 Xiang Wang , Xiangnan He , Yixin Cao , Meng Liu , Tat-Seng Chua

Graph Neural Networks (GNNs) have attracted tremendous attention by demonstrating their capability to handle graph data. However, they are difficult to be deployed in resource-limited devices due to model sizes and scalability constraints…

Machine Learning · Computer Science 2023-02-02 Yijun Tian , Shichao Pei , Xiangliang Zhang , Chuxu Zhang , Nitesh V. Chawla

Tremendous research efforts have been made to thrive deep domain adaptation (DA) by seeking domain-invariant features. Most existing deep DA models only focus on aligning feature representations of task-specific layers across domains while…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Shuang Li , Chi Harold Liu , Qiuxia Lin , Binhui Xie , Zhengming Ding , Gao Huang , Jian Tang

Knowledge distillation (KD) is a widely used technique to transfer knowledge from a large teacher network to a smaller student model. Traditional KD uses a fixed balancing factor alpha as a hyperparameter to combine the hard-label…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhengda Li

In this paper, we propose to use a Conditional Generative Adversarial Network (CGAN) for distilling (i.e. transferring) knowledge from sensor data and enhancing low-resolution target detection. In unconstrained surveillance settings, sensor…

Image and Video Processing · Electrical Eng. & Systems 2018-07-23 Siddharth Roheda , Benjamin S. Riggan , Hamid Krim , Liyi Dai