English
Related papers

Related papers: Transformers4NewsRec: A Transformer-based News Rec…

200 papers

News recommendation is important for personalized online news services. Most existing news recommendation methods rely on centrally stored user behavior data to both train models offline and provide online recommendation services. However,…

Information Retrieval · Computer Science 2021-09-14 Tao Qi , Fangzhao Wu , Chuhan Wu , Yongfeng Huang , Xing Xie

Deep neural networks have emerged as a powerful technique for learning representations from user-item interaction data in collaborative filtering (CF) for recommender systems. However, many existing methods heavily rely on unique user and…

Information Retrieval · Computer Science 2025-10-21 Xubin Ren , Chao Huang

Transformers have been widely applied in text classification. Unfortunately, real-world data contain anomalies and noisy labels that cause challenges for state-of-art Transformers. This paper proposes Protoformer, a novel self-learning…

Computation and Language · Computer Science 2022-06-28 Ashkan Farhangi , Ning Sui , Nan Hua , Haiyan Bai , Arthur Huang , Zhishan Guo

News recommendation calls for deep insights of news articles' underlying semantics. Therefore, pretrained language models (PLMs), like BERT and RoBERTa, may substantially contribute to the recommendation quality. However, it's extremely…

Information Retrieval · Computer Science 2021-03-08 Shitao Xiao , Zheng Liu , Yingxia Shao , Tao Di , Xing Xie

News recommendations heavily rely on Natural Language Processing (NLP) methods to analyze, understand, and categorize content, enabling personalized suggestions based on user interests and reading behaviors. Large Language Models (LLMs)…

Information Retrieval · Computer Science 2024-10-23 Dairui Liu , Boming Yang , Honghui Du , Derek Greene , Neil Hurley , Aonghus Lawlor , Ruihai Dong , Irene Li

Learning large-scale pre-trained models on broad-ranging data and then transfer to a wide range of target tasks has become the de facto paradigm in many machine learning (ML) communities. Such big models are not only strong performers in…

Information Retrieval · Computer Science 2025-09-23 Jie Wang , Fajie Yuan , Mingyue Cheng , Joemon M. Jose , Chenyun Yu , Beibei Kong , Zhijin Wang , Bo Hu , Zang Li

Personalized news recommender systems help users quickly find content of their interests from the sea of information. Today, the mainstream technology for personalized news recommendation is based on deep neural networks that can accurately…

Information Retrieval · Computer Science 2023-04-18 Rui Liu , Bin Yin , Ziyi Cao , Qianchen Xia , Yong Chen , Dell Zhang

Prior study has shown that pretrained language models (PLM) can boost the performance of text-based recommendation. In contrast to previous works that either use PLM to encode user history as a whole input text, or impose an additional…

Computation and Language · Computer Science 2023-05-26 Zhiming Mao , Huimin Wang , Yiming Du , Kam-fai Wong

In recent years, owing to the outstanding performance in graph representation learning, graph neural network (GNN) techniques have gained considerable interests in many real-world scenarios, such as recommender systems and social networks.…

Machine Learning · Computer Science 2021-12-09 Weibin Li , Mingkai He , Zhengjie Huang , Xianming Wang , Shikun Feng , Weiyue Su , Yu Sun

Recent advancements in Natural Language Processing (NLP) have led to the development of NLP-based recommender systems that have shown superior performance. However, current models commonly treat items as mere IDs and adopt discriminative…

Information Retrieval · Computer Science 2023-04-11 Jinming Li , Wentao Zhang , Tian Wang , Guanglei Xiong , Alan Lu , Gerard Medioni

The dissemination of fake news on social networks has drawn public need for effective and efficient fake news detection methods. Generally, fake news on social networks is multi-modal and has various connections with other entities such as…

Social and Information Networks · Computer Science 2022-05-09 Tianle Li , Yushi Sun , Shang-ling Hsu , Yanjia Li , Raymond Chi-Wing Wong

Media has a substantial impact on the public perception of events. A one-sided or polarizing perspective on any topic is usually described as media bias. One of the ways how bias in news articles can be introduced is by altering word…

Computation and Language · Computer Science 2022-11-08 Timo Spinde , Jan-David Krieger , Terry Ruas , Jelena Mitrović , Franz Götz-Hahn , Akiko Aizawa , Bela Gipp

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and materials discovery. Self-supervised pretraining of transformer models requires large-scale…

Machine Learning · Computer Science 2023-10-27 Pei Zhang , Logan Kearney , Debsindhu Bhowmik , Zachary Fox , Amit K. Naskar , John Gounley

With the pandemic of COVID-19, relevant fake news is spreading all over the sky throughout the social media. Believing in them without discrimination can cause great trouble to people's life. However, universal language models may perform…

Computation and Language · Computer Science 2023-02-13 Ben Chen , Bin Chen , Dehong Gao , Qijin Chen , Chengfu Huo , Xiaonan Meng , Weijun Ren , Yang Zhou

This paper presents LightFusionRec, a novel lightweight cross-domain recommendation system that integrates DistilBERT for textual feature extraction and FastText for genre embedding. Important issues in recommendation systems, such as data…

Artificial Intelligence · Computer Science 2024-10-22 Vansh Kharidia , Dhruvi Paprunia , Prashasti Kanikar

Recommender systems often use text-side information to improve their predictions, especially in cold-start or zero-shot recommendation scenarios, where traditional collaborative filtering approaches cannot be used. Many approaches to…

Information Retrieval · Computer Science 2024-10-10 Vojtěch Vančura , Pavel Kordík , Milan Straka

Large Transformer-based language models can aid human authors by suggesting plausible continuations of text written so far. However, current interactive writing assistants do not allow authors to guide text generation in desired topical…

Computation and Language · Computer Science 2021-03-30 Haw-Shiuan Chang , Jiaming Yuan , Mohit Iyyer , Andrew McCallum

Recent advances in large language models (LLMs) have enabled more semantic-aware recommendations through natural language generation. Existing LLM for recommendation (LLM4Rec) methods mostly operate in a System 1-like manner, relying on…

Information Retrieval · Computer Science 2026-01-22 Qihang Yu , Kairui Fu , Zheqi Lv , Shengyu Zhang , Xinhui Wu , Chen Lin , Feng Wei , Bo Zheng , Fei Wu

Contemporary generative recommendation systems face significant challenges in handling multimodal data, eliminating algorithmic biases, and providing transparent decision-making processes. This paper introduces an enhanced generative…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Inspired by the success of Transformer-based models in natural language processing, this paper investigates their potential as foundation models for network traffic analysis. We propose a unified pre-training and fine-tuning pipeline for…

Networking and Internet Architecture · Computer Science 2026-02-09 Samara Mayhoub , Chuan Heng Foh , Mahdi Boloursaz Mashhadi , Mohammad Shojafar , Rahim Tafazolli