English
Related papers

Related papers: Pre-trained Recommender Systems: A Causal Debiasin…

200 papers

Inductive transfer learning has had a big impact on computer vision and NLP domains but has not been used in the area of recommender systems. Even though there has been a large body of research on generating recommendations based on…

Information Retrieval · Computer Science 2020-06-11 Fajie Yuan , Xiangnan He , Alexandros Karatzoglou , Liguang Zhang

Recent studies have proposed unified user modeling frameworks that leverage user behavior data from various applications. Many of them benefit from utilizing users' behavior sequences as plain texts, representing rich information in any…

Information Retrieval · Computer Science 2023-05-16 Kyuyong Shin , Hanock Kwak , Wonjae Kim , Jisu Jeong , Seungjae Jung , Kyung-Min Kim , Jung-Woo Ha , Sang-Woo Lee

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Pre-trained language models have recently emerged as a powerful tool for fine-tuning a variety of language tasks. Ideally, when models are pre-trained on large amount of data, they are expected to gain implicit knowledge. In this paper, we…

Computation and Language · Computer Science 2023-06-22 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

Deep learning algorithms mine knowledge from the training data and thus would likely inherit the dataset's bias information. As a result, the obtained model would generalize poorly and even mislead the decision process in real-life…

Machine Learning · Computer Science 2021-08-16 Wei Zhu , Haitian Zheng , Haofu Liao , Weijian Li , Jiebo Luo

Pre-trained language models trained on large-scale data have learned serious levels of social biases. Consequently, various methods have been proposed to debias pre-trained models. Debiasing methods need to mitigate only discriminatory bias…

Computation and Language · Computer Science 2023-09-19 Masahiro Kaneko , Danushka Bollegala , Naoaki Okazaki

Machine learning fairness concerns about the biases towards certain protected or sensitive group of people when addressing the target tasks. This paper studies the debiasing problem in the context of image classification tasks. Our data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Yi Zhang , Jitao Sang

Providing user-understandable explanations to justify recommendations could help users better understand the recommended items, increase the system's ease of use, and gain users' trust. A typical approach to realize it is natural language…

Information Retrieval · Computer Science 2023-01-16 Lei Li , Yongfeng Zhang , Li Chen

Sequential recommendation models aim to learn from users evolving preferences. However, current state-of-the-art models suffer from an inherent popularity bias. This study developed a novel framework, BiCoRec, that adaptively accommodates…

Information Retrieval · Computer Science 2025-12-17 Mufhumudzi Muthivhi , Terence L van Zyl , Hairong Wang

Recommender systems are frequently challenged by the data sparsity problem. One approach to mitigate this issue is through cross-domain recommendation techniques. In a cross-domain context, sharing knowledge between domains can enhance the…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Iadh Ounis , Craig Macdonald

Multi-modal generative AI systems, such as those combining vision and language, rely on contrastive pre-training to learn representations across different modalities. While their practical benefits are widely acknowledged, a rigorous…

Machine Learning · Computer Science 2025-10-22 Kazusato Oko , Licong Lin , Yuhang Cai , Song Mei

As language models are increasingly included in human-facing machine learning tools, bias against demographic subgroups has gained attention. We propose FineDeb, a two-phase debiasing framework for language models that starts with…

Computation and Language · Computer Science 2023-02-07 Akash Saravanan , Dhruv Mullick , Habibur Rahman , Nidhi Hegde

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Reward modelling from preference data is a crucial step in aligning large language models (LLMs) with human values, requiring robust generalisation to novel prompt-response pairs. In this work, we propose to frame this problem in a causal…

Artificial Intelligence · Computer Science 2026-05-12 Katarzyna Kobalczyk , Mihaela van der Schaar

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Recommender systems aim to recommend new items to users by learning user and item representations. In practice, these representations are highly entangled as they consist of information about multiple factors, including user's interests,…

Information Retrieval · Computer Science 2022-04-18 Paras Sheth , Ruocheng Guo , Lu Cheng , Huan Liu , K. Selçuk Candan

Few-Shot Event Classification (FSEC) aims at developing a model for event prediction, which can generalize to new event types with a limited number of annotated data. Existing FSEC studies have achieved high accuracy on different…

Computation and Language · Computer Science 2021-08-31 Peiyi Wang , Runxin Xu , Tianyu Liu , Damai Dai , Baobao Chang , Zhifang Sui

Decision Focused Learning has emerged as a critical paradigm for integrating machine learning with downstream optimisation. Despite its promise, existing methodologies predominantly rely on probabilistic models and focus narrowly on task…

Machine Learning · Computer Science 2025-03-21 Keivan Shariatmadar , Neil Yorke-Smith , Ahmad Osman , Fabio Cuzzolin , Hans Hallez , David Moens

Generative models, such as Variational Auto-Encoder (VAE) and Generative Adversarial Network (GAN), have been successfully applied in sequential recommendation. These methods require sampling from probability distributions and adopt…

Information Retrieval · Computer Science 2023-06-23 Hanwen Du , Huanhuan Yuan , Zhen Huang , Pengpeng Zhao , Xiaofang Zhou

State-of-the-art models often make use of superficial patterns in the data that do not generalize well to out-of-domain or adversarial settings. For example, textual entailment models often learn that particular key words imply entailment,…

Computation and Language · Computer Science 2019-09-10 Christopher Clark , Mark Yatskar , Luke Zettlemoyer