English
Related papers

Related papers: Causal Representation Learning for Generalisable R…

200 papers

The Click-Through Rate (CTR) prediction task is critical in industrial recommender systems, where models are usually deployed on dynamic streaming data in practical applications. Such streaming data in real-world recommender systems face…

Information Retrieval · Computer Science 2023-07-17 Qi-Wei Wang , Hongyu Lu , Yu Chen , Da-Wei Zhou , De-Chuan Zhan , Ming Chen , Han-Jia Ye

In this paper, a novel framework is proposed to optimize the downlink multi-user communication of a millimeter wave base station, which is assisted by a reconfigurable intelligent reflector (IR). In particular, a channel estimation approach…

Information Theory · Computer Science 2021-08-03 Qianqian Zhang , Walid Saad , Mehdi Bennis

The era of big data has witnessed an increasing availability of observational data from mobile and social networking, online advertising, web mining, healthcare, education, public policy, marketing campaigns, and so on, which facilitates…

Machine Learning · Computer Science 2023-03-06 Zhixuan Chu , Ruopeng Li , Stephen Rathbun , Sheng Li

Continual learning is increasingly sought after in real world machine learning applications, as it enables learning in a more human-like manner. Conventional machine learning approaches fail to achieve this, as incrementally updating the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Joe Khawand , Peter Hanappe , David Colliaux

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Distributional reinforcement learning (DRL) extends the value-based approach by approximating the full distribution over future returns instead of the mean only, providing a richer signal that leads to improved performances. Quantile…

Machine Learning · Statistics 2022-02-23 Alix Lhéritier , Nicolas Bondoux

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

Representation learning approaches require a massive amount of discriminative training data, which is unavailable in many scenarios, such as healthcare, smart city, education, etc. In practice, people refer to crowdsourcing to get annotated…

Machine Learning · Computer Science 2021-12-17 Yang Hao , Wenbiao Ding , Zitao Liu

Representation learning constructs low-dimensional representations to summarize essential features of high-dimensional data. This learning problem is often approached by describing various desiderata associated with learned representations;…

Machine Learning · Statistics 2022-02-14 Yixin Wang , Michael I. Jordan

When applying offline reinforcement learning (RL) in healthcare scenarios, the out-of-distribution (OOD) issues pose significant risks, as inappropriate generalization beyond clinical expertise can result in potentially harmful…

Machine Learning · Computer Science 2025-05-23 Runze Yan , Xun Shen , Akifumi Wachi , Sebastien Gros , Anni Zhao , Xiao Hu

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard…

Optimization and Control · Mathematics 2024-03-26 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

In strategic classification, an institution (e.g., a bank) anticipates adaptation from users who change their features to increase utility in a classification task (e.g., loan repayment). Since a key challenge is the distribution shift…

Machine Learning · Computer Science 2026-05-27 Antonio Gois , Sophia Gunluk , Nir Rosenfeld , Nidhi Hegde , Simon Lacoste-Julien , Dhanya Sridhar

Despite the broad application of deep reinforcement learning (RL), transferring and adapting the policy to unseen but similar environments is still a significant challenge. Recently, the language-conditioned policy is proposed to facilitate…

Machine Learning · Computer Science 2023-03-10 Shaohui Peng , Xing Hu , Rui Zhang , Jiaming Guo , Qi Yi , Ruizhi Chen , Zidong Du , Ling Li , Qi Guo , Yunji Chen

One of the pursued objectives of deep learning is to provide tools that learn abstract representations of reality from the observation of multiple contextual situations. More precisely, one wishes to extract disentangled representations…

Machine Learning · Computer Science 2023-10-24 Pierre Colombo , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Traditional recommendation models trained on observational interaction data have generated large impacts in a wide range of applications, it faces bias problems that cover users' true intent and thus deteriorate the recommendation…

Information Retrieval · Computer Science 2022-02-08 Xiangmeng Wang , Qian Li , Dianer Yu , Peng Cui , Zhichao Wang , Guandong Xu

Reinforcement learning (RL) is a powerful technique for training intelligent agents, but understanding why these agents make specific decisions can be quite challenging. This lack of transparency in RL models has been a long-standing…

Machine Learning · Computer Science 2024-04-02 Wenhao Lu , Xufeng Zhao , Thilo Fryen , Jae Hee Lee , Mengdi Li , Sven Magg , Stefan Wermter

A wide variety of methods have been developed to enable lifelong learning in conventional deep neural networks. However, to succeed, these methods require a `batch' of samples to be available and visited multiple times during training.…

Machine Learning · Computer Science 2021-10-22 Soumya Banerjee , Vinay Kumar Verma , Toufiq Parag , Maneesh Singh , Vinay P. Namboodiri

Designing effective task sequences is crucial for curriculum reinforcement learning (CRL), where agents must gradually acquire skills by training on intermediate tasks. A key challenge in CRL is to identify tasks that promote exploration,…

Machine Learning · Computer Science 2025-07-08 Geonwoo Cho , Jaegyun Im , Doyoon Kim , Sundong Kim

Sequential Resource Allocation with situational constraints presents a significant challenge in real-world applications, where resource demands and priorities are context-dependent. This paper introduces a novel framework, SCRL, to address…

Artificial Intelligence · Computer Science 2025-06-18 Libo Zhang , Yang Chen , Toru Takisaka , Kaiqi Zhao , Weidong Li , Jiamou Liu