English
Related papers

Related papers: Entire Space Counterfactual Learning for Reliable …

200 papers

We theoretically analyze and compare the following five popular multiclass classification methods: One vs. All, All Pairs, Tree-based classifiers, Error Correcting Output Codes (ECOC) with randomly generated code matrices, and Multiclass…

Machine Learning · Computer Science 2013-02-19 Amit Daniely , Sivan Sabato , Shai Shalev Shwartz

Model-based reinforcement learning (RL) methods are appealing in the offline setting because they allow an agent to reason about the consequences of actions without interacting with the environment. Prior methods learn a 1-step dynamics…

Machine Learning · Computer Science 2022-11-07 Bogdan Mazoure , Benjamin Eysenbach , Ofir Nachum , Jonathan Tompson

Reinforcement Learning from Verifiable Rewards (RLVR) suffers from exploration inefficiency, where models struggle to generate successful rollouts, resulting in minimal learning signal. This challenge is particularly severe for tasks that…

Machine Learning · Computer Science 2026-03-20 Saaket Agashe , Jayanth Srinivasa , Gaowen Liu , Ramana Kompella , Xin Eric Wang

Recommender Systems (RSs) are exploited by various business enterprises to suggest their products (items) to consumers (users). Collaborative filtering (CF) is a widely used variant of RSs which learns hidden patterns from user-item…

Information Retrieval · Computer Science 2026-03-17 Nikita Baidya , Bidyut Kr. Patra , Ratnakar Dash

Deep learning techniques have been applied widely in industrial recommendation systems. However, far less attention has been paid to the overfitting problem of models in recommendation systems, which, on the contrary, is recognized as a…

Information Retrieval · Computer Science 2022-09-14 Zhao-Yu Zhang , Xiang-Rong Sheng , Yujing Zhang , Biye Jiang , Shuguang Han , Hongbo Deng , Bo Zheng

With the rapid growth of video data, Composed Video Retrieval (CVR) has emerged as a novel paradigm in video retrieval and is receiving increasing attention from researchers. Unlike unimodal video retrieval methods, the CVR task takes a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Zixu Li , Yupeng Hu , Zhiwei Chen , Qinlei Huang , Guozhi Qiu , Zhiheng Fu , Meng Liu

In coming up with solutions to real-world problems, humans implicitly adhere to constraints that are too numerous and complex to be specified completely. However, reinforcement learning (RL) agents need these constraints to learn the…

Machine Learning · Computer Science 2024-06-25 Sriram Ganapathi Subramanian , Guiliang Liu , Mohammed Elmahgiubi , Kasra Rezaee , Pascal Poupart

Conditional value-at-risk (CVaR) is a prominent risk measure in financial engineering, energy systems, and supply chain management. In these domains, Markov decision processes (MDPs) with a long-run CVaR criterion effectively mitigate cost…

Optimization and Control · Mathematics 2026-03-11 Qixin Wang , Hao Cao , Jian-Qiang Hu , Mingjie Hu , Li Xia

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

Traditionally, Recommender Systems (RS) have primarily measured performance based on the accuracy and relevance of their recommendations. However, this algorithmic-centric approach overlooks how different types of recommendations impact…

Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and…

Machine Learning · Computer Science 2022-08-17 Yang Yue , Bingyi Kang , Zhongwen Xu , Gao Huang , Shuicheng Yan

Computation of confidence sets is central to data science and machine learning, serving as the workhorse of A/B testing and underpinning the operation and analysis of reinforcement learning algorithms. Among all valid confidence sets for…

Machine Learning · Statistics 2026-01-27 Heguang Lin , Binhao Chen , Mengze Li , Daniel Pimentel-Alarcón , Matthew L. Malloy

Click-Through Rate (CTR) prediction on cold users is a challenging task in recommender systems. Recent researches have resorted to meta-learning to tackle the cold-user challenge, which either perform few-shot user representation learning…

Information Retrieval · Computer Science 2022-10-31 Yanyan Shen , Lifan Zhao , Weiyu Cheng , Zibin Zhang , Wenwen Zhou , Kangyi Lin

Reinforcement learning (RL) algorithms usually require a substantial amount of interaction data and perform well only for specific tasks in a fixed environment. In some scenarios such as healthcare, however, usually only few records are…

Machine Learning · Computer Science 2020-12-17 Chaochao Lu , Biwei Huang , Ke Wang , José Miguel Hernández-Lobato , Kun Zhang , Bernhard Schölkopf

The field of generating recommendations within the framework of causal inference has seen a recent surge, with recommendations being likened to treatments. This approach enhances insights into the influence of recommendations on user…

Information Retrieval · Computer Science 2023-08-21 Guanglin Zhou , Chengkai Huang , Xiaocong Chen , Xiwei Xu , Chen Wang , Liming Zhu , Lina Yao

Recently, click-through rate (CTR) prediction models have evolved from shallow methods to deep neural networks. Most deep CTR models follow an Embedding\&MLP paradigm, that is, first mapping discrete id features, e.g. user visited items,…

Machine Learning · Statistics 2019-06-26 Guorui Zhou , Kailun Wu , Weijie Bian , Zhao Yang , Xiaoqiang Zhu , Kun Gai

Click-through rate (CTR) prediction is a critical problem in web search, recommendation systems and online advertisement displaying. Learning good feature interactions is essential to reflect user's preferences to items. Many CTR prediction…

Information Retrieval · Computer Science 2021-05-13 Yuan Cheng , Yanbo Xue

Concept bottleneck models (CBMs) have emerged as critical tools in domains where interpretability is paramount. These models rely on predefined textual descriptions, referred to as concepts, to inform their decision-making process and offer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Maor Dikter , Tsachi Blau , Chaim Baskin

Click data collected by modern recommendation systems are an important source of observational data that can be utilized to train learning-to-rank (LTR) systems. However, these data suffer from a number of biases that can result in poor…

Information Retrieval · Computer Science 2020-05-13 Zohreh Ovaisi , Ragib Ahsan , Yifan Zhang , Kathryn Vasilaky , Elena Zheleva

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo