English
Related papers

Related papers: Temporal Smoothness Doubly Robust Learning for Deb…

200 papers

Knowledge tracing (KT), aiming to mine students' mastery of knowledge by their exercise records and predict their performance on future test questions, is a critical task in educational assessment. While researchers achieved tremendous…

Artificial Intelligence · Computer Science 2024-05-28 Haoxuan Li , Jifan Yu , Yuanxin Ouyang , Zhuang Liu , Wenge Rong , Juanzi Li , Zhang Xiong

One of the fundamental challenges associated with reinforcement learning (RL) is that collecting sufficient data can be both time-consuming and expensive. In this paper, we formalize a concept of time reversal symmetry in a Markov decision…

Machine Learning · Computer Science 2023-11-29 Brett Barkley , Amy Zhang , David Fridovich-Keil

Click-Through Rate (CTR) prediction is a pivotal task in product and content recommendation, where learning effective feature embeddings is of great significance. However, traditional methods typically learn fixed feature representations…

Information Retrieval · Computer Science 2023-09-06 Chen Zhu , Liang Du , Hong Chen , Shuang Zhao , Zixun Sun , Xin Wang , Wenwu Zhu

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

Off-policy learning allows us to learn about possible policies of behavior from experience generated by a different behavior policy. Temporal difference (TD) learning algorithms can become unstable when combined with function approximation…

Machine Learning · Computer Science 2021-06-23 Ray Jiang , Tom Zahavy , Zhongwen Xu , Adam White , Matteo Hessel , Charles Blundell , Hado van Hasselt

Knowledge tracing is a technique that predicts students' future performance by analyzing their learning process through historical interactions with intelligent educational platforms, enabling a precise evaluation of their knowledge…

Machine Learning · Computer Science 2024-09-12 Zhiyu Chen , Wei Ji , Jing Xiao , Zitao Liu

Doubly robust estimators with cross-fitting have gained popularity in causal inference due to their favorable structure-agnostic error guarantees. However, when additional structure, such as H\"{o}lder smoothness, is available then more…

Statistics Theory · Mathematics 2025-05-08 Alec McClean , Sivaraman Balakrishnan , Edward H. Kennedy , Larry Wasserman

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

Recommender Systems (RS) have significantly advanced online content filtering and personalized decision-making. However, emerging vulnerabilities in RS have catalyzed a paradigm shift towards Trustworthy RS (TRS). Despite substantial…

Information Retrieval · Computer Science 2025-02-19 Jin Li , Shoujin Wang , Qi Zhang , Longbing Cao , Fang Chen , Xiuzhen Zhang , Dietmar Jannach , Charu C. Aggarwal

Motivated by practical applications where stable long-term performance is critical-such as robotics, operations research, and healthcare-we study the problem of distributionally robust (DR) average-reward reinforcement learning. We propose…

Machine Learning · Computer Science 2026-02-03 Zijun Chen , Shengbo Wang , Nian Si

Datasets can be biased due to societal inequities, human biases, under-representation of minorities, etc. Our goal is to certify that models produced by a learning algorithm are pointwise-robust to potential dataset biases. This is a…

Machine Learning · Computer Science 2021-10-12 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

Knowledge Tracing (KT) is a core component of Intelligent Tutoring Systems, modeling learners' knowledge state to predict future performance and provide personalized learning support. Traditional KT models assume that learners' learning…

Machine Learning · Computer Science 2025-05-27 Yiyun Zhou , Zheqi Lv , Shengyu Zhang , Jingyuan Chen

Knowledge tracing (KT) refers to the problem of predicting future learner performance given their past performance in educational applications. Recent developments in KT using flexible deep neural network-based models excel at this task.…

Machine Learning · Computer Science 2020-07-27 Aritra Ghosh , Neil Heffernan , Andrew S. Lan

Continuously acquiring new knowledge from a dynamic environment is a fundamental capability for animals, facilitating their survival and ability to address various challenges. This capability is referred to as continual learning, which…

Machine Learning · Computer Science 2025-01-14 RunQing Wu , KaiHui Huang , HanYi Zhang , QiHe Liu , GuoJin Yu , JingSong Deng , Fei Ye

We investigate the finite-time convergence properties of Temporal Difference (TD) learning with linear function approximation, a cornerstone algorithm in the field of reinforcement learning. We are interested in the so-called ``robust''…

Machine Learning · Computer Science 2025-09-26 Wei-Cheng Lee , Francesco Orabona

Deep Learning models have shown remarkable performance in a broad range of vision tasks. However, they are often vulnerable against domain shifts at test-time. Test-time training (TTT) methods have been developed in an attempt to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Gustavo A. Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ismail Ben Ayed , Christian Desrosiers

Missing data and confounding are two problems researchers face in observational studies for comparative effectiveness. Williamson et al. (2012) recently proposed a unified approach to handle both issues concurrently using a multiply-robust…

Methodology · Statistics 2020-07-22 Katherine Evans , Isabel Fulcher , Eric J. Tchetgen Tchetgen

Robust stability and stochastic stability have separately seen intense study in control theory for many decades. In this work we establish relations between these properties for discrete-time systems and employ them for robust control…

Dynamical Systems · Mathematics 2020-04-20 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

Robust learning methods aim to learn a clean target distribution from noisy and corrupted training data where a specific corruption pattern is often assumed a priori. Our proposed method can not only successfully learn the clean target…

Machine Learning · Computer Science 2023-02-08 Jeongeun Park , Seungyoun Shin , Sangheum Hwang , Sungjoon Choi

Model-based reinforcement learning (MBRL) has gained much attention for its ability to learn complex behaviors in a sample-efficient way: planning actions by generating imaginary trajectories with predicted rewards. Despite its success, we…

Machine Learning · Computer Science 2024-02-20 Vint Lee , Pieter Abbeel , Youngwoon Lee