English
Related papers

Related papers: Machine Learning Debiasing with Conditional Moment…

200 papers

This paper addresses aircraft delays, emphasizing their impact on safety and financial losses. To mitigate these issues, an innovative machine learning (ML)-enhanced landing scheduling methodology is proposed, aiming to improve automation…

Artificial Intelligence · Computer Science 2023-11-28 Yutian Pang , Peng Zhao , Jueming Hu , Yongming Liu

Causal models provide rich descriptions of complex systems as sets of mechanisms by which each variable is influenced by its direct causes. They support reasoning about manipulating parts of the system and thus hold promise for addressing…

Machine Learning · Computer Science 2024-06-21 Julius von Kügelgen

Reward models (RMs) play a central role in aligning large language models (LLMs) with human preferences. However, RMs are often sensitive to spurious features such as response length. Existing inference-time approaches for mitigating these…

Computation and Language · Computer Science 2026-05-01 Kazutoshi Shinoda , Kosuke Nishida , Kyosuke Nishida

A variety of interesting parameters may depend on high dimensional regressions. Machine learning can be used to estimate such parameters. However estimators based on machine learners can be severely biased by regularization and/or model…

Statistics Theory · Mathematics 2024-03-18 Victor Chernozhukov , Whitney K. Newey , Victor Quintas-Martinez , Vasilis Syrgkanis

Machine learning (ML) is transforming healthcare, but safe clinical decisions demand reliable uncertainty estimates that standard ML models fail to provide. Conformal prediction (CP) is a popular tool that allows users to turn heuristic…

Machine Learning · Computer Science 2025-12-18 Klaus-Rudolf Kladny , Bernhard Schölkopf , Lisa Koch , Christian F. Baumgartner , Michael Muehlebach

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

When adapting an encoder to a new domain, the standard approach is to continue training with Masked Language Modeling (MLM). We show that temporarily switching to Causal Language Modeling (CLM) followed by a short MLM decay improves…

Computation and Language · Computer Science 2026-05-13 Rian Touchent , Eric de la Clergerie

Multiple studies have now demonstrated that machine learning (ML) can give improved skill for predicting or simulating fairly typical weather events, for tasks such as short-term and seasonal weather forecasting, downscaling simulations to…

Atmospheric and Oceanic Physics · Physics 2023-08-30 Peter AG Watson

In the global economy, credit companies play a central role in economic development, through their activity as money lenders. This important task comes with some drawbacks, mainly the risk of the debtors not being able to repay the provided…

Machine Learning · Computer Science 2021-01-01 Giorgio Visani , Federico Chesani , Enrico Bagli , Davide Capuzzo , Alessandro Poluzzi

Latent Class Models (LCMs) are used to cluster multivariate categorical data (e.g. group participants based on survey responses). Traditional LCMs assume a property called conditional independence. This assumption can be restrictive,…

Machine Learning · Statistics 2024-06-19 Jesse Bowers , Steve Culpepper

Machine learning (ML) estimates of conditional average treatment effects (CATE) can guide policy decisions, either by allowing targeting of individuals with beneficial CATE estimates, or as inputs to decision trees that optimise overall…

Econometrics · Economics 2023-10-04 Julia Hatamyar , Noemi Kreif

Locally Robust (LR)/Orthogonal/Debiased moments have proven useful with machine learning first steps, but their existence has not been investigated for general parameters. In this paper, we provide a necessary and sufficient condition,…

Econometrics · Economics 2023-06-21 Facundo Argañaraz , Juan Carlos Escanciano

Longitudinal targeted maximum likelihood estimation (LTMLE) has very rarely been used to estimate dynamic treatment effects in the context of time-dependent confounding affected by prior treatment when faced with long follow-up times,…

Accurate uncertainty quantification is crucial for the safe deployment of machine learning models, and prior research has demonstrated improvements in the calibration of modern language models (LMs). We study in-context learning (ICL), a…

Computation and Language · Computer Science 2024-03-29 Hanlin Zhang , Yi-Fan Zhang , Yaodong Yu , Dhruv Madeka , Dean Foster , Eric Xing , Himabindu Lakkaraju , Sham Kakade

In a world where Machine Learning (ML) is increasingly deployed to support decision-making in critical domains, providing decision-makers with explainable, stable, and relevant inputs becomes fundamental. Understanding how machine learning…

Machine Learning · Computer Science 2024-08-07 Karol Capała , Paulina Tworek , Jose Sousa

Confounding bias is a key challenge in causal effect estimation from observational data. Double Machine Learning (DML) addresses this issue by estimating treatment and outcome nuisance functions, constructing treatment and outcome…

Machine Learning · Computer Science 2026-05-26 Guodu Xiang , Kui Yu , Yujie Wang , Richang Hong , Fuyuan Cao , Jiye Liang

Conventional representation learning methods learn a universal representation that primarily captures dominant semantics, which may not always align with customized downstream tasks. For instance, in animal habitat analysis, researchers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Honglin Liu , Chao Sun , Peng Hu , Yunfan Li , Xi Peng

Recently, large language models (LLMs) have advanced recommendation systems (RSs), and recent works have begun to explore how to integrate LLMs into industrial RSs. While most approaches deploy LLMs offline to generate and pre-cache…

Information Retrieval · Computer Science 2026-04-22 Yunjia Xi , Menghui Zhu , Jianghao Lin , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

In-context learning (ICL) has emerged as a particularly remarkable characteristic of Large Language Models (LLM): given a pretrained LLM and an observed dataset, LLMs can make predictions for new data points from the same distribution…

Machine Learning · Statistics 2024-06-04 Fabian Falck , Ziyu Wang , Chris Holmes

Solving Constraint Optimization Problems (COPs) can be dramatically simplified by boundary estimation, that is, providing tight boundaries of cost functions. By feeding a supervised Machine Learning (ML) model with data composed of known…

Artificial Intelligence · Computer Science 2021-11-08 Helge Spieker , Arnaud Gotlieb