English
Related papers

Related papers: Dealing with Logs and Zeros in Regression Models

200 papers

Artificial intelligence operations (AIOps) play a pivotal role in identifying, mitigating, and analyzing anomalous system behaviors and alerts. However, the research landscape in this field remains limited, leaving significant gaps…

Machine Learning · Computer Science 2023-12-13 Daksh Dave , Gauransh Sawhney , Dhruv Khut , Sahil Nawale , Pushkar Aggrawal , Prasenjit Bhavathankar

The log odds ratio is a well-established metric for evaluating the association between binary outcome and exposure variables. Despite its widespread use, there has been limited discussion on how to summarize the log odds ratio as a function…

Methodology · Statistics 2023-04-04 Sung Jae Jun , Sokbae Lee

We demonstrate that regression models can be estimated by working independently in a row-wise fashion. We document a simple procedure which allows for a wide class of econometric estimators to be implemented cumulatively, where, in the…

Econometrics · Economics 2023-11-28 Damian Clarke , Nicolás Paris , Benjamín Villena-Roldán

In this paper, we conduct a comprehensive study of In-Context Learning (ICL) by addressing several open questions: (a) What type of ICL estimator is learned by large language models? (b) What is a proper performance metric for ICL and what…

Machine Learning · Statistics 2023-10-11 Yufeng Zhang , Fengzhuo Zhang , Zhuoran Yang , Zhaoran Wang

The autocovariance least squares (ALS) method is a computationally efficient approach for estimating noise covariances in Kalman filters without requiring specific noise models. However, conventional ALS and its variants rely on the classic…

Optimization and Control · Mathematics 2026-03-10 Jiahong Li , Fang Deng

Researchers now routinely use AI or other machine learning methods to estimate latent variables of economic interest, then plug-in the estimates as covariates in a regression. We show both theoretically and empirically that naively treating…

Econometrics · Economics 2025-05-01 Laura Battaglia , Timothy Christensen , Stephen Hansen , Szymon Sacher

Detecting outliers or anomalies is a common data analysis task. As a sub-field of unsupervised machine learning, a large variety of approaches exist, but the vast majority treats the input features as independent and often fails to…

Machine Learning · Computer Science 2021-02-05 Jörn Hees , Dayananda Herurkar , Mario Meier

We propose a novel regression adjustment method designed for estimating distributional treatment effect parameters in randomized experiments. Randomized experiments have been extensively used to estimate treatment effects in various…

Econometrics · Economics 2024-07-24 Undral Byambadalai , Tatsushi Oka , Shota Yasui

A large empirical literature regresses outcomes on empirical Bayes shrinkage estimates of value-added, yet little is known about whether this approach leads to unbiased estimates and valid inference for the downstream regression…

Econometrics · Economics 2025-12-11 Tian Xie

Many applications of generalised linear models (GLMs) can be improved by applying constraints that impose assumptions on the associations or improve consistency of the estimators. Yet, there are still barriers to the implementation and…

Methodology · Statistics 2026-02-19 Pierre Masselot , Devon Nenon , Jacopo Vanoli , Zaid Chalabi , Antonio Gasparrini

Ordinary least squares (OLS) estimators are widely used in network experiments to estimate spillover effects. We study the causal interpretation of, and inference for the OLS estimator under both design-based uncertainty from random…

Econometrics · Economics 2025-09-09 Kensuke Sakamoto , Yuya Shimizu

Corrupted data sets containing noisy or missing observations are prevalent in various contemporary applications such as economics, finance and bioinformatics. Despite the recent methodological and algorithmic advances in high-dimensional…

Methodology · Statistics 2020-05-12 J. Wu , Z. Zheng , Y. Li , Y. Zhang

We consider the problem of recovering an expert's reward function with inverse reinforcement learning (IRL) when there are missing/incomplete state-action pairs or observations in the demonstrated trajectories. This issue of missing…

Machine Learning · Computer Science 2019-11-19 Tien Mai , Quoc Phong Nguyen , Kian Hsiang Low , Patrick Jaillet

This paper aims to reevaluate the Taylor Rule, through a linear and a nonlinear method, such that its estimated federal funds rates match those actually previously implemented by the Federal Reserve Bank. In the linear method, this paper…

General Economics · Economics 2023-02-17 Alper Deniz Karakas

We propose an online debiased lasso (ODL) method for statistical inference in high-dimensional linear models with streaming data. The proposed ODL consists of an efficient computational algorithm for streaming data and approximately normal…

Statistics Theory · Mathematics 2021-08-20 Ruijian Han , Lan Luo , Yuanyuan Lin , Jian Huang

A new generalized multilinear regression model, termed the Higher-Order Partial Least Squares (HOPLS), is introduced with the aim to predict a tensor (multiway array) $\tensor{Y}$ from a tensor $\tensor{X}$ through projecting the data onto…

Artificial Intelligence · Computer Science 2014-01-27 Qibin Zhao , Cesar F. Caiafa , Danilo P. Mandic , Zenas C. Chao , Yasuo Nagasaka , Naotaka Fujii , Liqing Zhang , Andrzej Cichocki

Log anomaly detection is crucial for preserving the security of operating systems. Depending on the source of log data collection, various information is recorded in logs that can be considered log modalities. In light of this intuition,…

Machine Learning · Computer Science 2026-01-01 Mohammad Nasirzadeh , Jafar Tahmoresnezhad , Parviz Rashidi-Khazaee

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

Machine Learning · Computer Science 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

Counting inversions is a classic and important problem in databases. The number of inversions, $K^*$, in a list $L=(L(1),L(2),\ldots,L(n))$ is defined as the number of pairs $i < j$ with $L(i) > L(j)$. In this paper, new results for this…

Data Structures and Algorithms · Computer Science 2016-12-28 Saladi Rahul

We often seek to estimate the causal effect of an exposure on a particular outcome in both randomized and observational settings. One such estimation method is the covariate-adjusted residuals estimator, which was designed for individually…

Methodology · Statistics 2019-10-28 Stephen A. Lauer , Nicholas G. Reich , Laura B. Balzer