English
Related papers

Related papers: The Post Double LASSO for Efficiency Analysis

200 papers

This paper considers an empirical likelihood inference for parameters defined by general estimating equations, when data are missing at random. The efficiency of existing estimators depends critically on correctly specifying the conditional…

Methodology · Statistics 2016-12-06 Tianqing Liu , Xiaohui Yuan , Zhaohai Li , Aiyi Liu

Effective caching is crucial for the performance of modern-day computing systems. A key optimization problem arising in caching -- which item to evict to make room for a new item -- cannot be optimally solved without knowing the future.…

Machine Learning · Computer Science 2021-06-29 Jakub Chłędowski , Adam Polak , Bartosz Szabucki , Konrad Zolna

The Lasso is a popular model selection and estimation procedure for linear models that enjoys nice theoretical properties. In this paper, we study the Lasso estimator for fitting autoregressive time series models. We adopt a double…

Statistics Theory · Mathematics 2008-05-09 Yuval Nardi , Alessandro Rinaldo

Neural networks appear to have mysterious generalization properties when using parameter counting as a proxy for complexity. Indeed, neural networks often have many more parameters than there are data points, yet still provide good…

Machine Learning · Computer Science 2020-05-26 Wesley J. Maddox , Gregory Benton , Andrew Gordon Wilson

Learned indices using neural networks have been shown to outperform traditional indices such as B-trees in both query time and memory. However, learning the distribution of a large dataset can be expensive, and updating learned indices is…

Databases · Computer Science 2021-02-19 Guanli Liu , Lars Kulik , Xingjun Ma , Jianzhong Qi

The improvement of economic policymaking presents an opportunity for broad societal benefit, a notion that has inspired research towards AI-driven policymaking tools. AI policymaking holds the potential to surpass human performance through…

Artificial Intelligence · Computer Science 2024-10-14 Henry Gasztowtt , Benjamin Smith , Vincent Zhu , Qinxun Bai , Edwin Zhang

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

Methodology · Statistics 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

Machine learning algorithms can now outperform classic economic models in predicting quantities ranging from bargaining outcomes, to choice under uncertainty, to an individual's future jobs and wages. Yet this predictive accuracy comes at a…

Theoretical Economics · Economics 2025-08-27 Annie Liang

The modern era is characterised as an era of information or Big Data. This has motivated a huge literature on new methods for extracting information and insights from these data. A natural question is how these approaches differ from those…

Computation · Statistics 2020-06-09 Farzana Jahan , Insha Ullah , Kerrie L Mengersen

The dramatic growth of big datasets presents a new challenge to data storage and analysis. Data reduction, or subsampling, that extracts useful information from datasets is a crucial step in big data analysis. We propose an orthogonal…

Methodology · Statistics 2021-06-01 Lin Wang , Jake Elmstedt , Weng Kee Wong , Hongquan Xu

The large number of parameters in Pretrained Language Models enhance their performance, but also make them resource-intensive, making it challenging to deploy them on commodity hardware like a single GPU. Due to the memory and power…

Computation and Language · Computer Science 2024-01-09 Zirui Liu , Qingquan Song , Qiang Charles Xiao , Sathiya Keerthi Selvaraj , Rahul Mazumder , Aman Gupta , Xia Hu

Recent work on policy learning from observational data has highlighted the importance of efficient policy evaluation and has proposed reductions to weighted (cost-sensitive) classification. But, efficient policy evaluation need not yield…

Machine Learning · Computer Science 2020-02-13 Andrew Bennett , Nathan Kallus

This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict expected tactical descriptions of operational solutions (TDOSs). The…

Machine Learning · Computer Science 2022-06-10 Eric Larsen , Sébastien Lachapelle , Yoshua Bengio , Emma Frejinger , Simon Lacoste-Julien , Andrea Lodi

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

Statistics Theory · Mathematics 2019-08-09 Junlong Zhao , Chenlei Leng

Large language models have achieved remarkable capabilities, but their practical deployment is hindered by significant computational costs. While adaptive computation methods like early-exiting promise to reduce these costs, they introduce…

Computation and Language · Computer Science 2025-12-16 Sangmin Bae

Recent advances in large language models (LLMs) have greatly improved their reasoning and decision-making abilities when deployed as agents. Richer reasoning, however, often comes at the cost of longer chain of thought (CoT), hampering…

Computation and Language · Computer Science 2025-11-20 Sirui Chen , Mengshi Zhao , Lei Xu , Yuying Zhao , Beier Zhu , Hanwang Zhang , Shengjie Zhao , Chaochao Lu

Data valuation is a ML field that studies the value of training instances towards a given predictive task. Although data bias is one of the main sources of downstream model unfairness, previous work in data valuation does not consider how…

Machine Learning · Computer Science 2023-03-31 José Pombal , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Predicting the performance of students early and as accurately as possible is one of the biggest challenges of educational institutions. Analyzing the performance of students early can help in finding the strengths and weakness of students…

Computers and Society · Computer Science 2021-12-03 Aaditya Bhusal

We study the problem of estimating locations in time at which the level of technology in an economy changes when given a sequence of time ordered inputs and outputs. We approach the problem through the lens of nonparametric frontier…

Methodology · Statistics 2026-04-29 Shakeel Gavioli-Akilagun , Yining Chen , Flavio Ziegelmann

We apply network Lasso to semi-supervised regression problems involving network structured data. This approach lends quite naturally to highly scalable learning algorithms in the form of message passing over an empirical graph which…

Machine Learning · Statistics 2018-12-31 A. Jung , N. Vesselinova