English
Related papers

Related papers: Large-scale reverse engineering by the Lasso

200 papers

The construction of coherent prediction models holds great importance in medical research as such models enable health researchers to gain deeper insights into disease epidemiology and clinicians to identify patients at higher risk of…

Applications · Statistics 2024-01-17 Guanbo Wang , Sylvie Perreault , Robert W. Platt , Rui Wang , Marc Dorais , Mireille E. Schnitzer

This paper studies high-dimensional regression models with lasso when data is sampled under multi-way clustering. First, we establish convergence rates for the lasso and post-lasso estimators. Second, we propose a novel inference method…

Econometrics · Economics 2019-08-22 Harold D. Chiang , Yuya Sasaki

Inference for high-dimensional logistic regression models using penalized methods has been a challenging research problem. As an illustration, a major difficulty is the significant bias of the Lasso estimator, which limits its direct…

Methodology · Statistics 2024-10-29 Yuming Zhang , Stéphane Guerrier , Runze Li

We propose a pivotal method for estimating high-dimensional sparse linear regression models, where the overall number of regressors $p$ is large, possibly much larger than $n$, but only $s$ regressors are significant. The method is a…

Methodology · Statistics 2015-03-17 Alexandre Belloni , Victor Chernozhukov , Lie Wang

We present a novel classification-based method for learning to predict gene regulatory response. Our approach is motivated by the hypothesis that in simple organisms such as Saccharomyces cerevisiae, we can learn a decision rule for…

Quantitative Methods · Quantitative Biology 2007-05-23 Manuel Middendorf , Anshul Kundaje , Chris Wiggins , Yoav Freund , Christina Leslie

Modeling and drawing inference on the joint associations between single nucleotide polymorphisms and a disease has sparked interest in genome-wide associations studies. In the motivating Boston Lung Cancer Survival Cohort (BLCSC) data, the…

Methodology · Statistics 2021-11-18 Lu Xia , Bin Nan , Yi Li

Molecular profiling data (e.g., gene expression) has been used for clinical risk prediction and biomarker discovery. However, it is necessary to integrate other prior knowledge like biological pathways or gene interaction networks to…

Genomics · Quantitative Biology 2016-09-22 Wenwen Min , Juan Liu , Shihua Zhang

Reconciling gene trees with a species tree is a fundamental problem to understand the evolution of gene families. Many existing approaches reconcile each gene tree independently. However, it is well-known that the evolution of gene families…

Populations and Evolution · Quantitative Biology 2018-06-12 Riccardo Dondi , Manuel Lafond , Celine Scornavacca

Large Language Models (LLMs) are typically trained to predict in the forward direction of time. However, recent works have shown that prompting these models to look back and critique their own generations can produce useful feedback.…

Computation and Language · Computer Science 2025-02-04 Yerram Varun , Rahul Madhavan , Sravanti Addepalli , Arun Suggala , Karthikeyan Shanmugam , Prateek Jain

Reverse engineering of FPGA designs from bitstreams to RTL models aids in understanding the high level functionality of the design and for validating and reconstructing legacy designs. Fast carry-chains are commonly used in synthesis of…

In this work, we consider learning sparse models in large scale settings, where the number of samples and the feature dimension can grow as large as millions or billions. Two immediate issues occur under such challenging scenario: (i)…

Machine Learning · Statistics 2023-01-31 Atul Dhingra , Jie Shen , Nicholas Kleene

Can we leverage LLMs to model the process of discovering novel language model (LM) architectures? Inspired by real research, we propose a multi-agent LLM approach that simulates the conventional stages of research, from ideation and…

Artificial Intelligence · Computer Science 2025-06-26 Junyan Cheng , Peter Clark , Kyle Richardson

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

Methodology · Statistics 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman

Many applications in data analysis rely on the decomposition of a data matrix into a low-rank and a sparse component. Existing methods that tackle this task use the nuclear norm and L1-cost functions as convex relaxations of the rank…

Machine Learning · Statistics 2013-01-18 Clemens Hage , Martin Kleinsteuber

Sensing is the process of deriving signals from the environment that allows artificial systems to interact with the physical world. The Shannon theorem specifies the maximum rate at which information can be acquired. However, this upper…

Neural and Evolutionary Computing · Computer Science 2018-02-16 Anh Tuan Nguyen , Jian Xu , Zhi Yang

In genomic studies, identifying biomarkers associated with a variable of interest is a major concern in biomedical research. Regularized approaches are classically used to perform variable selection in high-dimensional linear models.…

Methodology · Statistics 2020-07-22 Wencan Zhu , Céline Lévy-Leduc , Nils Ternès

While Large Language Models (LLMs) demonstrate increasingly sophisticated affective capabilities, the internal mechanisms by which they process complex emotions remain unclear. Existing interpretability approaches often treat models as…

Computation and Language · Computer Science 2026-04-23 Yitong Shou , Manhao Guan

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

RNA design, the task of finding a sequence that folds into a target secondary structure, has broad biological and biomedical impact but remains computationally challenging due to the exponentially large sequence space and exponentially many…

Machine Learning · Computer Science 2026-02-16 Milan Gautam , Ning Dai , Tianshuo Zhou , Bowen Xie , David Mathews , Liang Huang

We propose a new estimator, the thresholded scaled Lasso, in high dimensional threshold regressions. First, we establish an upper bound on the $\ell_\infty$ estimation error of the scaled Lasso estimator of Lee et al. (2012). This is a…

Methodology · Statistics 2015-02-11 Laurent Callot , Mehmet Caner , Anders Bredahl Kock , Juan Andres Riquelme