English
Related papers

Related papers: Sparse Attention Regression Network Based Soil Fer…

200 papers

A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future…

Machine Learning · Statistics 2020-07-27 Julien Brajard , Alberto Carassi , Marc Bocquet , Laurent Bertino

The LASSO-Patternsearch algorithm is proposed to efficiently identify patterns of multiple dichotomous risk factors for outcomes of interest in demographic and genomic studies. The patterns considered are those that arise naturally from the…

Statistics Theory · Mathematics 2008-03-07 Weiliang Shi , Grace Wahba , Stephen Wright , Kristine Lee , Ronald Klein , Barbara Klein

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

Categorical predictors are omnipresent in everyday regression practice: in fact, most regression data involve some categorical predictors, and this tendency is increasing in modern applications with more complex structures and larger data…

Methodology · Statistics 2025-11-11 Chaegeun Song , Zhong Zheng , Bing Li , Lingzhou Xue

Agriculture is increasingly challenged by climate change, soil degradation, and resource depletion, and hence requires advanced data-driven crop classification and recommendation solutions. This work presents an explainable ensemble…

Pre-trained machine learning (ML) predictions have been increasingly used to complement incomplete data to enable downstream scientific inquiries, but their naive integration risks biased inferences. Recently, multiple methods have been…

Methodology · Statistics 2025-11-12 Xingran Chen , Tyler McCormick , Bhramar Mukherjee , Zhenke Wu

Propensity score matching is a common tool for adjusting for observed confounding in observational studies, but is known to have limitations in the presence of unmeasured confounding. In many settings, researchers are confronted with…

Methodology · Statistics 2017-12-08 Georgia Papadogeorgou , Christine Choirat , Corwin Zigler

The demand for lightweight models in image classification tasks under resource-constrained environments necessitates a balance between computational efficiency and robust feature representation. Traditional attention mechanisms, despite…

Machine Learning · Computer Science 2025-04-21 Zhenkai Qin , Feng Zhu , Huan Zeng , Xunyi Nong

Epigenetic aging clocks play a pivotal role in estimating an individual's biological age through the examination of DNA methylation patterns at numerous CpG (Cytosine-phosphate-Guanine) sites within their genome. However, making valid…

Machine Learning · Statistics 2026-01-21 Zhe Fei , Yi Li

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is done by solving an l_1-regularized linear regression problem, usually called Lasso. In this work we first combine the…

Information Theory · Computer Science 2010-03-02 Pablo Sprechmann , Ignacio Ramirez , Guillermo Sapiro , Yonina C. Eldar

Neural networks can be significantly compressed by pruning, yielding sparse models with reduced storage and computational demands while preserving predictive performance. Model soups (Wortsman et al., 2022) enhance generalization and…

Machine Learning · Computer Science 2024-03-26 Max Zimmer , Christoph Spiegel , Sebastian Pokutta

Large Language Models (LLMs) offer strong capabilities but incur high inference costs due to dense computation and memory access. Training-free activation sparsity is a promising approach for efficient LLM inference, yet existing methods…

Machine Learning · Computer Science 2026-02-17 Lei Chen , Yuan Meng , Xiaoyu Zhan , Zhi Wang , Wenwu Zhu

By treating intervals as inseparable sets, this paper proposes sparse machine learning regressions for high-dimensional interval-valued time series. With LASSO or adaptive LASSO techniques, we develop a penalized minimum distance…

Econometrics · Economics 2024-11-15 Haowen Bao , Yongmiao Hong , Yuying Sun , Shouyang Wang

Labeled datasets for agriculture are extremely spatially imbalanced. When developing algorithms for data-sparse regions, a natural approach is to use transfer learning from data-rich regions. While standard transfer learning approaches…

Machine Learning · Computer Science 2022-02-07 Gabriel Tseng , Hannah Kerner , David Rolnick

Graphical modelling techniques based on sparse selection have been applied to infer complex networks in many fields, including biology and medicine, engineering, finance, and social sciences. One structural feature of some of the networks…

Statistics Theory · Mathematics 2020-03-03 Annaliza McGillivray , Abbas Khalili , David A. Stephens

Estimating forest aboveground biomass (AGB) from Earth observation combines two structurally incompatible label sources: spaceborne lidar provides canopy structure at millions of locations but no biomass estimate, and ground-based plots…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Reza M. Asiyabi , Juan Alberto Molina-Valero , The SEOSAW Partnership , Steven Hancock , Casey M. Ryan

Robustness and compactness are two essential attributes of deep learning models that are deployed in the real world. The goals of robustness and compactness may seem to be at odds, since robustness requires generalization across domains,…

Machine Learning · Computer Science 2024-03-14 Anna Bair , Hongxu Yin , Maying Shen , Pavlo Molchanov , Jose Alvarez

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead

This article introduces a new methodology model both discrete and continuous spatial heterogeneity simultaneously with an application in detection of hyper-plain in thermohaline circulation. To enable the data-driven detection of spatial…

Methodology · Statistics 2025-09-09 Cuiwen Che , Yifan Chen , Zhaoyu Xing , Wei Zhong

Radar-based perception has gained increasing attention in autonomous driving, yet the inherent sparsity of radars poses challenges. Radar raw data often contains excessive noise, whereas radar point clouds retain only limited information.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jialong Wu , Mirko Meuter , Markus Schoeler , Matthias Rottmann