English
Related papers

Related papers: Sparse Attention Regression Network Based Soil Fer…

200 papers

In this paper, we present a new variable selection method for regression and classification purposes. Our method, called Subsampling Ranking Forward selection (SuRF), is based on LASSO penalised regression, subsampling and forward-selection…

Methodology · Statistics 2021-05-25 Lihui Liu , Hong Gu , Johan Van Limbergen , Toby Kenney

Many modern big data applications feature large scale in both numbers of responses and predictors. Better statistical efficiency and scientific insights can be enabled by understanding the large-scale response-predictor association network…

Methodology · Statistics 2017-04-28 Yoshimasa Uematsu , Yingying Fan , Kun Chen , Jinchi Lv , Wei Lin

This study proposes sparse estimation methods for the generalized linear models, which run one of least angle regression (LARS) and least absolute shrinkage and selection operator (LASSO) in the tangent space of the manifold of the…

Machine Learning · Statistics 2020-07-20 Yoshihiro Hirose

Tabular datasets are widely used in scientific disciplines such as biology. While these disciplines have already adopted AI methods to enhance their findings and analysis, they mainly use tree-based methods due to their interpretability. At…

Machine Learning · Computer Science 2025-04-16 Salvatore Raieli , Nathalie Jeanray , Stéphane Gerart , Sebastien Vachenc , Abdulrahman Altahhan

This paper considers near-field multiuser communications based on sparse arrays (SAs). First, for the uniform SAs (USAs), we analyze the beam gains of channel steering vectors, which shows that increasing the antenna spacings can…

Information Theory · Computer Science 2024-06-14 Kangjian Chen , Chenhao Qi , Geoffrey Ye Li , Octavia A. Dobre

Accurate monsoon rainfall prediction is vital for India's agriculture, water management, and climate risk planning, yet remains challenging due to sparse ground observations and complex regional variability. We present a multimodal deep…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Swaib Ilias Mazumder , Manish Kumar , Aparajita Khan

Uniform Manifold Approximation and Projection (UMAP) is a widely used manifold learning technique for dimensionality reduction. This paper studies UMAP, supervised UMAP, and several competing dimensionality reduction methods, including…

Machine Learning · Computer Science 2026-05-04 Guanzhe Zhang , Shanshan Ding , Zhezhen Jin

Vector autoregressive (VAR) models are widely used for causal discovery and forecasting in multivariate time series analysis. In the high-dimensional setting, which is increasingly common in fields such as neuroscience and econometrics,…

Sparse attention methods exploit the inherent sparsity in attention to speed up the prefilling phase of long-context inference, mitigating the quadratic complexity of full attention computation. While existing sparse attention methods rely…

Machine Learning · Computer Science 2025-05-27 Dan Peng , Zhihui Fu , Zewen Ye , Zhuoran Song , Jun Wang

Few-shot semantic segmentation of time-series remote sensing images remains a critical challenge, particularly in regions where labeled data is scarce or costly to obtain. While state-of-the-art models perform well under full supervision,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Kai Hu , Yaozu Feng , Vladimir Lysenko , Ya Guo , Huayi Wu

Accurate interpretation of soil moisture patterns is critical for irrigation scheduling and crop management, yet existing approaches for soil moisture time-series analysis either rely on threshold-based rules or data-hungry machine learning…

Artificial Intelligence · Computer Science 2025-09-24 Yeonju Lee , Rui Qi Chen , Joseph Oboamah , Po Nien Su , Wei-zhen Liang , Yeyin Shi , Lu Gan , Yongsheng Chen , Xin Qiao , Jing Li

In this research, an effort is made to address microgrid systems' operational challenges, characterized by power oscillations that eventually contribute to grid instability. An integrated strategy is proposed, leveraging the strengths of…

Machine Learning · Computer Science 2024-07-23 Vinod Kumar Maddineni , Naga Babu Koganti , Praveen Damacharla

Meeting the increasing global demand for food security and sustainable farming requires intelligent crop recommendation systems that operate in real time. Traditional soil analysis techniques are often slow, labor-intensive, and not…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Vishal Pandey , Ranjita Das , Debasmita Biswas

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias especially at a sparse…

Machine Learning · Computer Science 2018-08-23 Katsuyuki Hagiwara

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

Econometrics · Economics 2024-01-17 Ziwei Mei , Zhentao Shi

Imbalanced regression occurs when continuous target variables have skewed distributions, creating sparse regions that are difficult for machine learning models to predict accurately. This issue particularly affects neural networks, which…

Machine Learning · Computer Science 2025-04-22 Shayan Alahyari , Mike Domaratzki

Sparse linear regression methods including the well-known LASSO and the Dantzig selector have become ubiquitous in the engineering practice, including in medical imaging. Among other tasks, they have been successfully applied for the…

Signal Processing · Electrical Eng. & Systems 2023-01-03 Anna Pidnebesna , Iveta Fajnerova , Jiri Horacek , Jaroslav Hlinka

Uncertainty estimation in machine learning is paramount for enhancing the reliability and interpretability of predictive models, especially in high-stakes real-world scenarios. Despite the availability of numerous methods, they often pose a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Anton Baumann , Thomas Roßberg , Michael Schmitt

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

Methodology · Statistics 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman

Interpretable machine learning has demonstrated impressive performance while preserving explainability. In particular, neural additive models (NAM) offer the interpretability to the black-box deep learning and achieve state-of-the-art…

Machine Learning · Statistics 2022-02-28 Shiyun Xu , Zhiqi Bu , Pratik Chaudhari , Ian J. Barnett