English
Related papers

Related papers: Subject-Adaptive Sparse Linear Models for Interpre…

200 papers

Training deep neural networks with noise and data heterogeneity is a major challenge. We introduce Lightweight Learnable Adaptive Weighting (LiLAW), a method that dynamically adjusts the loss weight of each training sample based on its…

Machine Learning · Computer Science 2026-05-14 Abhishek Moturu , Muhammad Muzammil , Anna Goldenberg , Babak Taati

Sparse Autoencoders (SAEs) have been successfully used to probe Large Language Models (LLMs) and extract interpretable concepts from their internal representations. These concepts are linear combinations of neuron activations that…

Computation and Language · Computer Science 2026-02-23 Mathis Le Bail , Jérémie Dentan , Davide Buscaldi , Sonia Vanier

Advances in large language models (LLMs) have enabled a wide range of applications. However, depression prediction is hindered by the lack of large-scale, high-quality, and rigorously annotated datasets. This study introduces DepressLLM,…

Computation and Language · Computer Science 2025-08-13 Sehwan Moon , Aram Lee , Jeong Eun Kim , Hee-Ju Kang , Il-Seon Shin , Sung-Wan Kim , Jae-Min Kim , Min Jhon , Ju-Wan Kim

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimation and variable selection in linear regression with grouped variables. We further extend the SSGL to sparse generalized additive models (GAMs), thereby introducing the…

Methodology · Statistics 2020-07-29 Ray Bai , Gemma E. Moran , Joseph Antonelli , Yong Chen , Mary R. Boland

Survey data often arises from complex sampling designs, such as stratified or multistage sampling, with unequal inclusion probabilities. When sampling is informative, traditional inference methods yield biased estimators and poor coverage.…

Methodology · Statistics 2025-04-17 Snigdha Das , Dipankar Bandyopadhyay , Debdeep Pati

Speech and language technologies offer valuable opportunities for supporting mental health assessment through objective and interpretable cues. We present a systematic feature-based analysis framework leveraging perceptually grounded…

Artificial Intelligence · Computer Science 2026-05-28 Vassilis Lyberatos , Edmund G. Dervakos , Eleni Adamidi , Athanasios Voulodimos , Giorgos Stamou

Sparse Group LASSO (SGL) is a regularized model for high-dimensional linear regression problems with grouped covariates. SGL applies $l_1$ and $l_2$ penalties on the individual predictors and group predictors, respectively, to guarantee…

Statistics Theory · Mathematics 2022-02-23 Kan Chen , Zhiqi Bu , Shiyun Xu

Detecting medical conditions from speech acoustics is fundamentally a weakly-supervised learning problem: a single, often noisy, session-level label must be linked to nuanced patterns within a long, complex audio recording. This task is…

Sound · Computer Science 2026-04-21 Xingyuan Li , Mengyue Wu

Clinical decision making regarding treatments based on personal characteristics leads to effective health improvements. Machine learning (ML) has been the primary concern of diagnosis support according to comprehensive patient information.…

Machine Learning · Computer Science 2021-06-09 Kazuki Nakamura , Ryosuke Kojima , Eiichiro Uchino , Koichi Murashita , Ken Itoh , Shigeyuki Nakaji , Yasushi Okuno

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

Shapley values, a gold standard for feature attribution in Explainable AI, face two key challenges. First, the canonical Shapley framework assumes that the worth function is additive, yet real-world payoff constructions--driven by…

Machine Learning · Computer Science 2026-03-10 Jialai She

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim

Background and Aims: Large language models (LLMs) have shown remarkable generalization and transfer capabilities by learning from vast corpora of text and web data. Their semantic representations allow cross-task knowledge transfer and…

Machine Learning · Computer Science 2025-09-25 Yuqi Jin , Zhenhao Shuai , Zihan Hu , Weiteng Zhang , Weihao Xie , Jianwei Shuai , Xian Shen , Zhen Feng

Patient-trial matching requires reasoning over long, heterogeneous electronic health records (EHRs) and complex eligibility criteria, posing significant challenges for scalability, generalization, and computational efficiency. Existing…

Computation and Language · Computer Science 2026-04-27 Xiaodi Li , Yang Xiao , Munhwan Lee , Konstantinos Leventakos , Young J. Juhn , David Jones , Terence T. Sio , Wei Liu , Maria Vassilaki , Nansu Zong

In medical image analysis, achieving fast, efficient, and accurate segmentation is essential for automated diagnosis and treatment. Although recent advancements in deep learning have significantly improved segmentation accuracy, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhi Li , Kai Zhao , Yaqi Wang , Shuai Wang

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

Sparse linear regression is a fundamental tool in data analysis. However, traditional approaches often fall short when covariates exhibit structure or arise from heterogeneous sources. In biomedical applications, covariates may stem from…

Machine Learning · Statistics 2026-05-19 William R. P. Denault

Machine learning models are exceptionally effective in capturing complex non-linear relationships of high-dimensional datasets and making accurate predictions. However, their intrinsic ``black-box'' nature makes it difficult to interpret…

Plasma Physics · Physics 2024-07-29 Tadas Pyragius , Cary Colgan , Hazel Lowe , Filip Janky , Matteo Fontana , Yichen Cai , Graham Naylor

Large language models (LLMs) have shown promising capabilities in visually interpreting medical time-series data. However, their general-purpose design can limit domain-specific precision, and the proprietary nature of many models poses…

Artificial Intelligence · Computer Science 2025-07-22 Huayu Li , Zhengxiao He , Xiwen Chen , Ci Zhang , Stuart F. Quan , William D. S. Killgore , Shu-Fen Wung , Chen X. Chen , Geng Yuan , Jin Lu , Ao Li

Protein language models (PLMs) have demonstrated remarkable success in protein modeling and design, yet their internal mechanisms for predicting structure and function remain poorly understood. Here we present a systematic approach to…

Biomolecules · Quantitative Biology 2024-12-18 Elana Simon , James Zou