English
Related papers

Related papers: SparGE: Sparse Coding-based Patient Similarity Lea…

200 papers

We propose PARSE, a novel semi-supervised architecture for learning strong EEG representations for emotion recognition. To reduce the potential distribution mismatch between the large amounts of unlabeled data and the limited amount of…

Machine Learning · Computer Science 2022-09-28 Guangyi Zhang , Vandad Davoodnia , Ali Etemad

Effectively medication recommendation with complex multimorbidity conditions is a critical task in healthcare. Most existing works predicted medications based on longitudinal records, which assumed the information transmitted patterns of…

Machine Learning · Computer Science 2023-09-13 Sicen Liu , Xiaolong Wang , JIngcheng Du , Yongshuai Hou , Xianbing Zhao , Hui Xu , Hui Wang , Yang Xiang , Buzhou Tang

Sparse Autoencoders (SAEs) are an interpretability technique aimed at decomposing neural network activations into interpretable units. However, a major bottleneck for SAE development has been the lack of high-quality performance metrics,…

Machine Learning · Computer Science 2024-12-02 Adam Karvonen , Can Rager , Samuel Marks , Neel Nanda

We propose a sparsity-aware evolutionary (SAE) framework for model merging that involves iterative pruning-merging cycles to act as a novel mutation operator. We incorporate the sparsity constraints into the score function, which steers the…

Machine Learning · Computer Science 2026-02-10 Huan Zhang , Yanjian Zhang , Guillaume Wisniewski , Nadi Tomeh , Bang Liu

Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the loss landscape by minimizing the maximized change of…

Artificial Intelligence · Computer Science 2023-07-03 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Tianshuo Xu , Xiaoshuai Sun , Tongliang Liu , Rongrong Ji , Dacheng Tao

Sparse principal component analysis (PCA) is a well-established dimensionality reduction technique that is often used for unsupervised feature selection (UFS). However, determining the regularization parameters is rather challenging, and…

Machine Learning · Computer Science 2025-04-07 Long Chen , Xianchao Xiu

The aim of sparse approximation is to estimate a sparse signal according to the measurement matrix and an observation vector. It is widely used in data analytics, image processing, and communication, etc. Up to now, a lot of research has…

Signal Processing · Electrical Eng. & Systems 2018-05-31 Hao Wang , Ruibin Feng , Chi-Sing Leung

Machine learning for data-driven diagnosis has been actively studied in medicine to provide better healthcare. Supporting analysis of a patient cohort similar to a patient under treatment is a key task for clinicians to make decisions with…

Medical Physics · Physics 2020-03-25 Rongchen Guo , Takanori Fujiwara , Yiran Li , Kelly M. Lima , Soman Sen , Nam K. Tran , Kwan-Liu Ma

Since the introduction of the lasso in regression, various sparse methods have been developed in an unsupervised context like sparse principal component analysis (s-PCA), sparse canonical correlation analysis (s-CCA) and sparse singular…

Methodology · Statistics 2020-12-09 Ruiping Liu , Ndeye Niang , Gilbert Saporta , Huiwen Wang

Sparse autoencoders (SAEs) decompose language model representations into a sparse set of linear latent vectors. Recent works have improved SAEs using language model gradients, but these techniques require many expensive backward passes…

Machine Learning · Computer Science 2025-05-28 Matthew Chen , Joshua Engels , Max Tegmark

The electrocardiogram (ECG) is one of the most common primary tests to evaluate the health of the heart. Reliable automatic interpretation of ECG records is crucial to the goal of improving public health. It can enable a safe inexpensive…

Signal Processing · Electrical Eng. & Systems 2023-01-18 Laura Rebollo-Neira , Khalil Battikh , Amadou Sidi Watt

Tabular datasets with low-sample-size or many variables are prevalent in biomedicine. Practitioners in this domain prefer linear or tree-based models over neural networks since the latter are harder to interpret and tend to overfit when…

Machine Learning · Computer Science 2022-02-09 Junchen Yang , Ofir Lindenbaum , Yuval Kluger

The performance of image based stereo estimation suffers from lighting variations, repetitive patterns and homogeneous appearance. Moreover, to achieve good performance, stereo supervision requires sufficient densely-labeled data, which are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Yu-Kai Huang , Yueh-Cheng Liu , Tsung-Han Wu , Hung-Ting Su , Winston H. Hsu

A new line of research uses compression methods to measure the similarity between signals. Two signals are considered similar if one can be compressed significantly when the information of the other is known. The existing compression-based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Tanaya Guha , Rabab K. Ward

Joint Embedding Predictive Architectures (JEPA) have emerged as a powerful framework for learning general-purpose representations. However, these models often lack interpretability and suffer from inefficiencies due to dense embedding…

Machine Learning · Computer Science 2025-04-24 Max Hartman , Lav Varshney

Clinical trials play important roles in drug development but often suffer from expensive, inaccurate and insufficient patient recruitment. The availability of massive electronic health records (EHR) data and trial eligibility criteria (EC)…

Machine Learning · Computer Science 2020-06-17 Junyi Gao , Cao Xiao , Lucas M. Glass , Jimeng Sun

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao

With fully leveraging the value of unlabeled data, semi-supervised medical image segmentation algorithms significantly reduces the limitation of limited labeled data, achieving a significant improvement in accuracy. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jialu Zhou , Dianxi Shi , Shaowu Yang , Chunping Qiu , Luoxi Jing , Mengzhu Wang

We propose a probabilistic framework for interpreting and developing hard thresholding sparse signal reconstruction methods and present several new algorithms based on this framework. The measurements follow an underdetermined linear model,…

Information Theory · Computer Science 2010-11-08 Kun Qiu , Aleksandar Dogandzic

Sparse PCA is one of the most well-studied problems in high-dimensional statistics. In this problem, we are given samples from a distribution with covariance $\Sigma$, whose top eigenvector $v \in R^d$ is $s$-sparse. Existing sparse PCA…

Machine Learning · Statistics 2026-03-04 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Peiyuan Zhang