English
Related papers

Related papers: Projected $t$-SNE for batch correction

200 papers

A fundamental task in machine learning involves visualizing high-dimensional data sets that arise in high-impact application domains. When considering the context of large imbalanced data, this problem becomes much more challenging. In this…

Machine Learning · Computer Science 2021-09-21 Parisa Hajibabaee , Farhad Pourkamali-Anaraki , Mohammad Amin Hariri-Ardebili

Batch effects represent a major confounder in genomic diagnostics. In copy number variant (CNV) detection from NGS, many algorithms compare read depth between test samples and a reference sample, assuming they are process-matched. When this…

Genomics · Quantitative Biology 2026-01-16 Austin Talbot , Yue Ke

Classical nonlinear dimensionality reduction (NLDR) techniques like t-SNE, Isomap, and LLE excel at creating low-dimensional embeddings for data visualization but fundamentally lack the ability to map these embeddings back to the original…

Machine Learning · Computer Science 2025-10-16 Riddhish Thakare , Kingdom Mutala Akugri

Dimensional data reduction methods are fundamental to explore and visualize large data sets. Basic requirements for unsupervised data exploration are simplicity, flexibility and scalability. However, current methods show complex…

Machine Learning · Computer Science 2021-12-03 Joan Garriga , Frederic Bartumeus

An increasing number of multi-view data are being published by studies in several fields. This type of data corresponds to multiple data-views, each representing a different aspect of the same set of samples. We have recently proposed…

Machine Learning · Computer Science 2021-11-08 Theodoulos Rodosthenous , Vahid Shahrezaei , Marina Evangelou

Single-cell RNA sequencing enables high-resolution analysis of cellular heterogeneity, yet disentangling biological signal from batch effects remains a major challenge. Existing batch-correction algorithms suppress or discard batch-related…

Machine Learning · Computer Science 2025-11-07 Aixa X. Andrade , Son Nguyen , Austin Marckx , Albert Montillo

t-distributed Stochastic Neighborhood Embedding (t-SNE) is a method for dimensionality reduction and visualization that has become widely popular in recent years. Efficient implementations of t-SNE are available, but they scale poorly to…

Machine Learning · Computer Science 2019-02-26 George C. Linderman , Manas Rachh , Jeremy G. Hoskins , Stefan Steinerberger , Yuval Kluger

This article presents a novel application of the t-distributed Stochastic Neighbor Embedding (t-SNE) clustering algorithm to the telecommunication field. t-SNE is a dimensionality reduction (DR) algorithm that allows the visualization of…

Signal Processing · Electrical Eng. & Systems 2023-04-28 Alejandro Ramírez-Arroyo , Luz García , Antonio Alex-Amor , Juan F. Valenzuela-Valdés

The t-distributed Stochastic Neighbor Embedding (tSNE) algorithm has become in recent years one of the most used and insightful techniques for the exploratory data analysis of high-dimensional data. tSNE reveals clusters of high-dimensional…

Deep Neural Networks (DNNs) thrive in recent years in which Batch Normalization (BN) plays an indispensable role. However, it has been observed that BN is costly due to the reduction operations. In this paper, we propose alleviating this…

Machine Learning · Computer Science 2018-11-05 Zhaodong Chen , Lei Deng , Guoqi Li , Jiawei Sun , Xing Hu , Xin Ma , Yuan Xie

The t-distributed Stochastic Neighbor Embedding (t-SNE) algorithm is a ubiquitously employed dimensionality reduction (DR) method. Its non-parametric nature and impressive efficacy motivated its parametric extension. It is however bounded…

Machine Learning · Computer Science 2020-10-06 Francesco Crecchi , Cyril de Bodt , Michel Verleysen , John A. Lee , Davide Bacciu

Fast and cheaper next generation sequencing technologies will generate unprecedentedly massive and highly-dimensional genomic and epigenomic variation data. In the near future, a routine part of medical record will include the sequenced…

Genomics · Quantitative Biology 2013-01-17 Momiao Xiong , Long Ma

With the increasing availability of high-dimensional data, analysts often rely on exploratory data analysis to understand complex data sets. A key approach to exploring such data is dimensionality reduction, which embeds high-dimensional…

Machine Learning · Computer Science 2024-12-17 Pavlin G. Poličar , Blaž Zupan

Hyperspectral Imagery (and Remote Sensing in general) captured from UAVs or satellites are highly voluminous in nature due to the large spatial extent and wavelengths captured by them. Since analyzing these images requires a huge amount of…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Megh Shukla , Biplab Banerjee , Krishna Mohan Buddhiraju

Single-cell transcriptomic data approximates the abundance of proteins at a high resolution, but its noisiness necessitates transformation by a pipeline of methods before analysis and inference. In the absence of robust validation of these…

Applications · Statistics 2026-04-13 Toby Kettlewell , Yiyi Cheng , Thomas D. Otto , Vincent Macaulay , Mayetri Gupta

Dimension reduction, widely used in science, maps high-dimensional data into low-dimensional space. We investigate a basic mathematical model underlying the techniques of stochastic neighborhood embedding (SNE) and its popular variant…

Machine Learning · Statistics 2025-03-26 Ben Weinkove

Based on technological advances in sensing modalities, randomized trials with primary outcomes represented as high-dimensional vectors have become increasingly prevalent. For example, these outcomes could be week-long time-series data from…

Methodology · Statistics 2024-10-16 Yujin Jeong , Emily Fox , Ramesh Johari

Batch effects are responsible for the failure of promising genomic prognos- tic signatures, major ambiguities in published genomic results, and retractions of widely-publicized findings. Batch effect corrections have been developed to re-…

Methodology · Statistics 2013-01-18 Hilary S. Parker , Héctor Corrada Bravo , Jeffrey T. Leek

We propose a resampling-based fast variable selection technique for detecting relevant single nucleotide polymorphisms (SNP) in a multi-marker mixed effect model. Due to computational complexity, current practice primarily involves testing…

Applications · Statistics 2025-04-30 Subhabrata Majumdar , Saonli Basu , Matt McGue , Snigdhansu Chatterjee

Dimensionality reduction techniques aim at representing high-dimensional data in low-dimensional spaces to extract hidden and useful information or facilitate visual understanding and interpretation of the data. However, few of them take…

Machine Learning · Computer Science 2022-10-25 Yan Sun , Yi Han , Jicong Fan