English
Related papers

Related papers: Projected $t$-SNE for batch correction

200 papers

This research implements an advanced unsupervised clustering system for MNIST handwritten digits through two-phase deep autoencoder architecture. A deep neural autoencoder requires a training process during phase one to develop minimal yet…

Machine Learning · Computer Science 2025-06-13 Md. Faizul Islam Ansari

We study high-dimensional two-sample mean comparison and address the curse of dimensionality through data-adaptive projections. Leveraging the low-dimensional and localized signal structures commonly seen in single-cell genomics data, our…

Methodology · Statistics 2025-06-12 Tianyu Zhang , Jing Lei , Kathryn Roeder

Unsupervised machine learning has recently gained much attention in the field of molecular dynamics (MD). Particularly, dimensionality reduction techniques have been regularly employed to analyze large volumes of high-dimensional MD data to…

Chemical Physics · Physics 2025-05-23 Patryk Tajs , Mateusz Skarupski , Jakub Rydzewski

Low-dimensional embeddings and visualizations are an indispensable tool for analysis of high-dimensional data. State-of-the-art methods, such as tSNE and UMAP, excel in unveiling local structures hidden in high-dimensional data and are…

Machine Learning · Computer Science 2023-02-01 Jonas Fischer , Rebekka Burkholz , Jilles Vreeken

Across many scientific fields, measurements often represent the number of times an event occurs. For example, a document can be represented by word occurrence counts, neural activity by spike counts per time window, or online communication…

Machine Learning · Statistics 2026-04-21 Noga Mudrik , Adam S. Charles

This paper proposes a supervised dimension reduction methodology for tensor data which has two advantages over most image-based prognostic models. First, the model does not require tensor data to be complete which expands its application to…

Machine Learning · Computer Science 2023-06-06 Chengyu Zhou , Xiaolei Fang

The paper presents an O(N log N)-implementation of t-SNE -- an embedding technique that is commonly used for the visualization of high-dimensional data in scatter plots and that normally runs in O(N^2). The new implementation uses…

Machine Learning · Computer Science 2013-03-11 Laurens van der Maaten

We present S+t-SNE, an adaptation of the t-SNE algorithm designed to handle infinite data streams. The core idea behind S+t-SNE is to update the t-SNE embedding incrementally as new data arrives, ensuring scalability and adaptability to…

Artificial Intelligence · Computer Science 2025-01-22 Pedro C. Vieira , João P. Montrezol , João T. Vieira , João Gama

The t-distributed stochastic neighbor embedding (t- SNE) is a method for interpreting high dimensional (HD) data by mapping each point to a low dimensional (LD) space (usually two-dimensional). It seeks to retain the structure of the data.…

Machine Learning · Computer Science 2022-11-18 Prakash Chourasia , Sarwan Ali , Murray Patterson

Single-cell sequencing has a significant role to explore biological processes such as embryonic development, cancer evolution, and cell differentiation. These biological properties can be presented by a two-dimensional scatter plot.…

Genomics · Quantitative Biology 2021-10-19 Ziyi Liu , Minghui Liao , Fulin luo , Bo Du

Patch-seq, a recently developed experimental technique, allows neuroscientists to obtain transcriptomic and electrophysiological information from the same neurons. Efficiently analyzing and visualizing such paired multivariate data in order…

Machine Learning · Computer Science 2022-01-26 Yves Bernaerts , Philipp Berens , Dmitry Kobak

Due to the sequential sample arrival, changing experiment conditions, and evolution of knowledge, the demand to continually visualize evolving structures of sequential and diverse single-cell RNA-sequencing (scRNA-seq) data becomes…

Genomics · Quantitative Biology 2024-06-24 Hui Ma , Kai Chen

High-dimensional sparse data present computational and statistical challenges for supervised learning. We propose compact linear sketches for reducing the dimensionality of the input, followed by a single layer neural network. We show that…

Machine Learning · Computer Science 2016-04-21 Amit Daniely , Nevena Lazic , Yoram Singer , Kunal Talwar

Widely used pipelines for analyzing high-dimensional data utilize two-dimensional visualizations. These are created, for instance, via t-distributed stochastic neighbor embedding (t-SNE). A crucial element of the t-SNE embedding procedure…

Machine Learning · Computer Science 2024-12-06 Martin Skrodzki , Nicolas F. Chaves-de-Plaza , Thomas Höllt , Elmar Eisemann , Klaus Hildebrandt

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee

In several practical applications, particularly healthcare, clinical data of each patient is individually recorded in a database at irregular intervals as required. This causes a sparse and irregularly sampled time series, which makes it…

Machine Learning · Computer Science 2025-04-09 Mincheol Kim , Soo-Yong Shin

Causal inference plays a fundamental role in various real-world applications. However, in the motivating non-small cell lung cancer (NSCLC) study, it is challenging to estimate the treatment effect of chemotherapy on circulating tumor DNA…

Methodology · Statistics 2025-08-25 Zhixin Qiu , Huichen Zhu , Wenjie Wang , Yanlin Tang

To address the challenges of reliable statistical inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via…

Statistics Theory · Mathematics 2025-03-18 Weihao Li , Dongming Huang

t-distributed Stochastic Neighborhood Embedding (t-SNE), a clustering and visualization method proposed by van der Maaten & Hinton in 2008, has rapidly become a standard tool in a number of natural sciences. Despite its overwhelming…

Machine Learning · Computer Science 2017-06-09 George C. Linderman , Stefan Steinerberger

In genetic association studies, rare variants with extremely small allele frequency play a crucial role in complex traits, and the set-based testing methods that jointly assess the effects of groups of single nucleotide polymorphisms (SNPs)…

Methodology · Statistics 2020-03-13 Shonosuke Sugasawa , Hisashi Noma