English
Related papers

Related papers: Projected $t$-SNE for batch correction

200 papers

We introduce a nonlinear method for directly embedding large, sparse, stochastic graphs into low-dimensional spaces, without requiring vertex features to reside in, or be transformed into, a metric space. Graph data and models are prevalent…

Machine Learning · Computer Science 2019-06-14 Nikos Pitsianis , Alexandros-Stavros Iliopoulos , Dimitris Floros , Xiaobai Sun

The clustering and visualisation of high-dimensional data is a ubiquitous task in modern data science. Popular techniques include nonlinear dimensionality reduction methods like t-SNE or UMAP. These methods face the `scale-problem' of…

Machine Learning · Statistics 2025-10-20 Jack Kendrick

Causal inference plays an important role in under standing the underlying mechanisation of the data generation process across various domains. It is challenging to estimate the average causal effect and individual causal effects from…

Data Structures and Algorithms · Computer Science 2023-01-05 Haoran Zhao , Yinghao Zhang , Debo Cheng , Chen Li , Zaiwen Feng

This paper presents a kernelized version of the t-SNE algorithm, capable of mapping high-dimensional data to a low-dimensional space while preserving the pairwise distances between the data points in a non-Euclidean metric. This can be…

Machine Learning · Computer Science 2023-11-22 Denis C. Ilie-Ablachim , Bogdan Dumitrescu , Cristian Rusu

The central problem in biomedical imaging are batch effects: systematic technical variations unrelated to the biological signal of interest. These batch effects critically undermine experimental reproducibility and are the primary cause of…

Machine Learning · Computer Science 2026-04-23 Ana Sanchez-Fernandez , Thomas Pinetz , Werner Zellinger , Günter Klambauer

We extend a well-known dimension reduction method, t-distributed stochastic neighbor embedding (t-SNE), from non-parametric to parametric by training neural networks. The main advantage of a parametric technique is the generalization of…

Machine Learning · Computer Science 2020-10-01 Chien-Hsun Lai , Yu-Shuen Wang

Motivation: As cancer researchers have come to appreciate the importance of intratumor heterogeneity, much attention has focused on the challenges of accurately profiling heterogeneity in individual patients. Experimental technologies for…

Genomics · Quantitative Biology 2018-02-07 Theodore Roman , Lu Xie , Russell Schwartz

We describe a new method called t-ETE for finding a low-dimensional embedding of a set of objects in Euclidean space. We formulate the embedding problem as a joint ranking problem over a set of triplets, where each triplet captures the…

Artificial Intelligence · Computer Science 2017-05-18 Ehsan Amid , Nikos Vlassis , Manfred K. Warmuth

Dimensionality reduction methods, also known as projections, are frequently used for exploring multidimensional data in machine learning, data science, and information visualization. Among these, t-SNE and its variants have become very…

Machine Learning · Computer Science 2019-02-22 Mateus Espadoto , Nina S. T. Hirata , Alexandru C. Telea

Large-scale numerical simulations often produce high-dimensional gridded data that is challenging to process for downstream applications. A prime example is numerical weather prediction, where atmospheric processes are modeled using…

Machine Learning · Computer Science 2025-02-10 Jieyu Chen , Kevin Höhlein , Sebastian Lerch

Sensor data analysis plays a key role in health assessment of critical equipment. Such data are multivariate and exhibit nonlinear relationships. This paper describes how one can exploit nonlinear dimension reduction techniques, such as the…

Signal Processing · Electrical Eng. & Systems 2019-10-04 Kai Shen , Anya Mcguirk , Yuwei Liao , Arin Chaudhuri , Deovrat Kakde

Non-linear dimensionality reduction (NLDR) methods such as t-distributed stochastic neighbour embedding (t-SNE) are ubiquitous in the natural sciences, however, the appropriate use of these methods is difficult because of their complex…

Other Statistics · Statistics 2020-12-14 Stuart Lee , Ursula Laa , Dianne Cook

The dimensionality reduction has been widely introduced to use the high-dimensional data for regression, classification, feature analysis, and visualization. As the one technique of dimensionality reduction, a stochastic neighbor embedding…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Motoshi Abe , Junichi Miyao , Takio Kurita

Batch Normalization (BN) and its variants have delivered tremendous success in combating the covariate shift induced by the training step of deep learning methods. While these techniques normalize feature distributions by standardizing with…

Machine Learning · Computer Science 2021-05-06 Mandy Lu , Qingyu Zhao , Jiequan Zhang , Kilian M. Pohl , Li Fei-Fei , Juan Carlos Niebles , Ehsan Adeli

Progressive Visual Analytics aims at improving the interactivity in existing analytics techniques by means of visualization as well as interaction with intermediate results. One key method for data analysis is dimensionality reduction, for…

Computer Vision and Pattern Recognition · Computer Science 2016-06-17 Nicola Pezzotti , Boudewijn P. F. Lelieveldt , Laurens van der Maaten , Thomas Höllt , Elmar Eisemann , Anna Vilanova

Neural likelihood estimation methods for simulation-based inference can suffer from performance degradation when the modeled data is very high-dimensional or lies along a lower-dimensional manifold, which is due to the inability of the…

Machine Learning · Statistics 2025-06-12 Simon Dirmeier , Carlo Albert , Fernando Perez-Cruz

In this paper, we develop a multiply robust inference procedure of the average treatment effect (ATE) for data with high-dimensional covariates. We consider the case where it is difficult to correctly specify a single parametric model for…

Methodology · Statistics 2025-09-03 Xintao Xia , Yumou Qiu

With the recent surge in big data analytics for hyper-dimensional data there is a renewed interest in dimensionality reduction techniques for machine learning applications. In order for these methods to improve performance gains and…

Machine Learning · Computer Science 2023-01-20 J. Derek Tucker , Matthew T. Martinez , Jose M. Laborde

Single-cell RNA sequencing (scRNA-seq) has revolutionized our ability to analyze gene expression at the cellular level. By providing data on gene expression for each individual cell, scRNA-seq generates large datasets with thousands of…

Computational Complexity · Computer Science 2025-02-11 Md Romizul Islam , Swakkhar Shatabda

We propose a novel method, scTree, for single-cell Tree Variational Autoencoders, extending a hierarchical clustering approach to single-cell RNA sequencing data. scTree corrects for batch effects while simultaneously learning a…

Machine Learning · Computer Science 2024-07-11 Moritz Vandenhirtz , Florian Barkmann , Laura Manduchi , Julia E. Vogt , Valentina Boeva