English
Related papers

Related papers: Projected $t$-SNE for batch correction

200 papers

Longitudinal MRIs are often used to capture the gradual deterioration of brain structure and function caused by aging or neurological diseases. Analyzing this data via machine learning generally requires a large number of ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jiahong Ouyang , Qingyu Zhao , Ehsan Adeli , Edith V Sullivan , Adolf Pfefferbaum , Greg Zaharchuk , Kilian M Pohl

We introduce a unified, flexible, and easy-to-implement framework of sufficient dimension reduction that can accommodate both linear and nonlinear dimension reduction, and both the conditional distribution and the conditional mean as the…

Machine Learning · Statistics 2025-06-23 Yin Tang , Bing Li

Batch effects are inevitable in large-scale metabolomics. Prior to formal data analysis, batch effect correction (BEC) is applied to prevent from obscuring biological variations, and batch effect evaluation (BEE) is used for correction…

Methodology · Statistics 2024-12-16 Zhendong Guo

Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. However, most of current batch approaches do not scale well with the batch size. That is, their performances…

Machine Learning · Computer Science 2025-04-25 Dawei Zhan , Zhaoxi Zeng , Shuoxiao Wei , Ping Wu

Modern datasets and models are notoriously difficult to explore and analyze due to their inherent high dimensionality and massive numbers of samples. Existing visualization methods which employ dimensionality reduction to two or three…

Machine Learning · Computer Science 2018-08-01 David M. Chan , Roshan Rao , Forrest Huang , John F. Canny

Dimensionality reduction methods such as t-SNE and UMAP are popular methods for visualizing data with a potential (latent) clustered structure. They are known to group data points at the same time as they embed them, resulting in…

Machine Learning · Computer Science 2025-09-04 Elizabeth Coda , Ery Arias-Castro , Gal Mishne

Deconvolution of cell mixtures in "bulk" transcriptomic samples from homogenate human tissue is important for understanding the pathologies of diseases. However, several experimental and computational challenges remain in developing and…

Other Quantitative Biology · Quantitative Biology 2023-05-12 Sean K. Maden , Sang Ho Kwon , Louise A. Huuki-Myers , Leonardo Collado-Torres , Stephanie C. Hicks , Kristen R. Maynard

Spectral dimensionality reduction methods enable linear separations of complex data with high-dimensional features in a reduced space. However, these methods do not always give the desired results due to irregularities or uncertainties of…

Machine Learning · Statistics 2018-05-21 Momo Matsuda , Keiichi Morikuni , Tetsuya Sakurai

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

t-Distributed Stochastic Neighbor Embedding (t-SNE) for the visualization of multidimensional data has proven to be a popular approach, with successful applications in a wide range of domains. Despite their usefulness, t-SNE projections can…

Machine Learning · Computer Science 2024-04-19 Angelos Chatzimparmpas , Rafael M. Martins , Andreas Kerren

The simultaneous application of multiple treatments is increasingly common in many fields, such as healthcare and marketing. In such scenarios, it is important to estimate the single treatment effects and the interaction treatment effects…

Methodology · Statistics 2025-11-14 Yuki Murakami , Takumi Hattori , Kohsuke Kubota

t-SNE has gained popularity as a dimension reduction technique, especially for visualizing data. It is well-known that all dimension reduction techniques may lose important features of the data. We provide a mathematical framework for…

Machine Learning · Computer Science 2026-04-16 Rupert Li , Elchanan Mossel

In biomedical science, analyzing treatment effect heterogeneity plays an essential role in assisting personalized medicine. The main goals of analyzing treatment effect heterogeneity include estimating treatment effects in clinically…

Methodology · Statistics 2022-12-06 Waverly Wei , Maya Petersen , Mark J van der Laan , Zeyu Zheng , Chong Wu , Jingshen Wang

In this study, we focus on estimating the heterogeneous treatment effect (HTE) for survival outcome. The outcome is subject to censoring and the number of covariates is high-dimensional. We utilize data from both the randomized controlled…

Methodology · Statistics 2025-03-21 Xin Ye , Shu Yang , Xiaofei Wang , Yanyan Liu

tSNE and UMAP are popular dimensionality reduction algorithms due to their speed and interpretable low-dimensional embeddings. Despite their popularity, however, little work has been done to study their full span of differences. We…

High-Content Screening routinely generates massive volumes of cell painting images for phenotypic profiling. However, technical variations across experimental executions inevitably induce biological batch (bio-batch) effects. These cause…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Lei Tong , Xujing Yao , Adam Corrigan , Long Chen , Navin Rathna Kumar , Kerry Hallbrook , Jonathan Orme , Yinhai Wang , Huiyu Zhou

It is often desirable to reduce the dimensionality of a large dataset by projecting it onto a low-dimensional subspace. Matrix sketching has emerged as a powerful technique for performing such dimensionality reduction very efficiently. Even…

Machine Learning · Computer Science 2022-06-15 Michał Dereziński , Feynman Liang , Zhenyu Liao , Michael W. Mahoney

Simulation-based inference (SBI) solves statistical inverse problems by repeatedly running a stochastic simulator and inferring posterior distributions from model-simulations. To improve simulation efficiency, several inference methods take…

Machine Learning · Statistics 2022-11-11 Michael Deistler , Pedro J Goncalves , Jakob H Macke

Multimodal relational data analysis has become of increasing importance in recent years, for exploring across different domains of data, such as images and their text tags obtained from social networking services (e.g., Flickr). A variety…

Machine Learning · Computer Science 2020-05-05 Morihiro Mizutani , Akifumi Okuno , Geewook Kim , Hidetoshi Shimodaira

Precision is of utmost importance in the realm of clinical entity extraction from clinical notes and reports. Encoder Models fine-tuned for Named Entity Recognition (NER) are an efficient choice for this purpose, as they don't hallucinate.…

Computation and Language · Computer Science 2026-03-03 Kuldeep Jiwani , Yash K Jeengar , Ayush Dhaka