English
Related papers

Related papers: Large data limits and scaling laws for tSNE

200 papers

This study proposes median consensus embedding (MCE) to address variability in low-dimensional embeddings caused by random initialization in nonlinear dimensionality reduction techniques such as $t$-distributed stochastic neighbor…

Machine Learning · Statistics 2025-12-10 Yui Tomo , Daisuke Yoneoka

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

This paper deals with the asymptotic statistical properties of a class of redescending M-estimators in linear models with increasing dimension. This class is wide enough to include popular high breakdown point estimators such as…

Statistics Theory · Mathematics 2016-12-20 Ezequiel Smucler

Nowadays designing a real recommendation system has been a critical problem for both academic and industry. However, due to the huge number of users and items, the diversity and dynamic property of the user interest, how to design a…

Information Retrieval · Computer Science 2020-04-10 Jianbin Lin , Daixin Wang , Lu Guan , Yin Zhao , Binqiang Zhao , Jun Zhou , Xiaolong Li , Yuan Qi

In modern deep learning, there is a recent and growing literature on the interplay between large-width asymptotic properties of deep Gaussian neural networks (NNs), i.e. deep NNs with Gaussian-distributed weights, and Gaussian stochastic…

Machine Learning · Computer Science 2022-06-27 Stefano Favaro , Sandra Fortini , Stefano Peluchetti

This paper presents a theoretical analysis and practical evaluation of the main bottlenecks towards a scalable distributed solution for the training of Deep Neuronal Networks (DNNs). The presented results show, that the current state of the…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Janis Keuper , Franz-Josef Pfreundt

Machine learning has made tremendous progress in recent years, with models matching or even surpassing humans on a series of specialized tasks. One key element behind the progress of machine learning in recent years has been the ability to…

Machine Learning · Computer Science 2020-06-30 Giorgi Nadiradze , Ilia Markov , Bapi Chatterjee , Vyacheslav Kungurtsev , Dan Alistarh

Popular regularizers with non-differentiable penalties, such as Lasso, Elastic Net, Generalized Lasso, or SLOPE, reduce the dimension of the parameter space by inducing sparsity or clustering in the estimators' coordinates. In this paper,…

Statistics Theory · Mathematics 2025-01-03 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan , Michał Kos

High dimensional data can contain multiple scales of variance. Analysis tools that preferentially operate at one scale can be ineffective at capturing all the information present in this cross-scale complexity. We propose a multiscale joint…

Machine Learning · Statistics 2022-03-15 Daniel Sousa , Christopher Small

Current theoretical results on optimization trajectories of neural networks trained by gradient descent typically have the form of rigorous but potentially loose bounds on the loss values. In the present work we take a different approach…

Machine Learning · Computer Science 2021-05-04 Maksim Velikanov , Dmitry Yarotsky

We perform an asymptotic analysis of general particle systems arising in collective behavior in the limit of large self-propulsion and friction forces. These asymptotics impose a fixed speed in the limit, and thus a reduction of the…

Analysis of PDEs · Mathematics 2012-03-01 Mihai Bostan , J. A. Carrillo

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

In sparse linear regression, the SLOPE estimator generalizes LASSO by penalizing different coordinates of the estimate according to their magnitudes. In this paper, we present a precise performance characterization of SLOPE in the…

Information Theory · Computer Science 2021-06-07 Hong Hu , Yue M. Lu

When data is of an extraordinarily large size or physically stored in different locations, the distributed nearest neighbor (NN) classifier is an attractive tool for classification. We propose a novel distributed adaptive NN classifier for…

Machine Learning · Statistics 2023-06-06 Ruiqi Liu , Ganggang Xu , Zuofeng Shang

We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the…

Instrumentation and Methods for Astrophysics · Physics 2015-05-13 J. T. VanderPlas , A. J. Connolly

This work develops new results for stochastic approximation algorithms. The emphases are on treating algorithms and limits with discontinuities. The main ingredients include the use of differential inclusions, set-valued analysis, and…

Probability · Mathematics 2021-08-31 Nhu Nguyen , George Yin

In this work, the use of t-SNE is proposed to embed 3D point clouds of plants into 2D space for plant characterization. It is demonstrated that t-SNE operates as a practical tool to flatten and visualize a complete 3D plant model in 2D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Helin Dutagaci

We consider strongly coupled competitive elliptic systems of Gross-Pitaevskii type that arise in the study of two-component Bose-Einstein condensates, in general smooth bounded domains of $\mathbb{R}^N$, $N\geq 1$. As the coupling parameter…

Analysis of PDEs · Mathematics 2024-05-28 Christos Sourdis

There has been an intense recent activity in embedding of very high dimensional and nonlinear data structures, much of it in the data science and machine learning literature. We survey this activity in four parts. In the first part we cover…

Machine Learning · Statistics 2022-09-01 Dag Tjøstheim , Martin Jullum , Anders Løland

We consider penalized extremum estimation of a high-dimensional, possibly nonlinear model that is sparse in the sense that most of its parameters are zero but some are not. We use the SCAD penalty function, which provides model selection…

Econometrics · Economics 2024-02-23 Joel L. Horowitz , Ahnaf Rafi