English
Related papers

Related papers: Toward Asymptotic Optimality: Sequential Unsupervi…

200 papers

Modern neural language models achieve high accuracy in text generation, yet precise control over generation length remains underdeveloped. In this paper, we first investigate a recent length control method based on Reverse Positional…

Computation and Language · Computer Science 2026-05-05 Ivanhoé Botcazou , Tassadit Amghar , Sylvain Lamprier , Frédéric Saubion

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

Optimization and Control · Mathematics 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

t-distributed stochastic neighbor embedding (t-SNE) is a well-established visualization method for complex high-dimensional data. However, the original t-SNE method is nonparametric, stochastic, and often cannot well prevserve the global…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Zixia Zhou , Yuanyuan Wang , Boudewijn P. F. Lelieveldt , Qian Tao

Many approaches in machine learning rely on a weighted graph to encode the similarities between samples in a dataset. Entropic affinities (EAs), which are notably used in the popular Dimensionality Reduction (DR) algorithm t-SNE, are…

Machine Learning · Computer Science 2023-10-31 Hugues Van Assel , Titouan Vayer , Rémi Flamary , Nicolas Courty

Constrained Markov decision processes (CMDPs) model scenarios of sequential decision making with multiple objectives that are increasingly important in many applications. However, the model is often unknown and must be learned online while…

Machine Learning · Computer Science 2023-01-30 Krishna C Kalagarla , Rahul Jain , Pierluigi Nuzzo

Today's densely instrumented world offers tremendous opportunities for continuous acquisition and analysis of multimodal sensor data providing temporal characterization of an individual's behaviors. Is it possible to efficiently couple such…

Machine Learning · Computer Science 2018-09-03 Homa Hosseinmardi , Amir Ghasemian , Shrikanth Narayanan , Kristina Lerman , Emilio Ferrara

Diabetic Retinopathy (DR) is a significant cause of blindness globally, highlighting the urgent need for early detection and effective treatment. Recent advancements in Machine Learning (ML) techniques have shown promise in DR detection,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 D. Dhinakaran , L. Srinivasan , D. Selvaraj , S. M. Udhaya Sankar

Class imbalance in a dataset is a major problem for classifiers that results in poor prediction with a high true positive rate (TPR) but a low true negative rate (TNR) for a majority positive training dataset. Generally, the pre-processing…

Machine Learning · Computer Science 2022-03-29 Anuraganand Sharma , Prabhat Kumar Singh , Rohitash Chandra

In a mixture of linear regression model, the regression coefficients are treated as random vectors that may follow either a continuous or discrete distribution. We propose two Expectation-Maximization (EM) algorithms to estimate this prior…

Methodology · Statistics 2025-10-17 Andrew Welbaum , Wanli Qiao

Sufficient dimension reduction (SDR) methods aim to identify a dimension reduction subspace (DRS) that preserves all the information about the conditional distribution of a response given its predictor. Traditional SDR methods determine the…

Methodology · Statistics 2025-11-26 Derik T. Boonstra , Rakheon Kim , Dean M. Young

We consider the problem of uncertainty quantification in high dimensional regression and classification for which deep ensemble have proven to be promising methods. Recent observations have shown that deep ensemble often return…

Machine Learning · Computer Science 2023-04-11 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Bayesian density deconvolution using nonparametric prior distributions is a useful alternative to the frequentist kernel based deconvolution estimators due to its potentially wide range of applicability, straightforward uncertainty…

Statistics Theory · Mathematics 2013-09-10 Abhra Sarkar , Debdeep Pati , Bani K. Mallick , Raymond J. Carroll

We consider the problem of sufficient dimensionality reduction (SDR), where the high-dimensional observation is transformed to a low-dimensional sub-space in which the information of the observations regarding the label variable is…

Machine Learning · Computer Science 2018-12-20 Ershad Banijamali , Amir-Hossein Karimi , Ali Ghodsi

Sparse signal recovery is one of the most fundamental problems in various applications, including medical imaging and remote sensing. Many greedy algorithms based on the family of hard thresholding operators have been developed to solve the…

Signal Processing · Electrical Eng. & Systems 2023-06-09 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Auto-regressive sequence generative models trained by Maximum Likelihood Estimation suffer the exposure bias problem in practical finite sample scenarios. The crux is that the number of training samples for Maximum Likelihood Estimation is…

Machine Learning · Statistics 2020-07-14 Yuxuan Song , Ning Miao , Hao Zhou , Lantao Yu , Mingxuan Wang , Lei Li

We investigate the recovery of nodes and amplitudes from noisy frequency samples in spike train signals, also known as the super-resolution (SR) problem. When the node separation falls below the Rayleigh limit, the problem becomes…

Numerical Analysis · Mathematics 2025-02-11 Nuha Diab

Astronomical time series from large-scale surveys like LSST are often irregularly sampled and incomplete, posing challenges for classification and anomaly detection. We introduce a new framework based on Neural Stochastic Delay Differential…

Machine Learning · Computer Science 2026-04-03 YongKyung Oh , Seungsu Kam , Dong-Young Lim , Sungil Kim

Consider the communication-constrained problem of nonparametric function estimation, in which each distributed terminal holds multiple i.i.d. samples. Under certain regularity assumptions, we characterize the minimax optimal rates for all…

Machine Learning · Computer Science 2025-01-15 Deheng Yuan , Tao Guo , Zhongyi Huang

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of…

Methodology · Statistics 2025-08-04 Peili Li , Zhuomei Li , Yunhai Xiao , Chao Ying , Zhou Yu

Parametric embedding methods such as parametric t-SNE (pt-SNE) have been widely adopted for data visualization and out-of-sample data embedding without further computationally expensive optimization or approximation. However, the…

Machine Learning · Computer Science 2018-04-24 Martin Renqiang Min , Hongyu Guo , Dinghan Shen