English
Related papers

Related papers: Empirical risk minimization algorithm for multicla…

200 papers

We compute profile likelihoods for a stochastic model of diffusive transport motivated by experimental observations of heat conduction in layered skin tissues. This process is modelled as a random walk in a layered one-dimensional material,…

We revisit the problem of the existence of the maximum likelihood estimate for multi-class logistic regression. We show that one method of ensuring its existence is by assigning positive probability to every class in the sample dataset. The…

Machine Learning · Computer Science 2024-05-09 Dwight Nwaigwe , Marek Rychlik

In recent years many sparse linear discriminant analysis methods have been proposed for high-dimensional classification and variable selection. However, most of these proposals focus on binary classification and they are not directly…

Methodology · Statistics 2015-04-23 Qing Mai , Yi Yang , Hui Zou

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda

We propose a nonparametric estimation for a class of fractional stochastic differential equations (FSDE) with random effects. We precisely consider general linear fractional stochastic differential equations with drift depending on random…

Statistics Theory · Mathematics 2019-01-18 M. El Omari , H. El Maroufy , C. Fuchs

This paper addresses the nonparametric estimation of the drift function over a compact domain for a time-homogeneous diffusion process, based on high-frequency discrete observations from $N$ independent trajectories. We propose a neural…

Machine Learning · Statistics 2026-04-01 Yuzhen Zhao , Yating Liu , Marc Hoffmann

We prove convergence of the proximal policy gradient method for a class of constrained stochastic control problems with control in both the drift and diffusion of the state process. The problem requires either the running or terminal cost…

Optimization and Control · Mathematics 2025-05-27 Ashley Davey , Harry Zheng

In this paper, we aim to study the diffusion approximation for multi-scale McKean-Vlasov stochastic differential equations. More precisely, we prove the weak convergence of slow process $X^\varepsilon$ in $C([0,T];\mathbb{R}^n)$ towards the…

Probability · Mathematics 2022-06-07 Wei Hong , Shihu Li , Xiaobin Sun

This paper proposes a theoretical framework to evaluate and compare the performance of stochastic gradient algorithms for distributed learning in relation to their behavior around local minima in nonconvex environments. Previous works have…

Machine Learning · Computer Science 2025-07-03 Ying Cao , Zhaoxian Wu , Kun Yuan , Ali H. Sayed

We consider stochastic gradient descent and its averaging variant for binary classification problems in a reproducing kernel Hilbert space. In the traditional analysis using a consistency property of loss functions, it is known that the…

Machine Learning · Statistics 2022-07-26 Atsushi Nitanda , Taiji Suzuki

We present a framework leveraging a novel variant of the model-based diffusion algorithm to minimize the time required for a redundant dual-arm robot configuration to follow a desired relative Cartesian path. Our prior work proposed a…

Robotics · Computer Science 2026-04-21 Jushan Chen , Jonathan Fried , Santiago Paternain

Tensor-based discrete density estimation requires flexible modeling and proper divergence criteria to enable effective learning; however, traditional approaches using $\alpha$-divergence face analytical challenges due to the $\alpha$-power…

Machine Learning · Statistics 2025-05-26 Kazu Ghalamkari , Jesper Løve Hinrich , Morten Mørup

We propose a new simple and explicit numerical scheme for time-homogeneous stochastic differential equations. The scheme is based on sampling increments at each time step from a skew-symmetric probability distribution, with the level of…

Probability · Mathematics 2025-07-08 Yuga Iguchi , Samuel Livingstone , Nikolas Nüsken , Giorgos Vasdekis , Rui-Yang Zhang

We consider a Poisson equation in $\mathbb R^d$ for the elliptic operator corresponding to an ergodic diffusion process. Optimal regularity and smoothness with respect to the parameter are obtained under mild conditions on the coefficients.…

Probability · Mathematics 2020-09-11 Michael Röckner , Longjie Xie

We define two algorithms for propagating information in classification problems with pairwise relationships. The algorithms are based on contraction maps and are related to non-linear diffusion and random walks on graphs. The approach is…

Data Structures and Algorithms · Computer Science 2019-05-16 Pedro F. Felzenszwalb , Benar F. Svaiter

We present a graph-based variational algorithm for multiclass classification of high-dimensional data, motivated by total variation techniques. The energy functional is based on a diffuse interface model with a periodic potential. We…

Machine Learning · Statistics 2012-12-06 Cristina Garcia-Cardona , Arjuna Flenner , Allon G. Percus

In this work we investigate to which extent one can recover class probabilities within the empirical risk minimization (ERM) paradigm. The main aim of our paper is to extend existing results and emphasize the tight relations between…

Machine Learning · Computer Science 2020-07-22 Alexander Mey , Marco Loog

We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a…

In this work, we analyze the generalization ability of distributed online learning algorithms under stationary and non-stationary environments. We derive bounds for the excess-risk attained by each node in a connected network of learners…

Optimization and Control · Mathematics 2016-07-19 Zaid J. Towfic , Jianshu Chen , Ali H. Sayed

We study parameter estimation for univariate stochastic differential equations with locally Lipschitz drift and H\"older continuous multiplicative diffusion, a class commonly arising in several applications. Existing inference methods…

Methodology · Statistics 2026-05-19 Bowen Fang , Dario Spanò , Massimiliano Tamborrino
‹ Prev 1 4 5 6 7 8 10 Next ›