English
Related papers

Related papers: A Comparison of First-Difference and Forward Ortho…

200 papers

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving these problems due…

Optimization and Control · Mathematics 2025-03-24 Liang Zhang , Niao He , Michael Muehlebach

General ridge estimators are widely used in the general linear model because they possess desirable properties such as linear sufficiency and linear admissibility. However, when the covariance matrix of the error term is partially unknown,…

Statistics Theory · Mathematics 2026-01-27 Hirai Mukasa

We propose a family of optimization methods that achieve linear convergence using first-order gradient information and constant step sizes on a class of convex functions much larger than the smooth and strongly convex ones. This larger…

Optimization and Control · Mathematics 2018-09-14 Chris J. Maddison , Daniel Paulin , Yee Whye Teh , Brendan O'Donoghue , Arnaud Doucet

We provide the first convergence guarantees for the Consistency Models (CMs), a newly emerging type of one-step generative models that can generate comparable samples to those generated by Diffusion Models. Our main result is that, under…

Numerical Analysis · Mathematics 2023-08-23 Junlong Lyu , Zhitang Chen , Shoubo Feng

We develop new unbiased estimators of a number of quantities defined for functions of conditional moments, like conditional expectations and variances, of functions of two independent random variables given the first variable, including…

Computation · Statistics 2013-10-03 Tomasz Badowski

In this paper, we consider some aspects of the numerical analysis of the mathematical model of fractional Duffing with a derivative of variable fractional order of the Riemann-Liouville type. Using numerical methods: an explicit…

Numerical Analysis · Mathematics 2022-07-06 Valentine Kim , Roman Parovik

Fractional derivatives are a well-studied generalization of integer order derivatives. Naturally, for optimization, it is of interest to understand the convergence properties of gradient descent using fractional derivatives. Convergence…

Optimization and Control · Mathematics 2024-06-05 Ashwani Aggarwal

We derive a large deviation principle for random permutations induced by probability measures of the unit square, called permutons. These permutations are called $\mu$-random permutations. We also introduce and study a new general class of…

Probability · Mathematics 2023-04-04 Jacopo Borga , Sayan Das , Sumit Mukherjee , Peter Winkler

Different relativistic quantum mechanics approaches have recently been used to calculate properties of various systems, form factors in particular. It is known that predictions, which most often rely on a single-particle current…

Nuclear Theory · Physics 2008-11-26 Bertrand Desplanques , Yu Bing Dong

A time series forecasting model--which is typically built on a single time series--is known as a local time series model (tsLM). In contrast, a forecasting model trained on multiple time series is referred to as a global time series model…

Machine Learning · Computer Science 2025-11-10 Junru Ren , Shaomin Wu

In the current work we build a difference analog of the Caputo fractional derivative with generalized memory kernel ($_\lambda$L2-1$_\sigma$ formula). The fundamental features of this difference operator are studied and on its ground some…

Numerical Analysis · Mathematics 2021-08-25 Aslanbek Khibiev , Anatoly Alikhanov , Chengming Huang

We consider a discrete time analog of $G$--expectations and we prove that in the case where the time step goes to 0 the corresponding values converge to the original $G$--expectation. Furthermore we provide error estimates for the…

Probability · Mathematics 2011-09-16 Yan Dolinsky

In this paper, we propose two novel modulation concepts based on a simple maximum distance separable (MDS) code { and show that these concepts can achieve better error performance than index modulation (IM) and related schemes.} In the…

Signal Processing · Electrical Eng. & Systems 2021-08-11 Ferhat Yarkin , Justin P. Coon

The computation time required by standard finite difference methods with fixed timesteps for solving fractional diffusion equations is usually very large because the number of operations required to find the solution scales as the square of…

Numerical Analysis · Mathematics 2024-06-28 Santos B. Yuste , Joaquin Quintana-Murillo

Longitudinal models with dynamics governed by differential equations may require numerical integration alongside parameter estimation. We have identified a situation where the numerical integration introduces error in such a way that it…

Other Statistics · Statistics 2026-02-10 Tess O'Brien , Matthew T. Moores , David Warton , Daniel Falster

We present a new and easy-to-implement sequential sampling method for CGMY processes with either finite or infinite variation, exploiting the time change representation of the CGMY model and a decomposition of its time change. We find that…

Computational Finance · Quantitative Finance 2018-08-23 Chengwei Zhang , Zhiyuan Zhang

Variational inference lies at the core of many state-of-the-art algorithms. To improve the approximation of the posterior beyond parametric families, it was proposed to include MCMC steps into the variational lower bound. In this work we…

Machine Learning · Statistics 2016-09-28 Christopher Wolf , Maximilian Karl , Patrick van der Smagt

Orthogonal Monte Carlo (OMC) is a very effective sampling algorithm imposing structural geometric conditions (orthogonality) on samples for variance reduction. Due to its simplicity and superior performance as compared to its Quasi Monte…

Machine Learning · Computer Science 2020-05-29 Han Lin , Haoxian Chen , Tianyi Zhang , Clement Laroche , Krzysztof Choromanski

The maximum mean discrepancy (MMD) is a recently proposed test statistic for two-sample test. Its quadratic time complexity, however, greatly hampers its availability to large-scale applications. To accelerate the MMD calculation, in this…

Artificial Intelligence · Computer Science 2015-06-19 Ji Zhao , Deyu Meng

Measurement error is a pervasive issue which renders the results of an analysis unreliable. The measurement error literature contains numerous correction techniques, which can be broadly divided into those which aim to produce exactly…

Methodology · Statistics 2021-11-08 Dylan Spicker , Michael P Wallace , Grace Y Yi