English
Related papers

Related papers: Generalized Sequential Differential Calculus for E…

200 papers

Stochastic gradient descent (SGD) is a popular algorithm for minimizing objective functions that arise in machine learning. For constant step-sized SGD, the iterates form a Markov chain on a general state space. Focusing on a class of…

Optimization and Control · Mathematics 2025-03-26 David Shirokoff , Philip Zaleski

This dissertation focuses on developing a new construction of a functional calculus using Henstock-Kurzweil integration methods. The assignment of a functional calculus will be applied to self-adjoint operators. We will address both the…

Functional Analysis · Mathematics 2025-11-18 Marin Matei-Luca

This work provides a systematic study of the variational properties of decomposable functions which are compositions of an outer support function and an inner smooth mapping under certain constraint qualifications. A particular focus is put…

Optimization and Control · Mathematics 2024-08-20 Wenqing Ouyang , Andre Milzarek

Many problems involve the use of models which learn probability distributions or incorporate randomness in some way. In such problems, because computing the true expected gradient may be intractable, a gradient estimator is used to update…

Machine Learning · Computer Science 2022-12-29 Ronan Keane , H. Oliver Gao

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic

This paper is devoted to the study of generalized subdifferentials of spectral functions over Euclidean Jordan algebras. Spectral functions appear often in optimization problems playing the role of "regularizer", "barrier", "penalty…

Optimization and Control · Mathematics 2021-09-27 Bruno F. Lourenço , Akiko Takeda

We define an analogue of the classical Mittag-Leffler function which is applied to two variables, and establish its basic properties. Using a corresponding single-variable function with fractional powers, we define an associated fractional…

Classical Analysis and ODEs · Mathematics 2021-05-03 Arran Fernandez , Cemaliye Kürt , Mehmet Ali Özarslan

We consider generalized gradients in the general context of $G$-structures. They are natural first order differential operators acting on sections of vector bundles associated to irreducible $G$-representations. We study their geometric…

Differential Geometry · Mathematics 2009-08-18 Mihaela Pilca

Categorical random variables are a common staple in machine learning methods and other applications across disciplines. Many times, correlation within categorical predictors exists, and has been noted to have an effect on various algorithm…

Probability · Mathematics 2017-01-25 Rachel Traylor

Recently defined expectile regions capture the idea of centrality with respect to a multivariate distribution, but fail to describe the tail behavior while it is not at all clear what should be understood by a tail of a multivariate…

Statistics Theory · Mathematics 2023-12-18 Ha Thi Khanh Linh , Andreas H Hamel

In this article, the existence and uniqueness about the solution for a class of stochastic fractional-order differential equation systems are investigated, where the fractional derivative is described in Caputo sense. The fractional…

Numerical Analysis · Mathematics 2016-11-24 Guang-an Zou , Bo Wang

Integral transformations are used to estimate high order derivatives of various special functions. Applications are given to numerical integration, where estimates of high order derivatives of the integrand are needed to achieve bounds on…

Numerical Analysis · Mathematics 2007-06-21 David M. Bradley

This work develops, from a functional analytic perspective, the construction of random variables in Lebesgue spaces L^p. It extends classical notions of measurability, integrability, and expectation to L^p valued functions, using Pettis's…

In a nutshell, submodular functions encode an intuitive notion of diminishing returns. As a result, submodularity appears in many important machine learning tasks such as feature selection and data summarization. Although there has been a…

Data Structures and Algorithms · Computer Science 2018-03-19 Marko Mitrovic , Moran Feldman , Andreas Krause , Amin Karbasi

We consider the problem of minimizing the sum of two convex functions: one is the average of a large number of smooth component functions, and the other is a general convex function that admits a simple proximal mapping. We assume the whole…

Optimization and Control · Mathematics 2014-03-20 Lin Xiao , Tong Zhang

We develop a methodology to learn finitely generated random iterated function systems from time-series of partial observations using delay embeddings. We obtain a minimal model representation for the observed dynamics, using a hidden…

Dynamical Systems · Mathematics 2025-08-20 Emilia Gibson , Jeroen S. W. Lamb

We study sequential probability assignment in the Gaussian setting, where the goal is to predict, or equivalently compress, a sequence of real-valued observations almost as well as the best Gaussian distribution with mean constrained to a…

Information Theory · Computer Science 2025-05-27 Jaouad Mourtada

In 2023 in (3), Uwe finds the explicit form of the map which is which is settled in ZN of finite functional degree and14 discusses how to compute its usual degree w.r.t to the derivative in the linear form, i.e. the product of ones formed…

General Mathematics · Mathematics 2025-03-27 Yunting Iris Gao

We review the recent generalized fractional calculus of variations. We consider variational problems containing generalized fractional integrals and derivatives and study them using indirect methods. In particular, we provide necessary…

Optimization and Control · Mathematics 2014-05-13 Tatiana Odzijewicz , Delfim F. M. Torres

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt