English
Related papers

Related papers: Accelerating the pool-adjacent-violators algorithm…

200 papers

In this paper, we propose exact passive-aggressive (PA) online algorithms for learning to rank. The proposed algorithms can be used even when we have interval labels instead of actual labels for examples. The proposed algorithms solve a…

Machine Learning · Computer Science 2021-01-01 Naresh Manwani , Mohit Chandra

In this paper, we develop a parameterized proximal point algorithm (P-PPA) for solving a class of separable convex programming problems subject to linear and convex constraints. The proposed algorithm is provable to be globally convergent…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Hongchao Zhang , Jicheng Li

When self-adaptive systems encounter changes within their surrounding environments, they enact tactics to perform necessary adaptations. For example, a self-adaptive cloud-based system may have a tactic that initiates additional computing…

Artificial Intelligence · Computer Science 2020-04-24 Jeffrey Palmerino , Qi Yu , Travis Desell , Daniel E. Krutz

We construct an objective function that consists of a quadratic approximation term and a penalty term. Thanks to the quadratic approximation, we can deal with various kinds of loss functions into a unified way, and by taking advantage of…

Statistics Theory · Mathematics 2018-11-26 Takumi Suzuki , Nakahiro Yoshida

The Pandora's Box problem and its extensions capture optimization problems with stochastic input where the algorithm can obtain instantiations of input random variables at some cost. To our knowledge, all previous work on this class of…

Data Structures and Algorithms · Computer Science 2020-04-17 Shuchi Chawla , Evangelia Gergatsouli , Yifeng Teng , Christos Tzamos , Ruimin Zhang

This paper studies the distributed optimization problem over directed networks with noisy information-sharing. To resolve the imperfect communication issue over directed networks, a series of noise-robust variants of Push-Pull/AB method…

Optimization and Control · Mathematics 2023-07-28 Shengchao Zhao , Siyuan Song , Yongchao Liu

Stochastic Gradient Descent has been widely studied with classification accuracy as a performance measure. However, these stochastic algorithms cannot be directly used when non-decomposable pairwise performance measures are used such as…

Machine Learning · Statistics 2020-12-07 Soham Dan , Dushyant Sahoo

Linear and Quadratic Discriminant analysis (LDA/QDA) are common tools for classification problems. For these methods we assume observations are normally distributed within group. We estimate a mean and covariance matrix for each group and…

Machine Learning · Statistics 2011-12-08 Noah Simon , Rob Tibshirani

In this paper we study variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions. We introduce stochastic approximation schemes that employ an empirical estimate of the CVaR at each iteration to…

Optimization and Control · Mathematics 2020-08-28 Jasper Verbree , Ashish Cherukuri

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

Machine Learning · Statistics 2017-07-12 Gautam Ramachandra

Policy optimization on high-dimensional continuous control tasks exhibits its difficulty caused by the large variance of the policy gradient estimators. We present the action subspace dependent gradient (ASDG) estimator which incorporates…

Machine Learning · Computer Science 2019-05-30 Jiajin Li , Baoxiang Wang

We propose a pair-condensate variational approach (PCV) to determine a set of the most important collective pairs in the description of low-lying states in atomic nuclei. Having available the precise details on these key collective pairs --…

Nuclear Theory · Physics 2020-08-19 Y. Lei , H. Jiang , S. Pittel

This paper studies the convex isotonic regression with generalized order restrictions induced by a directed tree. The proposed model covers various intriguing optimization problems with shape or order restrictions, including the generalized…

Optimization and Control · Mathematics 2023-04-04 Xuyu Chen , Xudong Li , Yangfeng Su

In the dynamical systems approach to describing turbulent or otherwise chaotic flows, an important quantity is the Lyapunov exponents and vectors that characterize the strange attractor of the flow. In particular, knowledge of the Lyapunov…

Fluid Dynamics · Physics 2019-05-01 Malik Hassanaly , Venkat Raman

Variational quantum algorithms (VQAs) provide a promising approach to achieving quantum advantage for practical problems on near-term noisy intermediate-scale quantum (NISQ) devices. Thus far, most studies on VQAs have focused on…

Quantum Physics · Physics 2023-10-06 Yutaro Enomoto , Keitaro Anai , Kenta Udagawa , Shuntaro Takeda

We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to…

Artificial Intelligence · Computer Science 2024-08-05 Nicolò Dal Fabbro , Arman Adibi , H. Vincent Poor , Sanjeev R. Kulkarni , Aritra Mitra , George J. Pappas

Vision-Language-Action systems follow instructions to execute multi-step tasks in multimodal environments. Recent VLA approaches typically rely on post-hoc correction mechanisms or operate under fixed task decompositions and alignment…

Artificial Intelligence · Computer Science 2026-05-12 Xiyin Zeng , Yuyu Sun , Haoyang Li , Shouqiang Liu , Hao Wang

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Current approaches for explaining machine learning models fall into two distinct classes: antecedent event influence and value attribution. The former leverages training instances to describe how much influence a training point exerts on a…

Machine Learning · Computer Science 2019-01-30 Umang Bhatt , Pradeep Ravikumar , Jose M. F. Moura