中文
相关论文

相关论文: A Newton-Like Algorithm for Likelihood Maximizatio…

200 篇论文

This paper proposes a new robust smooth-threshold estimating equation to select important variables and automatically estimate parameters for high dimensional longitudinal data. A novel working correlation matrix is proposed to capture…

统计方法学 · 统计学 2021-11-30 Liya Fu , Jiaqi Li , You-Gan Wang

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

机器学习 · 计算机科学 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

We consider the robust estimation of the parameters of multivariate Gaussian linear regression models. To this aim we consider robust version of the usual (Mahalanobis) least-square criterion, with or without Ridge regularization. We…

统计理论 · 数学 2025-10-13 Antoine Godichon-Baggioni , Stephane S. Robin , Laure Sansonnet

Total generalization variation (TGV) is a very powerful and important regularization for various inverse problems and computer vision tasks. In this paper, we proposed a semismooth Newton based augmented Lagrangian method to solve this…

最优化与控制 · 数学 2022-01-28 Hongpeng Sun

Finding feasible points for which the proof succeeds is a critical issue in safe Branch and Bound algorithms which handle continuous problems. In this paper, we introduce a new strategy to compute very accurate approximations of feasible…

数值分析 · 计算机科学 2008-07-16 Alexandre Goldsztejn , Yahia Lebbah , Claude Michel , Michel Rueher

In this paper, we proposed a new technique, {\em variance controlled stochastic gradient} (VCSG), to improve the performance of the stochastic variance reduced gradient (SVRG) algorithm. To avoid over-reducing the variance of gradient by…

机器学习 · 计算机科学 2021-02-22 Jia Bi , Steve R. Gunn

In this paper, an efficient modified Newton type algorithm is proposed for nonlinear unconstrianed optimization problems. The modified Hessian is a convex combination of the identity matrix (for steepest descent algorithm) and the Hessian…

最优化与控制 · 数学 2015-10-09 Yaguang Yang

Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools…

机器学习 · 计算机科学 2022-01-28 Łukasz Kidziński , Francis K. C. Hui , David I. Warton , Trevor Hastie

We consider the problem of risk-sensitive control in a reinforcement learning (RL) framework. In particular, we aim to find a risk-optimal policy by maximizing the distortion riskmetric (DRM) of the discounted reward in a finite horizon…

机器学习 · 计算机科学 2025-08-12 Soumen Pachal , Mizhaan Prajit Maniyar , Prashanth L. A

We present a novel $Q$-learning algorithm tailored to solve distributionally robust Markov decision problems where the corresponding ambiguity set of transition probabilities for the underlying Markov decision process is a Wasserstein ball…

机器学习 · 计算机科学 2024-06-21 Ariel Neufeld , Julian Sester

We introduce varbvs, a suite of functions written in R and MATLAB for regression analysis of large-scale data sets using Bayesian variable selection methods. We have developed numerical optimization algorithms based on variational…

统计计算 · 统计学 2017-09-21 Peter Carbonetto , Xiang Zhou , Matthew Stephens

The paper studies the solution of stochastic optimization problems in which approximations to the gradient and Hessian are obtained through subsampling. We first consider Newton-like methods that employ these approximations and discuss how…

最优化与控制 · 数学 2016-09-28 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

数值分析 · 数学 2014-08-12 Ming Gu

Rank minimization can be converted into tractable surrogate problems, such as Nuclear Norm Minimization (NNM) and Weighted NNM (WNNM). The problems related to NNM, or WNNM, can be solved iteratively by applying a closed-form proximal…

计算机视觉与模式识别 · 计算机科学 2019-02-18 Tae-Hyun Oh , Yasuyuki Matsushita , Yu-Wing Tai , In So Kweon

We study the problem of minimizing a sum of convex objective functions where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of…

最优化与控制 · 数学 2015-04-24 Aryan Mokhtari , Qing Ling , Alejandro Ribeiro

Deep convolutional neural networks have been widely used in scene classification of remotely sensed images. In this work, we propose a robust learning method for the task that is secure against partially incorrect categorization of images.…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Jinyang Wang , Tao Wang , Min Gan , George Hadjichristofi

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

统计方法学 · 统计学 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

We consider minimizing a smooth and strongly convex objective function using a stochastic Newton method. At each iteration, the algorithm is given an oracle access to a stochastic estimate of the Hessian matrix. The oracle model includes…

最优化与控制 · 数学 2022-11-29 Sen Na , Michał Dereziński , Michael W. Mahoney

We consider a problem of placing generators of rewards to be collected by randomly moving agents in a network. In many settings, the precise mobility pattern may be one of several possible, based on parameters outside our control, such as…

多智能体系统 · 计算机科学 2024-06-04 Petros Petsinis , Kaichen Zhang , Andreas Pavlogiannis , Jingbo Zhou , Panagiotis Karras

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

机器学习 · 统计学 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi