中文
相关论文

相关论文: Optimal Estimation of Slope Vector in High-dimensi…

200 篇论文

Nonparametric regression subject to convexity or concavity constraints is increasingly popular in economics, finance, operations research, machine learning, and statistics. However, the conventional convex regression based on the least…

统计方法学 · 统计学 2022-09-27 Zhiqiang Liao , Sheng Dai , Timo Kuosmanen

Convolutional Neural Networks (CNNs) have revolutionized image classification by extracting spatial features and enabling state-of-the-art accuracy in vision-based tasks. The squeeze and excitation network proposed module gathers…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Mahendran Narayanan

In high-dimensional linear regression, the goal pursued here is to estimate an unknown regression function using linear combinations of a suitable set of covariates. One of the key assumptions for the success of any statistical procedure in…

统计理论 · 数学 2015-03-13 Philippe Rigollet , Alexandre Tsybakov

Existing nonconvex statistical optimization theory and methods crucially rely on the correct specification of the underlying "true" statistical models. To address this issue, we take a first step towards taming model misspecification by…

机器学习 · 统计学 2017-12-19 Zhuoran Yang , Lin F. Yang , Ethan X. Fang , Tuo Zhao , Zhaoran Wang , Matey Neykov

In this paper, we describe a new way to get convergence rates for optimal methods in smooth (strongly) convex optimization tasks. Our approach is based on results for tasks where gradients have nonrandom small noises. Unlike previous…

最优化与控制 · 数学 2020-07-14 Darina Dvinskikh , Alexander Tyurin , Alexander Gasnikov , Sergey Omelchenko

We consider the high-dimensional discriminant analysis problem. For this problem, different methods have been proposed and justified by establishing exact convergence rates for the classification risk, as well as the l2 convergence results…

机器学习 · 统计学 2013-06-28 Mladen Kolar , Han Liu

Extracting multi-scale information is key to semantic segmentation. However, the classic convolutional neural networks (CNNs) encounter difficulties in achieving multi-scale information extraction: expanding convolutional kernel incurs the…

计算机视觉与模式识别 · 计算机科学 2019-07-09 Mo Zhang , Jie Zhao , Xiang Li , Li Zhang , Quanzheng Li

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

最优化与控制 · 数学 2020-07-15 Jineng Ren , Jarvis Haupt

We develop a new approach to robust adaptive beamforming in the presence of signal steering vector errors. Since the signal steering vector is known imprecisely, its presumed (prior) value is used to find a more accurate estimate of the…

信息论 · 计算机科学 2012-05-15 Arash Khabbazibasmenj , Sergiy A. Vorobyov , Aboulnasr Hassanien

We propose a semismooth Newton algorithm for pathwise optimization (SNAP) for the LASSO and Enet in sparse, high-dimensional linear regression. SNAP is derived from a suitable formulation of the KKT conditions based on Newton derivatives.…

机器学习 · 统计学 2018-10-10 Jian Huang , Yuling Jiao , Xiliang Lu , Yueyong Shi , Qinglong Yang

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

统计方法学 · 统计学 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen

Inferring network structures remains an interesting question for its importance on the understanding and controlling collective dynamics of complex systems. The existing shrinking methods such as Lasso-type estimation can not suitably…

统计理论 · 数学 2025-09-03 Lei Shi , Jie Hu , Huaiyu Tan , Libin Jin , Wei Zhong , Chen Shen

We consider approaches for improving the efficiency of algorithms for fitting nonconvex penalized regression models such as SCAD and MCP in high dimensions. In particular, we develop rules for discarding variables during cyclic coordinate…

统计计算 · 统计学 2016-07-20 Sangin Lee , Patrick Breheny

With the increasing prevalence of autonomous vehicles, it is essential for computer vision algorithms to accurately assess road features in real-time. This study explores the LaneSegNet architecture, a new approach to lane topology…

计算机视觉与模式识别 · 计算机科学 2024-08-01 William Stevens , Vishal Urs , Karthik Selvaraj , Gabriel Torres , Gaurish Lakhanpal

We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the…

机器学习 · 统计学 2018-02-16 Xingguo Li , Lin F. Yang , Jason Ge , Jarvis Haupt , Tong Zhang , Tuo Zhao

Sparse inverse covariance selection is a fundamental problem for analyzing dependencies in high dimensional data. However, such a problem is difficult to solve since it is NP-hard. Existing solutions are primarily based on convex…

数值分析 · 计算机科学 2018-04-05 Ganzhao Yuan , Haoxian Tan , Wei-Shi Zheng

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

最优化与控制 · 数学 2021-12-07 Rishabh Gupta , Qi Zhang

Consider a dataset of vector-valued observations that consists of noisy inliers, which are explained well by a low-dimensional subspace, along with some number of outliers. This work describes a convex optimization problem, called REAPER,…

信息论 · 计算机科学 2015-07-24 Gilad Lerman , Michael McCoy , Joel A. Tropp , Teng Zhang

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

机器学习 · 计算机科学 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

In this study, we propose a novel approach to predict the distances of the detected objects in an observed scene. The proposed approach modifies the recently proposed Convolutional Support Estimator Networks (CSENs). CSENs are designed to…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Mete Ahishali , Mehmet Yamac , Serkan Kiranyaz , Moncef Gabbouj