中文
相关论文

相关论文: Nonconvex Linear System Identification with Minima…

200 篇论文

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

统计理论 · 数学 2024-03-06 Xin Li , Dongya Wu

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

机器学习 · 计算机科学 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

We study a nonconvex optimization algorithmic approach to phase retrieval and the more general problem of semidefinite low-rank matrix sensing. Specifically, we analyze the nonconvex landscape of a quartic Burer-Monteiro factored…

最优化与控制 · 数学 2026-04-20 Andrew D. McRae

The nuclear norm is widely used as a convex surrogate of the rank function in compressive sensing for low rank matrix recovery with its applications in image recovery and signal processing. However, solving the nuclear norm based relaxed…

机器学习 · 计算机科学 2016-01-20 Canyi Lu , Jinhui Tang , Shuicheng Yan , Zhouchen Lin

The low-rank matrix reconstruction (LRMR) approach is widely used in direction-of-arrival (DOA) estimation. As the rank norm penalty in an LRMR is NP-hard to compute, the nuclear norm (or the trace norm for a positive semidefinite (PSD)…

信息论 · 计算机科学 2017-12-07 Xiaohuan Wu , Wei-Ping Zhu , Jun Yan

Low-rank matrix models have been universally useful for numerous applications, from classical system identification to more modern matrix completion in signal processing and statistics. The nuclear norm has been employed as a convex…

统计理论 · 数学 2023-03-06 Kiryung Lee , Rakshith Sharma Srinivasa , Marius Junge , Justin Romberg

Matrix learning is at the core of many machine learning problems. A number of real-world applications such as collaborative filtering and text mining can be formulated as a low-rank matrix completion problem, which recovers incomplete…

机器学习 · 计算机科学 2021-02-23 Yaqing Wang , Quanming Yao , James T. Kwok

In this paper, we present an equivalent convex optimization formulation for discrete-time stochastic linear systems subject to linear chance constraints, alongside a tight convex relaxation for quadratic chance constraints. By lifting the…

系统与控制 · 电气工程与系统科学 2026-03-23 Tanmay Dokania , Yashwanth Kumar Nakka

Within the tensor singular value decomposition (T-SVD) framework, existing robust low-rank tensor completion approaches have made great achievements in various areas of science and engineering. Nevertheless, these methods involve the T-SVD…

机器学习 · 计算机科学 2023-05-22 Wenjin Qin , Hailin Wang , Feng Zhang , Weijun Ma , Jianjun Wang , Tingwen Huang

Convex optimization problems with staged structure appear in several contexts, including optimal control, verification of deep neural networks, and isotonic regression. Off-the-shelf solvers can solve these problems but may scale poorly. We…

最优化与控制 · 数学 2020-10-28 Rudy Bunel , Oliver Hinder , Srinadh Bhojanapalli , Krishnamurthy , Dvijotham

This paper investigates the Sensor Network Localization (SNL) problem, which seeks to determine sensor locations based on known anchor locations and partially given anchors-sensors and sensors-sensors distances. Two primary methods for…

最优化与控制 · 数学 2023-08-09 Mingyu Lei , Jiayu Zhang , Yinyu Ye

We present a new approach to learning the structure and parameters of a Bayesian network based on regularized estimation in an exponential family representation. Here we show that, given a fixed variable order, the optimal structure and…

机器学习 · 计算机科学 2012-07-02 Yuhong Guo , Dale Schuurmans

Modeling unknown systems from data is a precursor of system optimization and sequential decision making. In this paper, we focus on learning a Markov model from a single trajectory of states. Suppose that the transition model has a small…

统计方法学 · 统计学 2020-11-30 Ziwei Zhu , Xudong Li , Mengdi Wang , Anru Zhang

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

机器学习 · 统计学 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

Rank minimization (RM) is a wildly investigated task of finding solutions by exploiting low-rank structure of parameter matrices. Recently, solving RM problem by leveraging non-convex relaxations has received significant attention. It has…

机器学习 · 计算机科学 2018-09-17 Zaiyi Chen

This paper presents a two-stage online algorithm for recovery of low-rank parameter matrix in non-stationary stochastic systems. The first stage applies the recursive least squares (RLS) estimator combined with its singular value…

系统与控制 · 电气工程与系统科学 2025-06-25 Yanxin Fu , Junbao Zhou , Yu Hu , Wenxiao Zhao

Low rank matrix recovery is the focus of many applications, but it is a NP-hard problem. A popular way to deal with this problem is to solve its convex relaxation, the nuclear norm regularized minimization problem (NRM), which includes…

最优化与控制 · 数学 2019-09-17 Pan Shang , Lingchen Kong

We address the problem of designing stabilizing control policies for nonlinear systems in discrete-time, while minimizing an arbitrary cost function. When the system is linear and the cost is convex, the System Level Synthesis (SLS)…

系统与控制 · 电气工程与系统科学 2023-01-03 Luca Furieri , Clara Lucía Galimberti , Giancarlo Ferrari-Trecate

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Function approximation from input and output data is one of the most investigated problems in signal processing. This problem has been tackled with various signal processing and machine learning methods. Although tensors have a rich history…

统计理论 · 数学 2023-02-16 Christina Auer , Thomas Paireder , Oliver Ploder , Oliver Lang , Mario Huemer