English
Related papers

Related papers: Statistical Analysis of Block Coordinate Descent A…

200 papers

The order statistics based list decoding techniques for linear binary block codes of small to medium block length are investigated. The construction of the list of the test error patterns is considered. The original order statistics…

Information Theory · Computer Science 2011-01-27 Saif E. A. Alnawayseh , Pavel Loskot

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Jeffrey D. Scargle , Jay P. Norris , Brad Jackson , James Chiang

We use stochastic network calculus to investigate the delay performance of a multiuser MISO system with zero-forcing beamforming. First, we consider ideal assumptions with long codewords and perfect CSI at the transmitter, where we observe…

Information Theory · Computer Science 2018-06-27 Sebastian Schiessl , James Gross , Mikael Skoglund , Giuseppe Caire

In this article the most fundamental decomposition-based optimization method - block coordinate search, based on the sequential decomposition of problems in subproblems - and building performance simulation programs are used to reason about…

Optimization and Control · Mathematics 2016-09-12 Gian Luca Brunetti

Decision-making problems are commonly formulated as optimization problems, which are then solved to make optimal decisions. In this work, we consider the inverse problem where we use prior decision data to uncover the underlying…

Optimization and Control · Mathematics 2022-12-27 Rishabh Gupta , Qi Zhang

Block-oriented nonlinear models are popular in nonlinear system identification because of their advantages of being simple to understand and easy to use. Many different identification approaches were developed over the years to estimate the…

Systems and Control · Computer Science 2018-01-10 Maarten Schoukens , Koen Tiels

Coordinate descent methods have considerable impact in global optimization because global (or, at least, almost global) minimization is affordable for low-dimensional problems. Coordinate descent methods with high-order regularized models…

Optimization and Control · Mathematics 2023-04-28 V. S. Amaral , R. Andreani , E. G. Birgin , D. S. Marcondes , J. M. Martínez

In this paper, we consider a multiple-input single-output (MISO) linear time-varying system whose output is a superposition of scaled and time-frequency shifted versions of inputs. The goal of this paper is to determine system…

Information Theory · Computer Science 2020-11-24 Shahedeh Sayyari , Sajad Daei , Farzan Haddadi

In this paper we present a novel randomized block coordinate descent method for the minimization of a convex composite objective function. The method uses (approximate) partial second-order (curvature) information, so that the algorithm…

Optimization and Control · Mathematics 2015-05-11 Kimon Fountoulakis , Rachael Tappenden

In this paper we develop random block coordinate gradient descent methods for minimizing large scale linearly constrained separable convex problems over networks. Since we have coupled constraints in the problem, we devise an algorithm that…

Optimization and Control · Mathematics 2015-12-14 I. Necoara , Yu. Nesterov , F. Glineur

Asynchronous-parallel algorithms have the potential to vastly speed up algorithms by eliminating costly synchronization. However, our understanding to these algorithms is limited because the current convergence of asynchronous (block)…

Optimization and Control · Mathematics 2017-07-20 Tao Sun , Robert Hannah , Wotao Yin

This paper develops some extensions to the work of [1] which studied the continuous-time adaptive output tracking control schemes with the reference output signal generated from an unknown reference model system. The presented extensions…

Systems and Control · Electrical Eng. & Systems 2024-12-17 Gang Tao

We propose and analyze a block coordinate descent proximal algorithm (BCD-prox) for simultaneous filtering and parameter estimation of ODE models. As we show on ODE systems with up to d=40 dimensions, as compared to state-of-the-art…

Machine Learning · Computer Science 2019-05-28 Ramin Raziperchikolaei , Harish S. Bhat

In this paper, we study the system identification problem for sparse linear time-invariant systems. We propose a sparsity promoting block-regularized estimator to identify the dynamics of the system with only a limited number of input-state…

Systems and Control · Computer Science 2018-08-28 Salar Fattahi , Somayeh Sojoudi

This paper addresses the problem of learning a sparse structure Bayesian network from high-dimensional discrete data. Compared to continuous Bayesian networks, learning a discrete Bayesian network is a challenging problem due to the large…

Machine Learning · Computer Science 2022-09-27 Nazanin Shajoonnezhad , Amin Nikanjam

Software for computation of maximum likelihood estimates in linear structural equation models typically employs general techniques from non-linear optimization, such as quasi-Newton methods. In practice, careful tuning of initial values is…

Computation · Statistics 2016-10-12 Mathias Drton , Christopher Fox , Y. Samuel Wang

The performance of a conventional model-based controller significantly depends on the accuracy of the modeled dynamics. The model of a plant's dynamics is subjected to errors in estimating the numerical values of the physical parameters,…

Optimization and Control · Mathematics 2017-06-14 Mohammad Reza Amini , Mahdi Shahbakhti , Selina Pan

We propose a unifying framework for the automated computer-assisted worst-case analysis of cyclic block coordinate algorithms in the unconstrained smooth convex optimization setup. We compute exact worst-case bounds for the cyclic…

Optimization and Control · Mathematics 2022-12-01 Yassine Kamri , Julien M. Hendrickx , François Glineur

We propose a new selection rule for the coordinate selection in coordinate descent methods for huge-scale optimization. The efficiency of this novel scheme is provably better than the efficiency of uniformly random selection, and can reach…

Machine Learning · Computer Science 2017-06-27 Sebastian U. Stich , Anant Raj , Martin Jaggi

Many applications in mechanical, acoustic, and electronic engineering require estimating complex dynamical models, often represented as additive multi-input multi-output (MIMO) transfer functions with structural constraints. This paper…

Systems and Control · Electrical Eng. & Systems 2025-05-21 Rodrigo A. González , Maarten van der Hulst , Koen Classens , Tom Oomen