English
Related papers

Related papers: $L_1$-Based Adaptive Identification with Saturated…

200 papers

This paper presents a number of new findings about the canonical change point estimation problem. The first part studies the estimation of a change point on the real line in a simple stump model using the robust Huber estimating function…

Statistics Theory · Mathematics 2021-05-26 Debarghya Mukherjee , Moulinath Banerjee , Ya'acov Ritov

The tracking method based on the extreme learning machine (ELM) is efficient and effective. ELM randomly generates input weights and biases in the hidden layer, and then calculates and computes the output weights by reducing the iterative…

Machine Learning · Computer Science 2018-07-27 Jing Zhang , Huibing Wang , Yonggong Ren

Estimating causal effects from observational data informs us about which factors are important in an autonomous system, and enables us to take better decisions. This is important because it has applications in selecting a treatment in…

Machine Learning · Computer Science 2021-10-29 Plabon Shaha , Talha Islam Zadid , Ismat Rahman , Md. Mosaddek Khan

We present a novel algorithm that allows us to gain detailed insight into the effects of sparsity in linear and nonlinear optimization, which is of great importance in many scientific areas such as image and signal processing, medical…

Optimization and Control · Mathematics 2021-09-23 Katharina Bieker , Bennet Gebken , Sebastian Peitz

Adaptive random search approaches have been shown to be effective for global optimization problems, where under certain conditions, the expected performance time increases only linearly with dimension. However, previous analyses assume that…

Optimization and Control · Mathematics 2022-03-22 David D. Linz , Zelda B. Zabinsky

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

Machine Learning · Computer Science 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao

The $\ell_1$ norm is the tight convex relaxation for the $\ell_0$ "norm" and has been successfully applied for recovering sparse signals. For problems with fewer samplings, one needs to enhance the sparsity by nonconvex penalties such as…

Optimization and Control · Mathematics 2016-01-05 Xiaolin Huang , Lei Shi , Ming Yan

Tracking-by-detection has become an attractive tracking technique, which treats tracking as a category detection problem. However, the task in tracking is to search for a specific object, rather than an object category as in detection. In…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Changxin Gao , Feifei Chen , Jin-Gang Yu , Rui Huang , Nong Sang

Plausible identification of conditional average treatment effects (CATEs) may rely on controlling for a large number of variables to account for confounding factors. In these high-dimensional settings, estimation of the CATE requires…

Econometrics · Economics 2023-01-18 Adam Baybutt , Manu Navjeevan

We study the problem of system identification and adaptive control in partially observable linear dynamical systems. Adaptive and closed-loop system identification is a challenging problem due to correlations introduced in data collection.…

Machine Learning · Computer Science 2020-06-25 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

The state-of-the-art performance on entity resolution (ER) has been achieved by deep learning. However, deep models are usually trained on large quantities of accurately labeled training data, and can not be easily tuned towards a target…

Machine Learning · Computer Science 2022-04-12 Zhaoqiang Chen , Qun Chen , Youcef Nafa , Tianyi Duan , Wei Pan , Lijun Zhang , Zhanhuai Li

We propose two sparsity-aware normalized subband adaptive filter (NSAF) algorithms by using the gradient descent method to minimize a combination of the original NSAF cost function and the l1-norm penalty function on the filter…

Signal Processing · Electrical Eng. & Systems 2018-10-18 Y. Yu , H. Zhao , R. C. de Lamare

We study causal effect estimation from a mixture of observational and interventional data in a confounded linear regression model with multivariate treatments. We show that the statistical efficiency in terms of expected squared error can…

Many real-life dynamical systems change abruptly followed by almost stationary periods. In this paper, we consider streams of data with such abrupt behavior and investigate the problem of tracking their statistical properties in an online…

Methodology · Statistics 2019-01-16 Hugo Lewi Hammer , Anis Yazidi

This paper studies the problem of recursively estimating the weighted adjacency matrix of a network out of a temporal sequence of binary-valued observations. The observation sequence is generated from nonlinear networked dynamics in which…

Systems and Control · Electrical Eng. & Systems 2019-12-06 Yu Xing , Xingkang He , Haitao Fang , Karl Henrik Johansson

P-splines are penalized B-splines, in which finite order differences in coefficients are typically penalized with an $\ell_2$ norm. P-splines can be used for semiparametric regression and can include random effects to account for…

Methodology · Statistics 2018-11-01 Brian D. Segal , Michael R. Elliott , Thomas Braun , Hui Jiang

In this paper, we introduce a weighted $\ell_2/\ell_1$ minimization to recover block sparse signals with arbitrary prior support information. When partial prior support information is available, a sufficient condition based on the high…

Information Theory · Computer Science 2017-06-30 Wengu Chen , Huanmin Ge

In this paper we study the problem of learning a shallow artificial neural network that best fits a training data set. We study this problem in the over-parameterized regime where the number of observations are fewer than the number of…

Machine Learning · Computer Science 2022-08-25 Mahdi Soltanolkotabi , Adel Javanmard , Jason D. Lee

We study identification and estimation of causal effects in settings with panel data. Traditionally researchers follow model-based identification strategies relying on assumptions governing the relation between the potential outcomes and…

Econometrics · Economics 2022-02-18 Dmitry Arkhangelsky , Guido W. Imbens

Time series anomaly detection is widely used in IoT and cyber-physical systems, yet its evaluation remains challenging due to diverse application objectives and heterogeneous metric assumptions. This study introduces a problem-oriented…

Artificial Intelligence · Computer Science 2026-05-15 Kaixiang Yang , Jiarong Liu , Yupeng Song , Shuanghua Yang , Yujue Zhou