English
Related papers

Related papers: Stable Learning via Sparse Variable Independence

200 papers

While flow matching is elegant, its reliance on single-sample conditional velocities leads to high-variance training targets that destabilize optimization and slow convergence. By explicitly characterizing this variance, we identify 1) a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Donglin Yang , Yongxing Zhang , Xin Yu , Liang Hou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Renjie Liao

In visual-based Reinforcement Learning (RL), agents often struggle to generalize well to environmental variations in the state space that were not observed during training. The variations can arise in both task-irrelevant features, such as…

Artificial Intelligence · Computer Science 2023-12-25 Sili Huang , Yanchao Sun , Jifeng Hu , Siyuan Guo , Hechang Chen , Yi Chang , Lichao Sun , Bo Yang

This paper presents a sparse Bayesian learning (SBL) algorithm for linear inverse problems with a high order total variation (HOTV) sparsity prior. For the problem of sparse signal recovery, SBL often produces more accurate estimates than…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Victor Churchill , Anne Gelb

Testing the independence between random vectors is a fundamental problem in statistics. Distance correlation, a recently popular dependence measure, is universally consistent for testing independence against all distributions with finite…

Methodology · Statistics 2024-08-22 Yuwei Ke , Hok Kan Ling , Yanglei Song

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

The Broad Learning System (BLS) has gained significant attention for its computational efficiency and less network parameters compared to deep learning structures. However, the standard BLS relies on the pseudoinverse solution, which…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Zijing Li

In this paper I present a new approach for regression of time series using their own samples. This is a celebrated problem known as Auto-Regression. Dealing with outlier or missed samples in a time series makes the problem of estimation…

Artificial Intelligence · Computer Science 2015-08-19 Mohsen Joneidi

The problem of covariance estimation for replicated surface-valued processes is examined from the functional data analysis perspective. Considerations of statistical and computational efficiency often compel the use of separability of the…

Methodology · Statistics 2021-10-25 Tomas Masak , Victor M. Panaretos

Block-sparse signal recovery without knowledge of block sizes and boundaries, such as those encountered in multi-antenna mmWave channel models, is a hard problem for compressed sensing (CS) algorithms. We propose a novel Sparse Bayesian…

Signal Processing · Electrical Eng. & Systems 2021-02-17 Aditya Sant , Markus Leinonen , Bhaskar D. Rao

Billions of people use chopsticks, a simple yet versatile tool, for fine manipulation of everyday objects. The small, curved, and slippery tips of chopsticks pose a challenge for picking up small objects, making them a suitably complex test…

Robotics · Computer Science 2020-11-16 Liyiming Ke , Jingqiang Wang , Tapomayukh Bhattacharjee , Byron Boots , Siddhartha Srinivasa

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang

In this work, we extend the sparse iterative covariance-based estimator (SPICE), by generalizing the formulation to allow for different norm constraints on the signal and noise parameters in the covariance model. For a given norm, the…

Methodology · Statistics 2017-04-21 Johan Swärd , Stefan Ingi Adalbjörnsson , Andreas Jakobsson

We examine the linear regression problem in a challenging high-dimensional setting with correlated predictors where the vector of coefficients can vary from sparse to dense. In this setting, we propose a combination of probabilistic…

Methodology · Statistics 2025-05-13 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Stability arguments are often used to prevent learning algorithms from having ever increasing activity and weights that hinder generalization. However, stability conditions can clash with the sparsity required to augment the energy…

Neural and Evolutionary Computing · Computer Science 2024-01-08 Luca Herranz-Celotti , Jean Rouat

This paper deals with the problem of covariance stabilization for a class of linear stochastic discrete-time systems in the Stochastic Model Predictive Control (SMPC) framework. The considered systems are affected by independent and…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Kaouther Moussa , Dimitri Peaucelle

Deep latent generative models have attracted increasing attention due to the capacity of combining the strengths of deep learning and probabilistic models in an elegant way. The data representations learned with the models are often…

Machine Learning · Computer Science 2023-04-04 Zhao Xu , Daniel Onoro Rubio , Giuseppe Serra , Mathias Niepert

Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing. However, existing methods have limited scalability. In this paper, instead of convolving with a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

In this paper, we focus on the variable selection techniques for a class of semiparametric spatial regression models which allow one to study the effects of explanatory variables in the presence of the spatial information. The spatial…

Methodology · Statistics 2021-06-03 Guannan Wang , Jue Wang

Weakly supervised person search aims to jointly detect and match persons with only bounding box annotations. Existing approaches typically focus on improving the features by exploring relations of persons. However, scale variation problem…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Benzhi Wang , Yang Yang , Jinlin Wu , Guo-jun Qi , Zhen Lei
‹ Prev 1 8 9 10 Next ›