English
Related papers

Related papers: STORE: Sparse Tensor Response Regression and Neuro…

200 papers

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

Modeling inverse dynamics is crucial for accurate feedforward robot control. The model computes the necessary joint torques, to perform a desired movement. The highly non-linear inverse function of the dynamical system can be approximated…

Machine Learning · Computer Science 2017-11-15 Stephan Baier , Volker Tresp

The article considers the problem of estimating a high-dimensional sparse parameter in the presence of side information that encodes the sparsity structure. We develop a general framework that involves first using an auxiliary sequence to…

Methodology · Statistics 2019-10-21 Trambak Banerjee , Gourab Mukherjee , Wenguang Sun

Sparse neural networks are a key factor in developing resource-efficient machine learning applications. We propose the novel and powerful sparse learning method Adaptive Regularized Training (ART) to compress dense into sparse networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Patrick Glandorf , Timo Kaiser , Bodo Rosenhahn

We present a novel architecture for sparse pattern processing, using flash storage with embedded accelerators. Sparse pattern processing on large data sets is the essence of applications such as document search, natural language processing,…

Hardware Architecture · Computer Science 2017-01-25 Sang-Woo Jun , Huy T. Nguyen , Vijay N. Gadepally , Arvind

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

End-to-end model, especially Recurrent Neural Network Transducer (RNN-T), has achieved great success in speech recognition. However, transducer requires a great memory footprint and computing time when processing a long decoding sequence.…

Sound · Computer Science 2023-07-18 Xiaohui Zhang , Mangui Liang , Zhengkun Tian , Jiangyan Yi , Jianhua Tao

High-dimensional vector autoregression with measurement error is frequently encountered in a large variety of scientific and business applications. In this article, we study statistical inference of the transition matrix under this model.…

Methodology · Statistics 2020-09-18 Xiang Lyu , Jian Kang , Lexin Li

We consider support recovery in the quadratic logistic regression setting - where the target depends on both p linear terms $x_i$ and up to $p^2$ quadratic terms $x_i x_j$. Quadratic terms enable prediction/modeling of higher-order effects…

Machine Learning · Statistics 2017-03-09 Karthikeyan Shanmugam , Murat Kocaoglu , Alexandros G. Dimakis , Sujay Sanghavi

Diffusion models have demonstrated remarkable generative capabilities in image processing tasks. We propose a Sparse condition Temporal Rewighted Integrated Distribution Estimation guided diffusion model (STRIDE) for sparse-view CT…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zekun Zhou , Yanru Gong , Liu Shi , Qiegen Liu

The effectiveness of using model sparsity as a priori information when solving linear inverse problems is studied. We investigate the reconstruction quality of such a method in the non-idealized case and compute some typical recovery errors…

Numerical Analysis · Mathematics 2010-07-19 Ignace Loris , Caroline Verhoeven

We study the problem of reconstructing an image from information stored at contour locations. We show that high-quality reconstructions with high fidelity to the source image can be obtained from sparse input, e.g., comprising less than…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Tali Dekel , Chuang Gan , Dilip Krishnan , Ce Liu , William T. Freeman

Sparse coding aims to model data vectors as sparse linear combinations of basis elements, but a majority of related studies are restricted to continuous data without spatial or temporal structure. A new model-based sparse coding (MSC)…

Methodology · Statistics 2021-08-24 Xin Xing , Rui Xie , Wenxuan Zhong

In scientific fields such as quantum computing, physics, chemistry, and machine learning, high dimensional data are typically represented using sparse tensors. Tensor contraction is a popular operation on tensors to exploit meaning or alter…

Data Structures and Algorithms · Computer Science 2024-10-15 Andrew Ensinger , Gabriel Kulp , Victor Agostinelli , Dennis Lyakhov , Lizhong Chen

Super-symmetric tensors - a higher-order extension of scatter matrices - are becoming increasingly popular in machine learning and computer vision for modelling data statistics, co-occurrences, or even as visual descriptors. However, the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-11 Piotr Koniusz , Anoop Cherian

Existing pseudo label generation methods for point weakly supervised object detection are inadequate in low data volume and dense object detection tasks. We consider the generation of weakly supervised pseudo labels as the model's sparse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chuyang Shang , Tian Ma , Wanzhu Ren , Yuancheng Li , Jiayi Yang

The theory of compressive sensing (CS) asserts that an unknown signal $\mathbf{x} \in \mathbb{C}^N$ can be accurately recovered from $m$ measurements with $m\ll N$ provided that $\mathbf{x}$ is sparse. Most of the recovery algorithms need…

Methodology · Statistics 2017-10-12 Jianfeng Wang , Zhiyong Zhou , Anders Garpebring , Jun Yu

In this paper, we develop a framework to design sensing matrices for compressive sensing applications that lead to good mean squared error (MSE) performance subject to sensing cost constraints. By capitalizing on the MSE of the oracle…

Information Theory · Computer Science 2021-01-28 Wei Chen , Miguel R. D. Rodrigues , Ian Wassell

Consider the task of estimating a 3-order $n \times n \times n$ tensor from noisy observations of randomly chosen entries in the sparse regime. We introduce a similarity based collaborative filtering algorithm for estimating a tensor from…

Machine Learning · Computer Science 2023-01-18 Devavrat Shah , Christina Lee Yu

Classical scalar-response regression methods treat covariates as a vector and estimate a corresponding vector of regression coefficients. In medical applications, however, regressors are often in a form of multi-dimensional arrays. For…

Methodology · Statistics 2020-02-03 Damian Brzyski , Xixi Hu , Joaquin Goni , Beau Ances , Timothy W. Randolph , Jaroslaw Harezlak