English
Related papers

Related papers: Properties of Sparse Distributed Representations a…

200 papers

Monte Carlo rendering of translucent objects with heterogeneous scattering properties is often expensive both in terms of memory and computation. If we do path tracing and use a high dynamic range lighting environment, the rendering becomes…

Graphics · Computer Science 2025-03-28 Thomson TG , Jeppe Revall Frisvad , Ravi Ramamoorthi , Henrik Wann Jensen

Interpretable classification of time series presents significant challenges in high dimensions. Traditional feature selection methods in the frequency domain often assume sparsity in spectral density matrices (SDMs) or their inverses, which…

Machine Learning · Statistics 2024-08-19 Sarbojit Roy , Malik Shahid Sultan , Hernando Ombao

Runtime characteristics of sparse matrix computations and related processes may be often improved by reducing memory footprints of involved matrices. Such a reduction can be usually achieved when matrices are processed in a block-wise…

Numerical Analysis · Computer Science 2018-01-01 Daniel Langr

We present a generic framework for spatio-temporal (ST) data modeling, analysis, and forecasting, with a special focus on data that is sparse in both space and time. Our multi-scaled framework is a seamless coupling of two major components:…

Machine Learning · Computer Science 2018-04-04 Bao Wang , Xiyang Luo , Fangbo Zhang , Baichuan Yuan , Andrea L. Bertozzi , P. Jeffrey Brantingham

The study of hierarchy in networks of the human brain has been of significant interest among the researchers as numerous studies have pointed out towards a functional hierarchical organization of the human brain. This paper provides a novel…

Neurons and Cognition · Quantitative Biology 2021-03-02 Dushyant Sahoo , Theodore D. Satterthwaite , Christos Davatzikos

Holographic Reduced Representations (HRR) are a method for performing symbolic AI on top of real-valued vectors by associating each vector with an abstract concept, and providing mathematical operations to manipulate vectors as if they were…

Artificial Intelligence · Computer Science 2021-12-30 Ashwinkumar Ganesan , Hang Gao , Sunil Gandhi , Edward Raff , Tim Oates , James Holt , Mark McLean

This paper proposes a low latency neural network architecture for event-based dense prediction tasks. Conventional architectures encode entire scene contents at a fixed rate regardless of their temporal characteristics. Instead, the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Ryuhei Hamaguchi , Yasutaka Furukawa , Masaki Onishi , Ken Sakurada

This paper summarizes the idea of Tiered-Latency DRAM, which was published in HPCA 2013. The key goal of TL-DRAM is to provide low DRAM latency at low cost, a critical problem in modern memory systems. To this end, TL-DRAM introduces…

Hardware Architecture · Computer Science 2016-01-27 Donghyuk Lee , Yoongu Kim , Vivek Seshadri , Jamie Liu , Lavanya Subramanian , Onur Mutlu

We consider the problem of maintaining sparsity in private distributed storage of confidential machine learning data. In many applications, e.g., face recognition, the data used in machine learning algorithms is represented by sparse…

Information Theory · Computer Science 2022-06-15 Marvin Xhemrishi , Maximilian Egger , Rawad Bitar

Sparse representation can be described in high dimensions and used in many applications, including MRI imaging and radar imaging. In some cases, methods have been proposed to solve the high-dimensional sparse representation problem, but…

Signal Processing · Electrical Eng. & Systems 2018-07-17 Milad Nazari , Ali Mehrpooya , Zahra Abbasi , Mehdi Nayebi , M. Hassan Bastani

Despite the success of fully-supervised human skeleton sequence modeling, utilizing self-supervised pre-training for skeleton sequence representation learning has been an active field because acquiring task-specific skeleton annotations at…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuxiao Chen , Long Zhao , Jianbo Yuan , Yu Tian , Zhaoyang Xia , Shijie Geng , Ligong Han , Dimitris N. Metaxas

We introduce a temporal feature encoding architecture called Time Series Representation Model (TSRM) for multivariate time series forecasting and imputation. The architecture is structured around CNN-based representation layers, each…

Machine Learning · Computer Science 2025-04-29 Robert Leppich , Michael Stenger , Daniel Grillmeyer , Vanessa Borst , Samuel Kounev

Learned sparse document representations using a transformer-based neural model has been found to be attractive in both relevance effectiveness and time efficiency. This paper describes a representation sparsification scheme based on hard…

Information Retrieval · Computer Science 2023-06-21 Yifan Qiao , Yingrui Yang , Shanxiu He , Tao Yang

Sparse non-Hermitian random matrices arise in the study of disordered physical systems with asymmetric local interactions, and have applications ranging from neural networks to ecosystem dynamics. The spectral characteristics of these…

Statistical Mechanics · Physics 2024-02-21 Fernando Lucas Metz , Izaak Neri , Tim Rogers

Sparse Representation (SR) of signals or data has a well founded theory with rigorous mathematical error bounds and proofs. SR of a signal is given by superposition of very few columns of a matrix called Dictionary, implicitly reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 G. Madhuri , Atul Negi

We present a novel extension of the SINDy framework to delay differential equations with {\it distributed delays} and {\it renewal equations}, where typically the dependence from the past manifests via integrals in which the history is…

Dynamical Systems · Mathematics 2025-12-25 Dimitri Breda , Muhammad Tanveer , Jianhong Wu

The sparse modeling is an evident manifestation capturing the parsimony principle just described, and sparse models are widespread in statistics, physics, information sciences, neuroscience, computational mathematics, and so on. In…

Machine Learning · Computer Science 2023-08-29 Jianyi Lin

Many types of data from fields including natural language processing, computer vision, and bioinformatics, are well represented by discrete, compositional structures such as trees, sequences, or matchings. Latent structure models are a…

Machine Learning · Computer Science 2026-02-04 Vlad Niculae , Caio F. Corro , Nikita Nangia , Tsvetomila Mihaylova , André F. T. Martins

Many functional datasets are observed sparsely and irregularly. Ordering such data is challenging because only limited information is available from each observation, while the underlying trajectories remain infinite-dimensional. This paper…

Methodology · Statistics 2026-05-21 Hyemin Yeon , Xiongtao Dai , Sara Lopez-Pintado

Sparse representation of 3D images is considered within the context of data reduction. The goal is to produce high quality approximations of 3D images using fewer elementary components than the number of intensity points in the 3D array.…

Image and Video Processing · Electrical Eng. & Systems 2019-06-12 Laura Rebollo-Neira , Daniel Whitehouse