English
Related papers

Related papers: Sample, computation vs storage tradeoffs for class…

200 papers

In recent years, a class of dictionaries have been proposed for multidimensional (tensor) data representation that exploit the structure of tensor data by imposing a Kronecker structure on the dictionary underlying the data. In this work, a…

Machine Learning · Statistics 2017-11-15 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

Deep learning using neural networks is an effective technique for generating models of complex data. However, training such models can be expensive when networks have large model capacity resulting from a large number of layers and nodes.…

Machine Learning · Computer Science 2023-01-19 Jarom D. Hogue , Robert M. Kirby , Akil Narayan

The problem of testing whether a signal lies within a given subspace, also named matched subspace detection, has been well studied when the signal is represented as a vector. However, the matched subspace detection methods based on vectors…

Numerical Analysis · Computer Science 2018-04-24 Cuiping Li , Xiao-Yang Liu , Yue Sun

We consider the problems of classification and intrinsic dimension estimation on image data. A new subspace based classifier is proposed for supervised classification or intrinsic dimension estimation. The distribution of the data in each…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Liang Liao , Stephen John Maybank

Representation learning plays a central role in structuring internal embeddings to capture the statistical properties of language, influencing the coherence and contextual consistency of generated text. Statistical Coherence Alignment is…

Computation and Language · Computer Science 2025-08-11 Jonathan Gale , Godfrey Aldington , Harriet Thistlewood , Thomas Tattershall , Basil Wentworth , Vincent Enoasmo

Subspace clustering is an important unsupervised clustering approach. It is based on the assumption that the high-dimensional data points are approximately distributed around several low-dimensional linear subspaces. The majority of the…

Machine Learning · Computer Science 2021-12-20 Maryam Abdolali , Nicolas Gillis

Compressed sensing aims to undersample certain high-dimensional signals, yet accurately reconstruct them by exploiting signal characteristics. Accurate reconstruction is possible when the object to be recovered is sufficiently sparse in a…

Information Theory · Computer Science 2015-05-13 David L. Donoho , Arian Maleki , Andrea Montanari

Advances in techniques for thermal sampling in classical and quantum systems would deepen understanding of the underlying physics. Unfortunately, one often has to rely solely on inexact numerical simulation, due to the intractability of…

Quantum Physics · Physics 2020-04-10 Jeffrey Marshall , Andrea Di Gioacchino , Eleanor G. Rieffel

Consider a data set collected by (individuals-features) pairs in different times. It can be represented as a tensor of three dimensions (Individuals, features and times). The tensor biclustering problem computes a subset of individuals and…

Machine Learning · Computer Science 2019-03-12 Andriantsiory Dina Faneva , Mustapha Lebbah , Hanane Azzag , Gaël Beck

Class imbalance in real-world data poses a common bottleneck for machine learning tasks, since achieving good generalization on under-represented examples is often challenging. Mitigation strategies, such as under or oversampling the data…

Disordered Systems and Neural Networks · Physics 2025-02-03 Emanuele Loffredo , Mauro Pastore , Simona Cocco , Rémi Monasson

Finding a small set of representatives from an unlabeled dataset is a core problem in a broad range of applications such as dataset summarization and information extraction. Classical exemplar selection methods such as $k$-medoids work…

Machine Learning · Computer Science 2020-06-09 Chong You , Chi Li , Daniel P. Robinson , Rene Vidal

Theoretical studies have proven that the Hilbert space has remarkable performance in many fields of applications. Frames in tensor product of Hilbert spaces were introduced to generalize the inner product to high-order tensors. However,…

Machine Learning · Statistics 2017-11-15 Yunfei Ye

Unsupervised feature learning often finds low-dimensional embeddings that capture the structure of complex data. For tasks for which prior expert topological knowledge is available, incorporating this into the learned representation may…

Machine Learning · Computer Science 2022-03-08 Robin Vandaele , Bo Kang , Jefrey Lijffijt , Tijl De Bie , Yvan Saeys

In this work we propose a method for reducing the dimensionality of tensor objects in a binary classification framework. The proposed Common Mode Patterns method takes into consideration the labels' information, and ensures that tensor…

Machine Learning · Computer Science 2019-02-07 Konstantinos Makantasis , Anastasios Doulamis , Nikolaos Doulamis , Athanasios Voulodimos

Assume that samples of a filtered version of a function in a shift-invariant space are avalaible. This work deals with the existence of a sampling formula involving these samples and having reconstruction functions with compact support.…

Information Theory · Computer Science 2008-06-13 A. G. Garcia , M. A. Hernandez-Medina , G. Perez-Villalon

Part 2 of this monograph builds on the introduction to tensor networks and their operations presented in Part 1. It focuses on tensor network models for super-compressed higher-order representation of data/parameters and related cost…

Numerical Analysis · Computer Science 2017-08-31 A. Cichocki , A-H. Phan , Q. Zhao , N. Lee , I. V. Oseledets , M. Sugiyama , D. Mandic

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

In this paper we present two new approaches to efficiently solve large-scale compressed sensing problems. These two ideas are independent of each other and can therefore be used either separately or together. We consider all possibilities.…

Machine Learning · Statistics 2013-12-17 Robert Vanderbei , Han Liu , Lie Wang , Kevin Lin

Tensor decompositions such as the canonical format and the tensor train format have been widely utilized to reduce storage costs and operational complexities for high-dimensional data, achieving linear scaling with the input dimension…

Numerical Analysis · Mathematics 2020-02-11 Oscar Mickelin , Sertac Karaman

Tensor networks provide a powerful framework for compressing multi-dimensional data. The optimal tensor network structure for a given data tensor depends on both data characteristics and specific optimality criteria, making tensor network…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Zheng Guo , Aditya Deshpande , Brian Kiedrowski , Xinyu Wang , Alex Gorodetsky