English
Related papers

Related papers: Enhancing Deep Learning Models through Tensorizati…

200 papers

Tensors are higher-order extensions of matrices. While matrix methods form the cornerstone of machine learning and data analysis, tensor methods have been gaining increasing traction. However, software support for tensor operations is not…

Machine Learning · Computer Science 2018-05-10 Jean Kossaifi , Yannis Panagakis , Anima Anandkumar , Maja Pantic

Modeling of multidimensional signal using tensor is more convincing than representing it as a collection of matrices. The tensor based approaches can explore the abundant spatial and temporal structures of the mutlidimensional signal. The…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Baburaj Madathil , Sameera V Mohd Sagheer , Abdu Rahiman , Anju Jose Tom , Baiju P S , Jobin Francis , Sudhish N. George

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

A novel method for common and individual feature analysis from exceedingly large-scale data is proposed, in order to ensure the tractability of both the computation and storage and thus mitigate the curse of dimensionality, a major…

Signal Processing · Electrical Eng. & Systems 2017-11-03 Ilia Kisil , Giuseppe G. Calvi , Danilo P. Mandic

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as…

Machine Learning · Computer Science 2023-10-26 Leonardo Petrini

The online analysis of multi-way data stored in a tensor $\mathcal{X} \in \mathbb{R} ^{I_1 \times \dots \times I_N} $ has become an essential tool for capturing the underlying structures and extracting the sensitive features which can be…

Machine Learning · Computer Science 2020-03-11 Ali Anaissi , Basem Suleiman , Seid Miad Zandavi

Tensor networks (TNs) have been gaining interest as multiway data analysis tools owing to their ability to tackle the curse of dimensionality and to represent tensors as smaller-scale interconnections of their intrinsic features. However,…

Signal Processing · Electrical Eng. & Systems 2017-11-03 Giuseppe G. Calvi , Ilia Kisil , Danilo P. Mandic

In this paper, we propose a dimension reduction method specifically designed for tensor-structured feature data in deep neural networks. The method is implemented as a hidden layer, called the TensorProjection layer, which transforms input…

Machine Learning · Statistics 2024-10-23 Toshinari Morimoto , Su-Yun Huang

Tensor completion is a problem of filling the missing or unobserved entries of partially observed tensors. Due to the multidimensional character of tensors in describing complex datasets, tensor completion algorithms and their applications…

Machine Learning · Statistics 2018-05-04 Qingquan Song , Hancheng Ge , James Caverlee , Xia Hu

Hypercomplex algebras have recently been gaining prominence in the field of deep learning owing to the advantages of their division algebras over real vector spaces and their superior results when dealing with multidimensional signals in…

Machine Learning · Computer Science 2024-05-14 Danilo Comminiello , Eleonora Grassucci , Danilo P. Mandic , Aurelio Uncini

Advancements in deep learning are revolutionizing science and engineering. The immense success of deep learning is largely due to its ability to extract essential high-dimensional (HD) features from input data and make inference decisions…

Machine Learning · Computer Science 2025-01-30 Md Tauhidul Islam , Lei Xing

The increasing use of multiple sensors, which produce a large amount of multi-dimensional data, requires efficient representation and classification methods. In this paper, we present a new method for multi-dimensional data classification…

Machine Learning · Computer Science 2020-12-01 Bernardo B. Gatto , Eulanda M. dos Santos , Alessandro L. Koerich , Kazuhiro Fukui , Waldir S. S. Junior

Despite the popularisation of machine learning models, more often than not, they still operate as black boxes with no insight into what is happening inside the model. There exist a few methods that allow to visualise and explain why a model…

Machine Learning · Computer Science 2021-06-18 Błażej Leporowski , Alexandros Iosifidis

Neural networks with at least two hidden layers are called deep networks. Recent developments in AI and computer programming in general has led to development of tools such as Tensorflow, Keras, NumPy etc. making it easier to model and draw…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Ruthvik Vaila , Denver Lloyd , Kevin Tetz

The groundbreaking performance of deep neural networks (NNs) promoted a surge of interest in providing a mathematical basis to deep learning theory. Low-rank tensor decompositions are specially befitting for this task due to their close…

Machine Learning · Computer Science 2025-12-18 Ricardo Borsoi , Konstantin Usevich , Marianne Clausel

Deep learning, a branch of artificial intelligence, is a data-driven method that uses multiple layers of interconnected units or neurons to learn intricate patterns and representations directly from raw input data. Empowered by this…

Machine Learning · Computer Science 2025-07-28 Mohd Halim Mohd Noor , Ayokunle Olalekan Ige

The analysis of multidimensional data is becoming a more and more relevant topic in statistical and machine learning research. Given their complexity, such data objects are usually reshaped into matrices or vectors and then analysed.…

Machine Learning · Statistics 2021-04-09 Giuseppe Brandi , T. Di Matteo

Our goal is to provide a review of deep learning methods which provide insight into structured high-dimensional data. Rather than using shallow additive architectures common to most statistical models, deep learning uses layers of…

Machine Learning · Statistics 2023-10-11 Nick Polson , Vadim Sokolov

Tensors or {\em multi-way arrays} are functions of three or more indices $(i,j,k,\cdots)$ -- similar to matrices (two-way arrays), which are functions of two indices $(r,c)$ for (row,column). Tensors have a rich history, stretching over…

Recent years have been marked with the fast-pace diversification and increasing ubiquity of machine learning applications. Yet, a firm theoretical understanding of the surprising efficiency of neural networks to learn from high-dimensional…

Machine Learning · Statistics 2025-01-16 Hugo Cui