English
Related papers

Related papers: Tensor Contraction Layers for Parsimonious Deep Ne…

200 papers

We describe a quantum-assisted machine learning (QAML) method in which multivariate data is encoded into quantum states in a Hilbert space whose dimension is exponentially large in the length of the data vector. Learning in this space…

Quantum Physics · Physics 2021-10-13 Michael L. Wall , Giuseppe D'Aguanno

Tensor Networks (TNs) are a computational paradigm used for representing quantum many-body systems. Recent works have shown how TNs can also be applied to perform Machine Learning (ML) tasks, yielding comparable results to standard…

High Energy Physics - Experiment · Physics 2024-09-26 Lorenzo Borella , Alberto Coppi , Jacopo Pazzini , Andrea Stanco , Marco Trenti , Andrea Triossi , Marco Zanetti

Tensor Networks are non-trivial representations of high-dimensional tensors, originally designed to describe quantum many-body systems. We show that Tensor Networks are ideal vehicles to connect quantum mechanical concepts to machine…

High Energy Physics - Phenomenology · Physics 2021-09-09 Jack Y. Araz , Michael Spannowsky

The success of deep neural networks in many real-world applications is leading to new challenges in building more efficient architectures. One effective way of making networks more efficient is neural network compression. We provide an…

Machine Learning · Computer Science 2019-12-23 Andrey Kuzmin , Markus Nagel , Saurabh Pitre , Sandeep Pendyam , Tijmen Blankevoort , Max Welling

Multi-view subspace clustering methods have employed learned self-representation tensors from different tensor decompositions to exploit low rank information. However, the data structures embedded with self-representation tensors may vary…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Yipeng Liu , Yingcong Lu , Weiting Ou , Zhen Long , Ce Zhu

Constraint programming is a general and exact method based on constraint propagation and backtracking search. We provide a function decomposing a constraint network into a ternary constraint network (TCN) with a reduced number of operators.…

Symbolic Computation · Computer Science 2025-11-18 Pierre Talbot

Many real-world data, such as recommendation data and temporal graphs, can be represented as incomplete sparse tensors where most entries are unobserved. For such sparse tensors, identifying the top-k higher-order interactions that are most…

Machine Learning · Computer Science 2025-03-18 Jun-Gi Jang , Jingrui He , Andrew Margenot , Hanghang Tong

Since higher-order tensors are naturally suitable for representing multi-dimensional data in real-world, e.g., color images and videos, low-rank tensor representation has become one of the emerging areas in machine learning and computer…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yisi Luo , Xile Zhao , Zhemin Li , Michael K. Ng , Deyu Meng

Overparameterized networks trained to convergence have shown impressive performance in domains such as computer vision and natural language processing. Pushing state of the art on salient tasks within these domains corresponds to these…

Machine Learning · Computer Science 2020-08-04 James O' Neill

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Deep networks can be trained to map images into a low-dimensional latent space. In many cases, different images in a collection are articulated versions of one another; for example, same object with different lighting, background, or pose.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Rakib Hyder , M. Salman Asif

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

We study the implicit bias of gradient flow (i.e., gradient descent with infinitesimal step size) on linear neural network training. We propose a tensor formulation of neural networks that includes fully-connected, diagonal, and…

Machine Learning · Computer Science 2021-09-13 Chulhee Yun , Shankar Krishnan , Hossein Mobahi

Over the past decade a wide spectrum of machine learning models have been developed to model the neurodegenerative diseases, associating biomarkers, especially non-intrusive neuroimaging markers, with key clinical scores measuring the…

Machine Learning · Computer Science 2018-03-02 Mengying Sun , Inci M. Baytas , Liang Zhan , Zhangyang Wang , Jiayu Zhou

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

The problem of high-dimensional and large-scale representation of visual data is addressed from an unsupervised learning perspective. The emphasis is put on discrete representations, where the description length can be measured in bits and…

Machine Learning · Computer Science 2019-01-25 Sohrab Ferdowsi

Deep neural networks have achieved a great success in solving many machine learning and computer vision problems. The main contribution of this paper is to develop a deep network based on Tucker tensor decomposition, and analyze its…

Machine Learning · Computer Science 2019-05-24 Ye Liu , Junjun Pan , Michael Ng

The tensor low-rank prior has attracted considerable attention in dynamic MR reconstruction. Tensor low-rank methods preserve the inherent high-dimensional structure of data, allowing for improved extraction and utilization of intrinsic…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Yinghao Zhang , Peng Li , Yue Hu

This paper presents a novel approach combining convolutional layers (CLs) and large-margin metric learning for training supervised models on small datasets for texture classification. The core of such an approach is a loss function that…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Jonathan de Matos , Luiz Eduardo Soares de Oliveira , Alceu de Souza Britto Junior , Alessandro Lameiras Koerich