English
Related papers

Related papers: Regularized second-order optimization of tensor-ne…

200 papers

Tensor networks have demonstrated significant value for machine learning in a myriad of different applications. However, optimizing tensor networks using standard gradient descent has proven to be difficult in practice. Tensor networks…

Machine Learning · Computer Science 2022-03-08 Fergus Barratt , James Dborin , Lewis Wright

In this paper, we consider both first- and second-order techniques to address continuous optimization problems arising in machine learning. In the first-order case, we propose a framework of transition from deterministic or…

Machine Learning · Computer Science 2021-11-30 Sanae Lotfi , Tiphaine Bonniot de Ruisselet , Dominique Orban , Andrea Lodi

Quantum Computing (QC) stands to revolutionize computing, but is currently still limited. To develop and test quantum algorithms today, quantum circuits are often simulated on classical computers. Simulating a complex quantum circuit…

Quantum Physics · Physics 2022-04-21 Eli A. Meirom , Haggai Maron , Shie Mannor , Gal Chechik

Tensor network algorithms seek to minimize correlations to compress the classical data representing quantum states. Tensor network algorithms and similar tools---called tensor network methods---form the backbone of modern numerical methods…

Quantum Physics · Physics 2021-04-08 Andrey Kardashin , Alexey Uvarov , Jacob Biamonte

It is a critical challenge to simultaneously gain high interpretability and efficiency with the current schemes of deep machine learning (ML). Tensor network (TN), which is a well-established mathematical tool originating from quantum…

Quantum Physics · Physics 2023-11-21 Shi-Ju Ran , Gang Su

The so-called block-term decomposition (BTD) tensor model has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a…

Numerical Analysis · Mathematics 2021-04-21 Athanasios A. Rontogiannis , Eleftherios Kofidis , Paris V. Giampouras

Tensor networks, a model that originated from quantum physics, has been gradually generalized as efficient models in machine learning in recent years. However, in order to achieve exact contraction, only tree-like tensor networks such as…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Song Cheng , Lei Wang , Pan Zhang

As a dedicated quantum device, Ising machines could solve large-scale binary optimization problems in milliseconds. There is emerging interest in utilizing Ising machines to train feedforward neural networks due to the prosperity of…

Machine Learning · Computer Science 2023-11-08 Xujie Song , Tong Liu , Shengbo Eben Li , Jingliang Duan , Wenxuan Wang , Keqiang Li

We introduce a simple yet significant improvement to the time-evolving block decimation (TEBD) tensor network algorithm for simulating the time dynamics of strongly correlated one-dimensional (1D) mixed quantum states. The efficiency of 1D…

Quantum Physics · Physics 2026-05-19 Sayak Guha Roy , Kevin Slagle

Currently, low-rank tensor completion has gained cumulative attention in recovering incomplete visual data whose partial elements are missing. By taking a color image or video as a three-dimensional (3D) tensor, previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Shengke Xue , Wenyuan Qiu , Fan Liu , Xinyu Jin

As the number of qubits in a sensor increases, the complexity of designing and controlling the quantum circuits grows exponentially. Manually optimizing these circuits becomes infeasible. Optimizing entanglement distribution in large-scale…

Quantum Physics · Physics 2025-09-01 Laxmisha Ashok Attisara , Sathish Kumar

We demonstrate the use of matrix product state (MPS) models for discriminating quantum data on quantum computers using holographic algorithms, focusing on classifying a translationally invariant quantum state based on $L$ qubits of quantum…

Quantum Physics · Physics 2022-07-13 Michael L. Wall , Paraj Titum , Gregory Quiroz , Michael Foss-Feig , Kaden R. A. Hazzard

This paper is concerned with the problem of recovering third-order tensor data from limited samples. A recently proposed tensor decomposition (BMD) method has been shown to efficiently compress third-order spatiotemporal data. Using the…

Numerical Analysis · Mathematics 2024-02-21 Fan Tian , Mirjeta Pasha , Misha E. Kilmer , Eric Miller , Abani Patra

With the advent of quantum and quantum-inspired machine learning, adapting the structure of learning models to match the structure of target datasets has been shown to be crucial for obtaining high performance. Probabilistic models based on…

Quantum Physics · Physics 2022-11-30 Atithi Acharya , Manuel Rudolph , Jing Chen , Jacob Miller , Alejandro Perdomo-Ortiz

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

A structural optimization scheme for a single-layer nonnegative adaptive tensor tree (NATT) that models a target probability distribution is proposed as an alternative paradigm for generative modeling. The NATT scheme, by construction,…

Machine Learning · Computer Science 2025-07-02 Katsuya O. Akamatsu , Kenji Harada , Tsuyoshi Okubo , Naoki Kawashima

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase…

Signal Processing · Electrical Eng. & Systems 2021-10-15 Michael Koller , Wolfgang Utschick

One of the main problems encountered so far with recurrent neural networks is that they struggle to retain long-time information dependencies in their recurrent connections. Neural Turing Machines (NTMs) attempt to mitigate this issue by…

Neural and Evolutionary Computing · Computer Science 2024-12-20 Jacopo Castellini

Generative quantum machine learning models are trained to deduce the probability distribution underlying a given dataset, and to produce new, synthetic samples from it. The majority of such models proposed in the literature, like the…

Quantum Physics · Physics 2026-03-25 Michael Krebsbach , Florentin Reiter , Thomas Wellens , Hagen-Henrik Kowalski , Ali Abedi