English
Related papers

Related papers: Integrating Neural Networks and Tensor Networks fo…

200 papers

Recently, the \textit{Tensor Nuclear Norm~(TNN)} regularization based on t-SVD has been widely used in various low tubal-rank tensor recovery tasks. However, these models usually require smooth change of data along the third dimension to…

Machine Learning · Computer Science 2021-06-16 Hao Kong , Canyi Lu , Zhouchen Lin

Recent advances at the intersection of control theory, neuroscience, and machine learning have revealed novel mechanisms by which dynamical systems perform computation. These advances encompass a wide range of conceptual, mathematical, and…

Machine Learning · Computer Science 2026-04-10 Arthur N. Montanari , Francesco Bullo , Dmitry Krotov , Adilson E. Motter

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

In the race to bring Artificial Intelligence (AI) to the edge, collaborative intelligence has emerged as a promising way to lighten the computation load on edge devices that run applications based on Deep Neural Networks (DNNs). Typically,…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Lior Bragilevsky , Ivan V. Bajić

Convolutional neural networks typically consist of many convolutional layers followed by one or more fully connected layers. While convolutional layers map between high-order activation tensors, the fully connected layers operate on…

Machine Learning · Computer Science 2020-07-22 Jean Kossaifi , Zachary C. Lipton , Arinbjorn Kolbeinsson , Aran Khanna , Tommaso Furlanello , Anima Anandkumar

We introduce an algorithmic framework based on tensor networks for computing fluid flows around immersed objects in curvilinear coordinates. We show that the tensor network simulations can be carried out solely using highly compressed…

This work presents a novel method for task optimization in industrial plants using quantum-inspired tensor network technology. This method obtains the best possible combination of tasks on a set of machines with directed constraints while…

CoVariance Neural Networks (VNNs) perform convolutions on the graph determined by the covariance matrix of the data, which enables expressive and stable covariance-based learning. However, covariance matrices are typically dense, fail to…

Machine Learning · Computer Science 2026-01-21 Andrea Cavallo , Samuel Rey , Antonio G. Marques , Elvin Isufi

Nowadays, the use of soft computational techniques in power systems under the umbrella of machine learning is increasing with good reception. In this paper, we first present a deep learning approach to find the optimal configuration for…

Networking and Internet Architecture · Computer Science 2025-01-14 Davoud Yousefi , Hassan Yari , Farzad Osouli , Mohammad Ebrahimi , Somayeh Esmalifalak , Morteza Johari , Abbas Azarnezhad , Fatemeh Sadeghi , Rogayeh Mirzapour

The deployment and training of neural networks on edge computing devices pose many challenges. The low memory nature of edge devices is often one of the biggest limiting factors encountered in the deployment of large neural network models.…

Machine Learning · Computer Science 2023-06-01 Burak Bartan , Haoming Li , Harris Teague , Christopher Lott , Bistra Dilkina

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

Robust tensor recovery plays an instrumental role in robustifying tensor decompositions for multilinear data analysis against outliers, gross corruptions and missing values and has a diverse array of applications. In this paper, we study…

Machine Learning · Statistics 2014-08-26 Donald Goldfarb , Zhiwei Qin

Network virtualization (NV) is a technology with broad application prospects. Virtual network embedding (VNE) is the core orientation of VN, which aims to provide more flexible underlying physical resource allocation for user function…

Networking and Internet Architecture · Computer Science 2022-02-07 Peiying Zhang , Chao Wang , Neeraj Kumar , Weishan Zhang , Lei Liu

Modeling the joint distribution of high-dimensional data is a central task in unsupervised machine learning. In recent years, many interests have been attracted to developing learning models based on tensor networks, which have the…

Statistical Mechanics · Physics 2023-02-02 Jing Liu , Sujie Li , Jiang Zhang , Pan Zhang

In this paper, we introduce a tensor network (TN) scheme into the entanglement augmentation process of the synergistic optimization framework by Rudolph et al. [arXiv:2208.13673] to build its process systematically for inhomogeneous…

Quantum Physics · Physics 2024-06-14 Ryo Watanabe , Keisuke Fujii , Hiroshi Ueda

This work studies the problem of high-dimensional data (referred to as tensors) completion from partially observed samplings. We consider that a tensor is a superposition of multiple low-rank components. In particular, each component can be…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Chang Nie , Huan Wang , Zhihui Lai

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

Neural Networks (NNs) are steering a new generation of artificial intelligence (AI) applications at the micro-edge. Examples include wireless sensors, wearables and cybernetic systems that collect data and process them to support real-world…

Signal Processing · Electrical Eng. & Systems 2021-03-17 Sergey Mileiko , Thanasin Bunnam , Fei Xia , Rishad Shafik , Alex Yakovlev , Shidhartha Das

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

We introduce a variational algorithm to simulate quantum many-body states based on a tree tensor network ansatz which releases the isometry constraint usually imposed by the real-space renormalization coarse-graining: This additional…

Statistical Mechanics · Physics 2014-10-08 Matthias Gerster , Pietro Silvi , Matteo Rizzi , Rosario Fazio , Tommaso Calarco , Simone Montangero