English
Related papers

Related papers: Lightweight and Effective Tensor Sensitivity for A…

200 papers

Function approximation from input and output data is one of the most investigated problems in signal processing. This problem has been tackled with various signal processing and machine learning methods. Although tensors have a rich history…

Statistics Theory · Mathematics 2023-02-16 Christina Auer , Thomas Paireder , Oliver Ploder , Oliver Lang , Mario Huemer

Molecule-and-text cross-modal representation learning has emerged as a promising direction for enhancing the quality of molecular representation, thereby improving performance in various scientific fields. However, most approaches employ a…

Quantitative Methods · Quantitative Biology 2025-03-04 Yikun Zhang , Geyan Ye , Chaohao Yuan , Bo Han , Long-Kai Huang , Jianhua Yao , Wei Liu , Yu Rong

Recurrent neural networks (RNNs) and transformers have been shown to be Turing-complete, but this result assumes infinite precision in their hidden representations, positional encodings for transformers, and unbounded computation time in…

Computational Complexity · Computer Science 2023-09-27 Ankur Mali , Alexander Ororbia , Daniel Kifer , Lee Giles

Quantum machine learning researchers often rely on incorporating Tensor Networks (TN) into Deep Neural Networks (DNN) and variational optimization. However, the standard optimization techniques used for training the contracted trainable…

Quantum Physics · Physics 2023-10-04 Debanjan Konar , Dheeraj Peddireddy , Vaneet Aggarwal , Bijaya K. Panigrahi

Deep neural networks (DNNs) have achieved outstanding performance in a wide range of applications, e.g., image classification, natural language processing, etc. Despite the good performance, the huge number of parameters in DNNs brings…

Machine Learning · Computer Science 2020-12-21 Jinmian Ye , Guangxi Li , Di Chen , Haiqin Yang , Shandian Zhe , Zenglin Xu

We present a tensor network model (TNM) for forecasting nonlinear and chaotic dynamics, bridging quantum many-body methods with classical complex systems. The TNM leverages hierarchical tensor contractions to encode non-Markovian temporal…

Quantum Physics · Physics 2025-11-13 Jia-Bin You , Jian Feng Kong , Jun Ye

Neural network quantum states (NQS) have emerged as a powerful and flexible framework for addressing quantum many-body problems. While successful for model Hamiltonians, their application to molecular systems remains challenging for several…

Chemical Physics · Physics 2025-07-28 Zibo Wu , Bohan Zhang , Wei-Hai Fang , Zhendong Li

Modeling of conservative systems with neural networks is an area of active research. A popular approach is to use Hamiltonian neural networks (HNNs) which rely on the assumptions that a conservative system is described with Hamilton's…

Artificial Intelligence · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

Binary Neural Network (BNN) converts full-precision weights and activations into their extreme 1-bit counterparts, making it particularly suitable for deployment on lightweight mobile devices. While binary neural networks are typically…

Machine Learning · Computer Science 2025-01-08 Jun Chen , Jingyang Xiang , Tianxin Huang , Xiangrui Zhao , Yong Liu

Tensor networks (TN) have found a wide use in machine learning, and in particular, TN and deep learning bear striking similarities. In this work, we propose the quantum-classical hybrid tensor networks (HTN) which combine tensor networks…

Machine Learning · Computer Science 2024-08-15 Ding Liu , Jiaqi Yao , Zekun Yao , Quan Zhang

The next generation of cosmological surveys is expected to generate unprecedented high-quality data, consequently increasing the already substantial computational costs of Bayesian statistical methods. This will pose a significant challenge…

Cosmology and Nongalactic Astrophysics · Physics 2024-03-22 Evan Saraivanov , Kunhao Zhong , Vivian Miranda , Supranta S. Boruah , Tim Eifler , Elisabeth Krause

Biochemical discovery increasingly relies on classifying molecular structures when the consequences of different errors are highly asymmetric. In mutagenicity and carcinogenicity, misclassifying a harmful compound as benign can trigger…

Methodology · Statistics 2025-12-05 Lingchong Liu , Elynn Chen , Yuefeng Han , Lucy Xia

This study introduces a novel transformer model optimized for large-scale point cloud processing in scientific domains such as high-energy physics (HEP) and astrophysics. Addressing the limitations of graph neural networks and standard…

Machine Learning · Computer Science 2024-06-06 Siqi Miao , Zhiyuan Lu , Mia Liu , Javier Duarte , Pan Li

We have developed TTNOpt, a software package that utilizes tree tensor networks (TTNs) for quantum spin systems and high-dimensional data analysis. TTNOpt provides efficient and powerful TTN computations by locally optimizing the network…

Quantum Physics · Physics 2026-02-06 Ryo Watanabe , Hidetaka Manabe , Toshiya Hikihara , Hiroshi Ueda

Using machine learning, we explore the utility of various deep neural networks (NN) when applied to high harmonic generation (HHG) scenarios. First, we train the NNs to predict the time-dependent dipole and spectra of HHG emission from…

Optics · Physics 2023-03-07 M. Lytova , M. Spanner , I. Tamblyn

Tensor Networks (TNs) are a computational paradigm used for representing quantum many-body systems. Recent works have shown how TNs can also be applied to perform Machine Learning (ML) tasks, yielding comparable results to standard…

High Energy Physics - Experiment · Physics 2024-09-26 Lorenzo Borella , Alberto Coppi , Jacopo Pazzini , Andrea Stanco , Marco Trenti , Andrea Triossi , Marco Zanetti

Deep Convolutional Neural Networks (CNNs) achieve high accuracy but often rely on purely global, gradient-based optimisation, which can lead to overfitting, redundant filters, and reduced interpretability. To address these limitations, we…

Machine Learning · Computer Science 2025-08-28 Davorin Miličević , Ratko Grbić

The interplay of quantum and classical simulation and the delicate divide between them is in the focus of massively parallelized tensor network state (TNS) algorithms designed for high performance computing (HPC). In this contribution, we…

Quantum Physics · Physics 2023-05-10 Andor Menczer , Örs Legeza

Quantization of weights of deep neural networks (DNN) has proven to be an effective solution for the purpose of implementing DNNs on edge devices such as mobiles, ASICs and FPGAs, because they have no sufficient resources to support…

Machine Learning · Computer Science 2019-12-20 Tianyu Zhang , Lei Zhu , Qian Zhao , Kilho Shin