English
Related papers

Related papers: Accelerating the training of single-layer binary n…

200 papers

Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit. However, most existing training algorithms for BNNs rely on…

Machine Learning · Computer Science 2025-12-08 Luca Colombo , Fabrizio Pittorino , Manuel Roveri

Learning compact binary codes for image retrieval problem using deep neural networks has recently attracted increasing attention. However, training deep hashing networks is challenging due to the binary constraints on the hash codes. In…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Thanh-Toan Do , Tuan Hoang , Dang-Khoa Le Tan , Anh-Dzung Doan , Ngai-Man Cheung

Deep neural networks excel in high-dimensional problems, outperforming models such as kernel methods, which suffer from the curse of dimensionality. However, the theoretical foundations of this success remain poorly understood. We follow…

Machine Learning · Statistics 2025-10-06 Shuo Huang , Hippolyte Labarrière , Ernesto De Vito , Tomaso Poggio , Lorenzo Rosasco

Quantum machine learning is considered one of the current research fields with immense potential. In recent years, Havl\'i\v{c}ek et al. [Nature 567, 209-212 (2019)] have proposed a quantum machine learning algorithm with quantum-enhanced…

Quantum Physics · Physics 2025-06-09 Chao Ding , Shi Wang , Yaonan Wang , Weibo Gao

Quantum machine learning has the potential for a transformative impact across industry sectors and in particular in finance. In our work we look at the problem of hedging where deep reinforcement learning offers a powerful framework for…

Convolutional Neural Networks (CNNs) are pivotal in computer vision and Big Data analytics but demand significant computational resources when trained on large-scale datasets. Conventional training via back-propagation (BP) with losses like…

Machine Learning · Computer Science 2025-06-03 Aasish Kumar Sharma , Sanjeeb Prashad Pandey , Julian M. Kunkel

Recent work has shown that the training of a one-hidden-layer, scalar-output fully-connected ReLU neural network can be reformulated as a finite-dimensional convex program. Unfortunately, the scale of such a convex program grows…

Machine Learning · Computer Science 2021-05-27 Yatong Bai , Tanmay Gautam , Yu Gai , Somayeh Sojoudi

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

Understanding and characterising quantum many-body dynamics remains a significant challenge due to both the exponential complexity required to represent quantum many-body Hamiltonians, and the need to accurately track states in time under…

Quantum Physics · Physics 2024-08-19 Timothy Heightman , Edward Jiang , Antonio Acín

Incorporating nonlinearity into quantum machine learning is essential for learning a complicated input-output mapping. We here propose quantum algorithms for nonlinear regression, where nonlinearity is introduced with feature maps when…

Quantum Physics · Physics 2018-08-30 Dan-Bo Zhang , Shi-Liang Zhu , Z. D. Wang

Many approaches to transform classification problems from non-linear to linear by feature transformation have been recently presented in the literature. These notably include sparse coding methods and deep neural networks. However, many of…

Machine Learning · Computer Science 2015-07-08 Alessandro Montalto , Giovanni Tessitore , Roberto Prevete

In this work, we introduce a novel Quadratic Binary Optimization (QBO) framework for training a quantized neural network. The framework enables the use of arbitrary activation and loss functions through spline interpolation, while Forward…

Machine Learning · Computer Science 2025-12-09 Wenxin Li , Chuan Wang , Hongdong Zhu , Qi Gao , Yin Ma , Hai Wei , Kai Wen

Since classical machine learning has become a powerful tool for developing data-driven algorithms, quantum machine learning is expected to similarly impact the development of quantum algorithms. The literature reflects a mutually beneficial…

Quantum Physics · Physics 2024-12-13 Leandro C. Souza , Bruno C. Guingo , Gilson Giraldi , Renato Portugal

In recent years, binary code learning, a.k.a hashing, has received extensive attention in large-scale multimedia retrieval. It aims to encode high-dimensional data points to binary codes, hence the original high-dimensional metric space can…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Mingbao Lin , Rongrong Ji , Hong Liu , Yongjian Liu

The binary neural network, largely saving the storage and computation, serves as a promising technique for deploying deep models on resource-limited devices. However, the binarization inevitably causes severe information loss, and even…

Neural and Evolutionary Computing · Computer Science 2020-04-08 Haotong Qin , Ruihao Gong , Xianglong Liu , Xiao Bai , Jingkuan Song , Nicu Sebe

We propose a multi-step training method for designing generalized linear classifiers. First, an initial multi-class linear classifier is found through regression. Then validation error is minimized by pruning of unnecessary inputs.…

Machine Learning · Computer Science 2023-12-15 Kanishka Tyagi , Chinmay Rane , Michael Manry

Regression is a cornerstone of statistics and machine learning, with applications spanning science, engineering, and economics. While quantum algorithms for regression have attracted considerable attention, most existing work has focused on…

Quantum Physics · Physics 2025-09-30 Chenghua Liu , Zhengfeng Ji

Deep hedging represents a cutting-edge approach to risk management for financial derivatives by leveraging the power of deep learning. However, existing methods often face challenges related to computational inefficiency, sensitivity to…

Machine Learning · Computer Science 2025-02-26 Lei Zhao , Lin Cai

The increasing complexity of modern deep neural network models and the expanding sizes of datasets necessitate the development of optimized and scalable training methods. In this white paper, we addressed the challenge of efficiently…

Machine Learning · Computer Science 2024-04-29 Raphael Ruschel , A. S. M. Iftekhar , B. S. Manjunath , Suya You

The slow convergence rate and pathological curvature issues of first-order gradient methods for training deep neural networks, initiated an ongoing effort for developing faster $\mathit{second}$-$\mathit{order}$ optimization algorithms…

Machine Learning · Computer Science 2020-12-10 Jan van den Brand , Binghui Peng , Zhao Song , Omri Weinstein