English
Related papers

Related papers: Hadamax Encoding: Elevating Performance in Model-F…

200 papers

Training intelligent agents through reinforcement learning is a notoriously unstable procedure. Massive parallelization on GPUs and distributed systems has been exploited to generate a large amount of training experiences and consequently…

Machine Learning · Computer Science 2019-02-08 Greg Heinrich , Iuri Frosio

This paper presents HUANet, a constrained deep neural network architecture that unrolls the iterations of the Alternating Direction Method of Multipliers (ADMM) into a trainable neural network for solving constrained convex optimization…

Optimization and Control · Mathematics 2026-04-16 Trinh Tran , Binh Nguyen , Truong X. Nghiem

Recent approaches in hierarchical text classification (HTC) rely on the capabilities of a pre-trained transformer model and exploit the label semantics and a graph encoder for the label hierarchy. In this paper, we introduce an effective…

Machine Learning · Computer Science 2025-01-24 Younes Yousef , Lukas Galke , Ansgar Scherp

Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shu-Chuan Chu , Zhi-Chao Dou , Jeng-Shyang Pan , Shaowei Weng , Junbao Li

Hadamard Product (HP) has long been a cornerstone in click-through rate (CTR) prediction tasks due to its simplicity, effectiveness, and ability to capture feature interactions without additional parameters. However, the underlying reasons…

Information Retrieval · Computer Science 2025-05-29 Honghao Li , Yiwen Zhang , Yi Zhang , Lei Sang , Jieming Zhu

Since the introduction of DQN, a vast majority of reinforcement learning research has focused on reinforcement learning with deep neural networks as function approximators. New methods are typically evaluated on a set of environments that…

Machine Learning · Computer Science 2021-05-25 Johan S. Obando-Ceron , Pablo Samuel Castro

Deep reinforcement learning has been shown to be a powerful framework for learning policies from complex high-dimensional sensory inputs to actions in complex tasks, such as the Atari domain. In this paper, we explore output representation…

Machine Learning · Computer Science 2016-06-16 Ishan P. Durugkar , Clemens Rosenbaum , Stefan Dernbach , Sridhar Mahadevan

The use of deep learning-based techniques for approximating secure encoding functions has attracted considerable interest in wireless communications due to impressive results obtained for general coding and decoding tasks for wireless…

Information Theory · Computer Science 2021-06-02 Rick Fritschek , Rafael F. Schaefer , Gerhard Wunder

This paper introduces a divide-and-conquer inspired adversarial learning (DACAL) approach for photo enhancement. The key idea is to decompose the photo enhancement process into hierarchically multiple sub-problems, which can be better…

Image and Video Processing · Electrical Eng. & Systems 2019-10-24 Zhiwu Huang , Danda Pani Paudel , Guanju Li , Jiqing Wu , Radu Timofte , Luc Van Gool

The Retinex model is one of the most representative and effective methods for low-light image enhancement. However, the Retinex model does not explicitly tackle the noise problem, and shows unsatisfactory enhancing results. In recent years,…

Image and Video Processing · Electrical Eng. & Systems 2023-02-20 Tingting Wu , Wenna Wu , Ying Yang , Feng-Lei Fan , Tieyong Zeng

Today's high-performance computing (HPC) applications are producing vast volumes of data, which are challenging to store and transfer efficiently during the execution, such that data compression is becoming a critical technique to mitigate…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-02 Jiannan Tian , Cody Rivera , Sheng Di , Jieyang Chen , Xin Liang , Dingwen Tao , Franck Cappello

The severe on-chip memory limitations are currently preventing the deployment of the most accurate Deep Neural Network (DNN) models on tiny MicroController Units (MCUs), even if leveraging an effective 8-bit quantization scheme. To tackle…

Machine Learning · Computer Science 2020-08-13 Manuele Rusci , Marco Fariselli , Alessandro Capotondi , Luca Benini

The IEEE 802.16 technology (WiMAX) is a promising technology for providing last-mile connectivity by radio link due to its high speed data rates, low cost of deployment, and large coverage area. However, the maximum number of channels…

Networking and Internet Architecture · Computer Science 2010-05-28 Iwan Adhicandra

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

In this work, we consider transmissions over block fading channels and assume that adaptive modulation and coding (AMC) and hybrid automatic repeat request (HARQ) are implemented. Knowing that in high signal-to-noise ratio, the conventional…

Information Theory · Computer Science 2018-02-21 Mohammed Jabi , Leszek Szczecinski , Mustapha Benjillali , Abdellatif Benyouss , Benoit Pelletier

Training and deploying large-scale machine learning models is time-consuming, requires significant distributed computing infrastructures, and incurs high operational costs. Our analysis, grounded in real-world large model training on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-12 Samuel Hsia , Alicia Golden , Bilge Acun , Newsha Ardalani , Zachary DeVito , Gu-Yeon Wei , David Brooks , Carole-Jean Wu

As a special field in deep learning, Graph Neural Networks (GNNs) focus on extracting intrinsic network features and have drawn unprecedented popularity in both academia and industry. Most of the state-of-the-art GNN models offer…

Machine Learning · Computer Science 2021-08-17 Qinyi Zhu , Yiou Xiao

Modern transformer-based deep neural networks present unique technical challenges for effective acceleration in real-world applications. Apart from the vast amount of linear operations needed due to their sizes, modern transformer models…

Hardware Architecture · Computer Science 2024-11-07 Jiajun Wu , Mo Song , Jingmin Zhao , Yizhao Gao , Jia Li , Hayden Kwok-Hay So

Recent advances in reinforcement learning have demonstrated the potential of quantum learning models based on parametrized quantum circuits as an alternative to deep learning models. On the one hand, these findings have shown the ultimate…

Quantum Physics · Physics 2024-12-13 Dominik Freinberger , Julian Lemmel , Radu Grosu , Sofiene Jerbi

We propose a learning architecture that allows symbolic control and guidance in reinforcement learning with deep neural networks. We introduce SymDQN, a novel modular approach that augments the existing Dueling Deep Q-Networks (DuelDQN)…

Artificial Intelligence · Computer Science 2025-04-04 Ivo Amador , Nina Gierasimczuk