English
Related papers

Related papers: RepAct: The Re-parameterizable Adaptive Activation…

200 papers

Deep Neural Networks (DNNs) are computationally and memory intensive, which makes their hardware implementation a challenging task especially for resource constrained devices such as IoT nodes. To address this challenge, this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mohammed F. Tolba , Huruy Tekle Tesfai , Hani Saleh , Baker Mohammad , Mahmoud Al-Qutayri

This paper introduces AdaptoVision, a novel convolutional neural network (CNN) architecture designed to efficiently balance computational complexity and classification accuracy. By leveraging enhanced residual units, depth-wise separable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Md. Sanaullah Chowdhury Lameya Sabrin

In this paper, we present Neural Adaptive Tomography (NeAT), the first adaptive, hierarchical neural rendering pipeline for multi-view inverse rendering. Through a combination of neural features with an adaptive explicit representation, we…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Darius Rückert , Yuanhao Wang , Rui Li , Ramzi Idoughi , Wolfgang Heidrich

Deep neural networks with adaptive configurations have gained increasing attention due to the instant and flexible deployment of these models on platforms with different resource budgets. In this paper, we investigate a novel option to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Qing Jin , Linjie Yang , Zhenyu Liao

We introduce a lightweight and accurate architecture for resource-efficient visual correspondence. Our method, dubbed XFeat (Accelerated Features), revisits fundamental design choices in convolutional neural networks for detecting,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Guilherme Potje , Felipe Cadar , Andre Araujo , Renato Martins , Erickson R. Nascimento

In this work, we propose a novel activation mechanism called LayerAct for CNNs. This approach is motivated by our theoretical and experimental analyses, which demonstrate that Layer Normalization (LN) can mitigate a limitation of existing…

Machine Learning · Computer Science 2025-02-20 Kihyuk Yoon , Chiehyeon Lim

This paper proposes ReBNet, an end-to-end framework for training reconfigurable binary neural networks on software and developing efficient accelerators for execution on FPGA. Binary neural networks offer an intriguing opportunity for…

Machine Learning · Computer Science 2018-03-29 Mohammad Ghasemzadeh , Mohammad Samragh , Farinaz Koushanfar

In this paper we present Hyper-Dimensional Reconfigurable Analytics at the Tactical Edge (HyDRATE) using low-SWaP embedded hardware that can perform real-time reconfiguration at the edge leveraging non-MAC (free of floating-point…

Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core idea of ResNets is to have shortcut connections between layers that allow the network to be much deeper while still being easy to optimize avoiding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Sam Leroux , Pavlo Molchanov , Pieter Simoens , Bart Dhoedt , Thomas Breuel , Jan Kautz

Deep neural networks (DNNs) are increasingly being deployed in safety-critical systems such as personal healthcare devices and self-driving cars. In such DNN-based systems, error resilience is a top priority since faults in DNN inference…

Machine Learning · Computer Science 2021-12-28 Behnam Ghavami , Mani Sadati , Zhenman Fang , Lesley Shannon

Graph Neural Networks have demonstrated significant success in graph classification tasks, yet they often require substantial computational resources and struggle to capture global graph properties effectively. We introduce LightTopoGAT, a…

Machine Learning · Computer Science 2025-12-16 Ankit Sharma , Sayan Roy Gupta

Vision transformers have recently made a breakthrough in computer vision showing excellent performance in terms of precision for numerous applications. However, their computational cost is very high compared to alternative approaches such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Martial Guidez , Stefan Duffner , Christophe Garcia

Accurate reconstruction of arbitrary-shaped long slender continuum bodies, such as guidewires, catheters and other soft continuum manipulators, is essential for accurate mechanical simulation. However, existing image-based reconstruction…

Robotics · Computer Science 2026-03-25 Yaozhi Zhang , Shun Yu , Yugang Zhang , Yang Liu

A large number of emerging IoT applications rely on machine learning routines for analyzing data. Executing such tasks at the user devices improves response time and economizes network resources. However, due to power and computing…

Networking and Internet Architecture · Computer Science 2020-03-10 A. Galanopoulos , A. G. Tasiopoulos , G. Iosifidis , T. Salonidis , D. J. Leith

Recent studies have shown that the choice of activation function can significantly affect the performance of deep learning networks. However, the benefits of novel activation functions have been inconsistent and task dependent, and…

Machine Learning · Computer Science 2022-01-25 Garrett Bingham , Risto Miikkulainen

This paper presents an automatic network adaptation method that finds a ConvNet structure well-suited to a given target task, e.g., image classification, for efficiency as well as accuracy in transfer learning. We call the concept…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yang Zhong , Vladimir Li , Ryuzo Okada , Atsuto Maki

Interactive segmentation models such as the Segment Anything Model (SAM) have demonstrated remarkable generalization on natural images, but they perform suboptimally on remote sensing imagery (RSI) due to severe domain shifts and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 M. Naseer Subhani

Learned activation functions in models like Kolmogorov-Arnold Networks (KANs) outperform fixed-activation architectures in terms of accuracy and interpretability; however, their computational complexity poses critical challenges for…

Hardware Architecture · Computer Science 2025-08-26 Mengyuan Yin , Benjamin Chen Ming Choong , Chuping Qu , Rick Siow Mong Goh , Weng-Fai Wong , Tao Luo

Edge-based computer vision models running on compact, resource-limited devices benefit greatly from using unprocessed, detail-rich RAW sensor data instead of processed RGB images. Training these models, however, necessitates large labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Radu Berdan , Beril Besbinar , Christoph Reinders , Junji Otsuka , Daisuke Iso

Wearable devices have strict power and memory limitations. As a result, there is a need to optimize the power consumption on those devices without sacrificing the accuracy. This paper presents AdaSense: a sensing, feature extraction and…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Marina Neseem , Jon Nelson , Sherief Reda