English
Related papers

Related papers: FastWave: Accelerating Autoregressive Convolutiona…

200 papers

Convolutional neural network (CNN) offers significant accuracy in image detection. To implement image detection using CNN in the internet of things (IoT) devices, a streaming hardware accelerator is proposed. The proposed accelerator…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 Li Du , Yuan Du , Yilei Li , Mau-Chung Frank Chang

In computer vision, convolutional neural networks (CNN) such as ConvNeXt, have been able to surpass state-of-the-art transformers, partly thanks to depthwise separable convolutions (DSC). DSC, as an approximation of the regular convolution,…

We propose a simple two-step approach for speeding up convolution layers within large convolutional neural networks based on tensor decomposition and discriminative fine-tuning. Given a layer, we use non-linear least squares to compute a…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Vadim Lebedev , Yaroslav Ganin , Maksim Rakhuba , Ivan Oseledets , Victor Lempitsky

Recent advancements in generative modeling have significantly enhanced the reconstruction of audio waveforms from various representations. While diffusion models are adept at this task, they are hindered by latency issues due to their…

Sound · Computer Science 2024-10-08 Peng Liu , Dongyang Dai , Zhiyong Wu

Since introduced, Swin Transformer has achieved remarkable results in the field of computer vision, it has sparked the need for dedicated hardware accelerators, specifically catering to edge computing demands. For the advantages of…

Hardware Architecture · Computer Science 2023-08-29 Zhiyang Liu , Pengyu Yin , Zhenhua Ren

This paper introduces a lightweight convolutional neural network, called FDDWNet, for real-time accurate semantic segmentation. In contrast to recent advances of lightweight networks that prefer to utilize shallow structure, FDDWNet makes…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Jia Liu , Quan Zhou , Yong Qiang , Bin Kang , Xiaofu Wu , Baoyu Zheng

Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses on accelerating them with single hardware units such as Graphics Processing Units (GPUs),…

Hardware Architecture · Computer Science 2026-05-04 Ali Emre Oztas , Mahir Demir , James Garside , Mikel Luj'an

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones;…

In recent years, neural network approaches have shown superior performance to conventional hand-made features in numerous application areas. In particular, convolutional neural networks (ConvNets) exploit spatially local correlations across…

Sound · Computer Science 2016-07-11 Yoonchang Han , Kyogu Lee

In this paper, we propose WG-WaveNet, a fast, lightweight, and high-quality waveform generation model. WG-WaveNet is composed of a compact flow-based model and a post-filter. The two components are jointly trained by maximizing the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-21 Po-chun Hsu , Hung-yi Lee

This paper presents Systolic-CNN, an OpenCL-defined scalable, run-time-flexible FPGA accelerator architecture, optimized for accelerating the inference of various convolutional neural networks (CNNs) in multi-tenancy cloud/edge computing.…

Hardware Architecture · Computer Science 2020-12-08 Akshay Dua , Yixing Li , Fengbo Ren

Surveillance systems, autonomous vehicles, human monitoring systems, and video retrieval are just few of the many applications in which 3D Convolutional Neural Networks are exploited. However, their extensive use is restricted by their high…

Hardware Architecture · Computer Science 2024-03-05 Petros Toupas , Christos-Savvas Bouganis , Dimitrios Tzovaras

Deep learning-based point cloud processing plays an important role in various vision tasks, such as autonomous driving, virtual reality (VR), and augmented reality (AR). The submanifold sparse convolutional network (SSCN) has been widely…

Signal Processing · Electrical Eng. & Systems 2022-10-17 Zilun Wang , Wendong Mao , Peixiang Yang , Zhongfeng Wang , Jun Lin

In recent years, neural networks have surpassed classical algorithms in areas such as object recognition, e.g. in the well-known ImageNet challenge. As a result, great effort is being put into developing fast and efficient accelerators,…

Hardware Architecture · Computer Science 2019-07-18 Andreas Bytyn , Rainer Leupers , Gerd Ascheid

Audio Super-Resolution is a set of techniques aimed at high-quality estimation of the given signal as if it would be sampled with higher sample rate. Among suggested methods there are diffusion and flow models (which are considered slower),…

Sound · Computer Science 2026-03-05 Nikita Kuznetsov , Maksim Kaledin

In this paper, we evaluate convolutional neural network (CNN) features using the AlexNet architecture and very deep convolutional network (VGGNet) architecture. To date, most CNN researchers have employed the last layers before output,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-28 Hirokatsu Kataoka , Kenji Iwata , Yutaka Satoh

Convolutional Neural Networks (CNN) are very popular in many fields including computer vision, speech recognition, natural language processing, to name a few. Though deep learning leads to groundbreaking performance in these domains, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Chaim Baskin , Natan Liss , Yoav Chai , Evgenii Zheltonozhskii , Eli Schwartz , Raja Giryes , Avi Mendelson , Alexander M. Bronstein

Recently ConvNets or convolutional neural networks (CNN) have come up as state-of-the-art classification and detection algorithms, achieving near-human performance in visual detection. However, ConvNet algorithms are typically very…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Bert Moons , Bert De Brabandere , Luc Van Gool , Marian Verhelst

Gated DeltaNet (GDN) is a linear attention mechanism that replaces the growing KV cache with a fixed-size recurrent state. Hybrid LLMs like Qwen3-Next use 75% GDN layers and achieve competitive accuracy to attention-only models. However, at…

Hardware Architecture · Computer Science 2026-03-09 Neelesh Gupta , Peter Wang , Rajgopal Kannan , Viktor K. Prasanna

Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel GNN models…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-20 Rishov Sarkar , Stefan Abi-Karam , Yuqi He , Lakshmi Sathidevi , Cong Hao