English
Related papers

Related papers: Invertible DenseNets with Concatenated LipSwish

200 papers

The transformer architecture by Vaswani et al. (2017) is now ubiquitous across application domains, from natural language processing to speech processing and image understanding. We propose DenseFormer, a simple modification to the standard…

Computation and Language · Computer Science 2024-03-22 Matteo Pagliardini , Amirkeivan Mohtashami , Francois Fleuret , Martin Jaggi

Recently, deep learning-based compressed sensing (CS) has achieved great success in reducing the sampling and computational cost of sensing systems and improving the reconstruction quality. These approaches, however, largely overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yu Zhou , Yu Chen , Xiao Zhang , Pan Lai , Lei Huang , Jianmin Jiang

Hyperspectral image (HSI) denoising is essentially ill-posed since a noisy HSI can be degraded from multiple clean HSIs. However, existing deep learning (DL)-based approaches only restore one clean HSI from the given noisy HSI with a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Qizhou Wang , Li Pang , Xiangyong Cao , Zhiqiang Tian , Deyu Meng

Convolutional Neural Networks (CNNs) filter the input data using spatial convolution operators with compact stencils. Commonly, the convolution operators couple features from all channels, which leads to immense computational cost in the…

Machine Learning · Computer Science 2019-05-17 Jonathan Ephrath , Lars Ruthotto , Eldad Haber , Eran Treister

Convolutional Neural Networks (CNNs) have revolutionized image classification by extracting spatial features and enabling state-of-the-art accuracy in vision-based tasks. The squeeze and excitation network proposed module gathers…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mahendran Narayanan

While modern representation learning relies heavily on global error signals, decentralized algorithms driven by local interactions offer a fundamental distributed alternative. However, the macroscopic convergence properties of these…

Machine Learning · Computer Science 2026-04-21 Zilin Li , Weiwei Xu , Xuchun Tong , Xuanbo Lu , Xuanqi Zhao

In order to enhance the real-time performance of convolutional neural networks(CNNs), more and more researchers are focusing on improving the efficiency of CNN. Based on the analysis of some CNN architectures, such as ResNet, DenseNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Qiuyu Zhu , Ruixin Zhang

We focus on the word-level visual lipreading, which requires recognizing the word being spoken, given only the video but not the audio. State-of-the-art methods explore the use of end-to-end neural networks, including a shallow (up to three…

Computer Vision and Pattern Recognition · Computer Science 2019-07-22 Xinshuo Weng , Kris Kitani

We present a psychoacoustically enhanced cost function to balance network complexity and perceptual performance of deep neural networks for speech denoising. While training the network, we utilize perceptual weights added to the ordinary…

Sound · Computer Science 2018-01-31 Kai Zhen , Aswin Sivaraman , Jongmo Sung , Minje Kim

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Networks (DenseNet), have achieved great success for image representation by discovering deep hierarchical information. However, most existing networks simply stacks the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Zhao Zhang , Zemin Tang , Yang Wang , Zheng Zhang , Choujun Zhan , Zhengjun Zha , Meng Wang

Deluge Networks (DelugeNets) are deep neural networks which efficiently facilitate massive cross-layer information inflows from preceding layers to succeeding layers. The connections between layers in DelugeNets are established through…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Jason Kuen , Xiangfei Kong , Gang Wang , Yap-Peng Tan

This paper presents a study of robust policy networks in deep reinforcement learning. We investigate the benefits of policy parameterizations that naturally satisfy constraints on their Lipschitz bound, analyzing their empirical performance…

Machine Learning · Computer Science 2025-02-07 Nicholas H. Barbara , Ruigang Wang , Ian R. Manchester

Deep net architectures have constantly evolved over the past few years, leading to significant advancements in a wide array of computer vision tasks. However, besides high accuracy, many applications also require a low computational load…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Idan Kligvasser , Tomer Michaeli

Detecting subtle defects in window frames, including dents and scratches, is vital for upholding product integrity and sustaining a positive brand perception. Conventional machine vision systems often struggle to identify these defects in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-14 Jorge Vasquez , Hemant K. Sharma , Tomotake Furuhata , Kenji Shimada

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Pruning is one of the most effective model reduction techniques. Deep networks require massive computation and such models need to be compressed to bring them on edge devices. Most existing pruning techniques are focused on vision-based…

Machine Learning · Computer Science 2020-04-30 Ramchalam Kinattinkara Ramakrishnan , Eyyüb Sari , Vahid Partovi Nia

With the rapid development of deep learning, a growing number of pre-trained models have been publicly available. However, deploying these fixed models in real-world IoT applications is challenging because different devices possess…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Maoyu Wang , Yao Lu , Jiaqi Nie , Zeyu Wang , Yun Lin , Qi Xuan , Guan Gui

Automatic segmentation of retinal vessels in fundus images plays an important role in the diagnosis of some diseases such as diabetes and hypertension. In this paper, we propose Deformable U-Net (DUNet), which exploits the retinal vessels'…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Qiangguo Jin , Zhaopeng Meng , Tuan D. Pham , Qi Chen , Leyi Wei , Ran Su

This paper studies the Speech Enhancement based on Deep Neural Networks. The proposed architecture gradually follows the signal transformation during enhancement by means of a visualization probe at each network block. Alongside the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-10 Jorge Llombart , Dayana Ribas , Antonio Miguel , Luis Vicente , Alfonso Ortega , Eduardo Lleida

Convolutional neural networks have achieved a great success in the recent years. Although, the way to maximize the performance of the convolutional neural networks still in the beginning. Furthermore, the optimization of the size and the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-21 Hussam Qassim , David Feinzimer , Abhishek Verma