English
Related papers

Related papers: Rethinking Skip Connections: Additive U-Net for Ro…

200 papers

Time-To-First-Spike (TTFS) coding in Spiking Neural Networks (SNNs) offers significant advantages in terms of energy efficiency, closely mimicking the behavior of biological neurons. In this work, we delve into the role of skip connections,…

Signal Processing · Electrical Eng. & Systems 2023-12-05 Youngeun Kim , Adar Kahana , Ruokai Yin , Yuhang Li , Panos Stinis , George Em Karniadakis , Priyadarshini Panda

Deep neural networks with skip-connections, such as ResNet, show excellent performance in various image classification benchmarks. It is though observed that the initial motivation behind them - training deeper networks - does not actually…

Computer Vision and Pattern Recognition · Computer Science 2018-01-29 Sergey Zagoruyko , Nikos Komodakis

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Quality and intelligibility of speech signals are degraded under additive background noise which is a critical problem for hearing aid and cochlear implant users. Motivated to address this problem, we propose a novel speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-06 Hamidreza Baradaran Kashani , Ata Jodeiri , Mohammad Mohsen Goodarzi , Iman Sarraf Rezaei

Oversmoothing remains a persistent problem when applying deep learning to off-axis quantitative phase imaging (QPI). End-to-end U-Nets favour low-frequency content and under-represent fine, diagnostic detail. We trace this issue to spectral…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Yi Zhang

Variations of deep neural networks such as convolutional neural network (CNN) have been successfully applied to image denoising. The goal is to automatically learn a mapping from a noisy image to a clean image given training data consisting…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Tianyang Wang , Mingxuan Sun , Kaoning Hu

Recent advancements in information technology and the widespread use of the Internet have led to easier access to data worldwide. As a result, transmitting data through noisy channels is inevitable. Reducing the size of data and protecting…

Low-light raw denoising is an important and valuable task in computational photography where learning-based methods trained with paired real data are mainstream. However, the limited data volume and complicated noise distribution have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Hansen Feng , Lizhi Wang , Yuzhi Wang , Hua Huang

Spiking Neural Networks (SNNs) aim to bridge the gap between neuroscience and machine learning by emulating the structure of the human nervous system. However, like convolutional neural networks, SNNs are vulnerable to adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Weiran Chen , Qi Xu

We investigate the task of learning blind image denoising networks from an unpaired set of clean and noisy images. Such problem setting generally is practical and valuable considering that it is feasible to collect unpaired noisy and clean…

Image and Video Processing · Electrical Eng. & Systems 2020-09-01 Xiaohe Wu , Ming Liu , Yue Cao , Dongwei Ren , Wangmeng Zuo

Noise in seismic data arises from numerous sources and is continually evolving. The use of supervised deep learning procedures for denoising of seismic datasets often results in poor performance: this is due to the lack of noise-free field…

Geophysics · Physics 2022-09-27 Claire Birnie , Tariq Alkhalifah

The ship-detection task in satellite imagery presents significant obstacles to even the most state of the art segmentation models due to lack of labelled dataset or approaches which are not able to generalize to unseen images. The most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Venkatesh R , Anand Metha

Trace-wise noise is a type of noise often seen in seismic data, which is characterized by vertical coherency and horizontal incoherency. Using self-supervised deep learning to attenuate this type of noise, the conventional blind-trace deep…

Geophysics · Physics 2024-04-04 Mohammad Mahdi Abedi , David Pardo , Tariq Alkhalifah

Supervised learning-based methods yield robust denoising results, yet they are inherently limited by the need for large-scale clean/noisy paired datasets. The use of unsupervised denoisers, on the other hand, necessitates a more detailed…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Nahyun Kim , Donggon Jang , Sunhyeok Lee , Bomi Kim , Dae-Shik Kim

Over past few years afterward the birth of ResNet, skip connection has become the defacto standard for the design of modern architectures due to its widespread adoption, easy optimization and proven performance. Prior work has explained the…

Machine Learning · Computer Science 2023-03-03 Dengsheng Chen , Jie Hu , Wenwen Qiang , Xiaoming Wei , Enhua Wu

Deep Image Prior (DIP) shows that some network architectures naturally bias towards smooth images and resist noises, a phenomenon known as spectral bias. Image denoising is an immediate application of this property. Although DIP has removed…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Yilin Liu , Jiang Li , Yunkui Pang , Dong Nie , Pew-thian Yap

Despite inherent ill-definition, anomaly detection is a research endeavor of great interest within machine learning and visual scene understanding alike. Most commonly, anomaly detection is considered as the detection of outliers within a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Samet Akçay , Amir Atapour-Abarghouei , Toby P. Breckon

Channel denoising is a practical and effective technique for mitigating channel estimation errors in multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) systems. However, adapting denoising techniques to…

Signal Processing · Electrical Eng. & Systems 2025-08-14 Sungyoung Ha , Ikbeom Lee , Seunghyeon Jeon , Yo-Seb Jeon

We propose a fully-convolutional neural-network architecture for image denoising which is simple yet powerful. Its structure allows to exploit the gradual nature of the denoising process, in which shallow layers handle local noise…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Tal Remez , Or Litany , Raja Giryes , Alex M. Bronstein

Fast and flexible processing are two essential requirements for a number of practical applications of image denoising. Current state-of-the-art methods, however, still require either high computational cost or limited scopes of the target.…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Shunta Maeda