English
Related papers

Related papers: Dilated Convolutional Neural Networks for Lightwei…

200 papers

Dilated convolution with learnable spacings (DCLS) is a recent convolution method in which the positions of the kernel elements are learned throughout training by backpropagation. Its interest has recently been demonstrated in computer…

Sound · Computer Science 2023-11-23 Ismail Khalfaoui-Hassani , Timothée Masquelier , Thomas Pellegrini

It is well known that a systematic analysis of the pupil size variations, recorded by means of an eye-tracker, is a rich source of information about a subject's arousal and cognitive state. Current methods for pupil analysis are limited to…

Image and Video Processing · Electrical Eng. & Systems 2020-06-22 Dario Zanca , Alessandra Rufa

As aliasing artefacts are highly structural and non-local, many MRI reconstruction networks use pooling to enlarge filter coverage and incorporate global context. However, this inadvertently impedes fine detail recovery as downsampling…

Image and Video Processing · Electrical Eng. & Systems 2023-12-01 Wendi Ma , Marlon Bran Lorenzana , Wei Dai , Hongfu Sun , Shekhar S. Chandra

Recently, many Convolution Neural Networks (CNN) have been successfully employed in bitemporal SAR image change detection. However, most of the existing networks are too heavy and occupy a large volume of memory for storage and calculation.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Rongfang Wang , Fan Ding , Licheng Jiao , Jia-Wei Chen , Bo Liu , Wenping Ma , Mi Wang

In this work we explore recent advances in Recurrent Neural Networks for large scale Language Modeling, a task central to language understanding. We extend current models to deal with two key challenges present in this task: corpora and…

Computation and Language · Computer Science 2016-02-15 Rafal Jozefowicz , Oriol Vinyals , Mike Schuster , Noam Shazeer , Yonghui Wu

Vanilla convolutional neural networks are known to provide superior performance not only in image recognition tasks but also in natural language processing and time series analysis. One of the strengths of convolutional layers is the…

Machine Learning · Computer Science 2019-05-09 Gavneet Singh Chadha , Jan Niclas Reimann , Andreas Schwung

We propose a novel model for multi-label text classification, which is based on sequence-to-sequence learning. The model generates higher-level semantic unit representations with multi-level dilated convolution as well as a corresponding…

Computation and Language · Computer Science 2018-11-13 Junyang Lin , Qi Su , Pengcheng Yang , Shuming Ma , Xu Sun

Spatial relations between objects in an image have proved useful for structural object recognition. Structural constraints can act as regularization in neural network training, improving generalization capability with small datasets.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Mateus Riva , Pietro Gori , Florian Yger , Roberto Cesar , Isabelle Bloch

Low-light image enhancement is a classical computer vision problem aiming to recover normal-exposure images from low-light images. However, convolutional neural networks commonly used in this field are good at sampling low-frequency local…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Yunliang Zhuang , Zhuoran Zheng , Chen Lyu

We improve automatic correction of grammatical, orthographic, and collocation errors in text using a multilayer convolutional encoder-decoder neural network. The network is initialized with embeddings that make use of character N-gram…

Computation and Language · Computer Science 2018-01-29 Shamil Chollampatt , Hwee Tou Ng

Unsupervised deep learning methods for solving audio restoration problems extensively rely on carefully tailored neural architectures that carry strong inductive biases for defining priors in the time or spectral domain. In this context,…

Convolutional neural networks have been proven effective in a variety of image restoration tasks. Most state-of-the-art solutions, however, are trained using images with a single particular degradation level, and their performance…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Yiwen Guo , Ming Lu , Wangmeng Zuo , Changshui Zhang , Yurong Chen

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning community over the last…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Chen Qin , Jo Schlemper , Jose Caballero , Anthony Price , Joseph V. Hajnal , Daniel Rueckert

Diagonal linear networks (DLNs) are a toy simplification of artificial neural networks; they consist in a quadratic reparametrization of linear regression inducing a sparse implicit regularization. In this paper, we describe the trajectory…

Machine Learning · Computer Science 2023-11-14 Raphaël Berthier

In this work we reduce undersampling artefacts in two-dimensional ($2D$) golden-angle radial cine cardiac MRI by applying a modified version of the U-net. We train the network on $2D$ spatio-temporal slices which are previously extracted…

Image and Video Processing · Electrical Eng. & Systems 2019-08-14 Andreas Kofler , Marc Dewey , Tobias Schaeffter , Christian Wald , Christoph Kolbitsch

Ancient manuscripts are frequently damaged, containing gaps in the text known as lacunae. In this paper, we present a bidirectional RNN model for character prediction of Coptic characters in manuscript lacunae. Our best model performs with…

Computation and Language · Computer Science 2024-07-18 Lauren Levine , Cindy Tung Li , Lydia Bremer-McCollum , Nicholas Wagner , Amir Zeldes

Convolutional Neural Networks have been used in a variety of image related applications after their rise in popularity due to ImageNet competition. Convolutional Neural Networks have shown remarkable results in applications including face…

Machine Learning · Computer Science 2023-01-18 Anshumaan Chauhan , Siddhartha Bhattacharyya , S. Vadivel

Convolutional Recurrent Neural Network (CRNN) is a popular network for recognizing texts in images. Advances like the variant of CRNN, such as Dense Convolutional Network with Connectionist Temporal Classification, has reduced the running…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Zhao Zhang , Zemin Tang , Yang Wang , Haijun Zhang , Shuicheng Yan , Meng Wang

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev