English
Related papers

Related papers: Mitigating severe over-parameterization in deep co…

200 papers

This paper studies cross-domain lossy compression through the lens of minimum entropy coupling (MEC) with rate and classification constraints. In this setting, an encoder observes samples from a degraded source domain, while the decoder is…

Information Theory · Computer Science 2026-05-12 Nam Nguyen , Hassan Tavakoli , An Vuong , Thinh Nguyen , Bella Bose

The exponential growth in parameter size and computational complexity of deep models poses significant challenges for efficient deployment. The core problem of existing compression methods is that different layers of the model have…

Machine Learning · Computer Science 2025-12-24 Boyang Zhang , Daning Cheng , Yunquan Zhang , Meiqi Tu , Fangming Liu , Jiake Tian

Automated characterization of galactic substructure is an essential step in understanding the transformative physical processes driving galaxy evolution. In this study, we investigate the application of deep learning (DL) frameworks to…

Recently, deep learning methods such as the convolutional neural networks have gained prominence in the area of image denoising. This is owing to their proven ability to surpass state-of-the-art classical image denoising algorithms such as…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Basit O. Alawode , Mudassir Masood

We present Earliness-Aware Deep Convolutional Networks (EA-ConvNets), an end-to-end deep learning framework, for early classification of time series data. Unlike most existing methods for early classification of time series data, that are…

Machine Learning · Computer Science 2016-11-15 Wenlin Wang , Changyou Chen , Wenqi Wang , Piyush Rai , Lawrence Carin

Many DNN-enabled vision applications constantly operate under severe energy constraints such as unmanned aerial vehicles, Augmented Reality headsets, and smartphones. Designing DNNs that can meet a stringent energy budget is becoming…

Machine Learning · Computer Science 2019-04-09 Haichuan Yang , Yuhao Zhu , Ji Liu

Simulations of complex physical systems are typically realized by discretizing partial differential equations (PDEs) on unstructured meshes. While neural networks have recently been explored for surrogate and reduced order modeling of PDE…

Machine Learning · Computer Science 2021-10-27 Jiayang Xu , Aniruddhe Pradhan , Karthik Duraisamy

This paper examines three generic strategies for improving the performance of neuro-evolution techniques aimed at evolving convolutional neural networks (CNNs). These were implemented as part of the Evolutionary eXploration of Augmenting…

Neural and Evolutionary Computing · Computer Science 2018-11-21 Travis Desell

Our work aims to reproduce the set of findings published in "Network Deconvolution" by Ye et al. (2020)[1]. That paper proposes an optimization technique for model training in convolutional neural networks. The proposed technique "network…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Rochana R. Obadage , Kumushini Thennakoon , Sarah M. Rajtmajer , Jian Wu

This work proposes an unsupervised fusion framework based on deep convolutional transform learning. The great learning ability of convolutional filters for data analysis is well acknowledged. The success of convolutive features owes to…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

With the recently massive development in convolution neural networks, numerous lightweight CNN-based image super-resolution methods have been proposed for practical deployments on edge devices. However, most existing methods focus on one…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Yan Wang

Convolutional Neural Networks (CNN) are more suitable, indeed. However, fixed kernel sizes make traditional CNN too specific, neither flexible nor conducive to feature learning, thus impacting on the classification accuracy. The convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Muhammad Ahmad , Adil Mehmood Khan , Manuel Mazzara , Salvatore Distefano , Swalpa Kumar Roy , Xin Wu

High-efficiency deep learning (DL) models are necessary not only to facilitate their use in devices with limited resources but also to improve resources required for training. Convolutional neural networks (ConvNets) typically exert severe…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Christos Kyrkou

Modern neural networks have revolutionized the fields of computer vision (CV) and Natural Language Processing (NLP). They are widely used for solving complex CV tasks and NLP tasks such as image classification, image generation, and machine…

Machine Learning · Computer Science 2023-07-25 Xingyi Liu , Keshab K. Parhi

Ensemble learning has gain attention in resent deep learning research as a way to further boost the accuracy and generalizability of deep neural network (DNN) models. Recent ensemble training method explores different training algorithms or…

Machine Learning · Computer Science 2023-01-20 Jingchi Zhang , Huanrui Yang , Hai Li

Convolutional Neural Network is known as ConvNet have been extensively used in many complex machine learning tasks. However, hyperparameters optimization is one of a crucial step in developing ConvNet architectures, since the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Pushparaja Murugan

Compression is a standard procedure for making convolutional neural networks (CNNs) adhere to some specific computing resource constraints. However, searching for a compressed architecture typically involves a series of time-consuming…

Image and Video Processing · Electrical Eng. & Systems 2021-07-08 Suraj Mishra , Danny Z. Chen , X. Sharon Hu

Convolutional neural networks (CNNs) are one of the most widely used neural network architectures, showcasing state-of-the-art performance in computer vision tasks. Although larger CNNs generally exhibit higher accuracy, their size can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Sukhbinder Singh , Saeed S. Jahromi , Roman Orus

Deep Learning (DL) aims at learning the \emph{meaningful representations}. A meaningful representation refers to the one that gives rise to significant performance improvement of associated Machine Learning (ML) tasks by replacing the raw…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Deep neural networks do not discriminate between spurious and causal patterns, and will only learn the most predictive ones while ignoring the others. This shortcut learning behaviour is detrimental to a network's ability to generalize to…

Machine Learning · Computer Science 2023-01-11 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen