中文
相关论文

相关论文: LightLayers: Parameter Efficient Dense and Convolu…

200 篇论文

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

机器学习 · 计算机科学 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Despite many modern applications of Deep Neural Networks (DNNs), the large number of parameters in the hidden layers makes them unattractive for deployment on devices with storage capacity constraints. In this paper we propose a Data-Driven…

机器学习 · 计算机科学 2021-07-14 Dimitris Papadimitriou , Swayambhoo Jain

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

Deep neural network models have a complex architecture and are overparameterized. The number of parameters is more than the whole dataset, which is highly resource-consuming. This complicates their application and limits its usage on…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Vasiliy Alekseev , Ilya Lukashevich , Ilia Zharikov , Ilya Vasiliev

Recently, deep learning methods such as the convolutional neural networks have gained prominence in the area of image denoising. This is owing to their proven ability to surpass state-of-the-art classical image denoising algorithms such as…

图像与视频处理 · 电气工程与系统科学 2024-09-02 Basit O. Alawode , Mudassir Masood

Deep neural networks (DNNs) have substantial computational requirements, which greatly limit their performance in resource-constrained environments. Recently, there are increasing efforts on optical neural networks and optical computing…

机器学习 · 计算机科学 2021-04-05 Yingjie Li , Ruiyang Chen , Berardi Sensale Rodriguez , Weilu Gao , Cunxi Yu

To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as $k\in\{1,2\}$) of powers of 2. In such…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Ruizhou Ding , Zeye Liu , Ting-Wu Chin , Diana Marculescu , R. D. , Blanton

Deep learning models like Transformers and Convolutional Neural Networks (CNNs) have revolutionized various domains, but their parameter-intensive nature hampers deployment in resource-constrained settings. In this paper, we introduce a…

机器学习 · 计算机科学 2024-01-31 Onur Can Koyun , Behçet Uğur Töreyin

Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common…

机器学习 · 计算机科学 2021-04-20 Lukas Baischer , Matthias Wess , Nima TaheriNejad

Deep learning-based low-light image enhancers have made significant progress in recent years, with a trend towards achieving satisfactory visual quality while gradually reducing the number of parameters and improving computational…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Nan An , Long Ma , Guangchao Han , Xin Fan , RIsheng Liu

LightNet is a lightweight, versatile and purely Matlab-based deep learning framework. The idea underlying its design is to provide an easy-to-understand, easy-to-use and efficient computational platform for deep learning research. The…

机器学习 · 计算机科学 2016-08-03 Chengxi Ye , Chen Zhao , Yezhou Yang , Cornelia Fermuller , Yiannis Aloimonos

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

机器学习 · 统计学 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Owing to flexible architectures of deep convolutional neural networks (CNNs), CNNs are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii)…

计算机视觉与模式识别 · 计算机科学 2019-03-05 Chunwei Tian , Yong Xu , Lunke Fei , Junqian Wang , Jie Wen , Nan Luo

This paper introduces a novel lightweight computational framework for enhancing images under low-light conditions, utilizing advanced machine learning and convolutional neural networks (CNNs). Traditional enhancement techniques often fail…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Zhuoheng Li , Yuheng Pan , Houcheng Yu , Zhiheng Zhang

Recently, many Convolution Neural Networks (CNN) have been successfully employed in bitemporal SAR image change detection. However, most of the existing networks are too heavy and occupy a large volume of memory for storage and calculation.…

图像与视频处理 · 电气工程与系统科学 2020-06-23 Rongfang Wang , Fan Ding , Licheng Jiao , Jia-Wei Chen , Bo Liu , Wenping Ma , Mi Wang

Modern neural network architectures for large-scale learning tasks have substantially higher model complexities, which makes understanding, visualizing and training these architectures difficult. Recent contributions to deep learning…

机器学习 · 计算机科学 2024-10-30 Jayadeva , Himanshu Pant , Mayank Sharma , Abhimanyu Dubey , Sumit Soman , Suraj Tripathi , Sai Guruju , Nihal Goalla

Deep neural networks (DNNs) are powerful machine learning models and have succeeded in various artificial intelligence tasks. Although various architectures and modules for the DNNs have been proposed, selecting and designing the…

神经与进化计算 · 计算机科学 2018-01-24 Shinichi Shirakawa , Yasushi Iwata , Youhei Akimoto

Deep Neural nets (NNs) with millions of parameters are at the heart of many state-of-the-art computer vision systems today. However, recent works have shown that much smaller models can achieve similar levels of performance. In this work,…

计算机视觉与模式识别 · 计算机科学 2015-07-23 Suraj Srinivas , R. Venkatesh Babu

Deep neural networks (DNNs) usually contain massive parameters, but there is redundancy such that it is guessed that the DNNs could be trained in low-dimensional subspaces. In this paper, we propose a Dynamic Linear Dimensionality Reduction…

机器学习 · 计算机科学 2021-08-17 Tao Li , Lei Tan , Qinghua Tao , Yipeng Liu , Xiaolin Huang

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

计算机视觉与模式识别 · 计算机科学 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi