中文
相关论文

相关论文: What do CNNs Learn in the First Layer and Why? A L…

200 篇论文

Contrasting the previous evidence that neurons in the later layers of a Convolutional Neural Network (CNN) respond to complex object shapes, recent studies have shown that CNNs actually exhibit a `texture bias': given an image with both…

计算机视觉与模式识别 · 计算机科学 2021-01-28 Md Amirul Islam , Matthew Kowal , Patrick Esser , Sen Jia , Bjorn Ommer , Konstantinos G. Derpanis , Neil Bruce

Deep learning, in particular Convolutional Neural Network (CNN), has achieved promising results in face recognition recently. However, it remains an open question: why CNNs work well and how to design a 'good' architecture. The existing…

计算机视觉与模式识别 · 计算机科学 2015-04-10 Guosheng Hu , Yongxin Yang , Dong Yi , Josef Kittler , William Christmas , Stan Z. Li , Timothy Hospedales

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

计算机视觉与模式识别 · 计算机科学 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Toward a deeper understanding on the inner work of deep neural networks, we investigate CNN (convolutional neural network) using DCN (deconvolutional network) and randomization technique, and gain new insights for the intrinsic property of…

计算机视觉与模式识别 · 计算机科学 2018-02-21 Kun He , Jingbo Wang , Haochuan Li , Yao Shu , Mengxiao Zhang , Man Zhu , Liwei Wang , John E. Hopcroft

We study the learning ability of linear recurrent neural networks with Gradient Descent. We prove the first theoretical guarantee on linear RNNs to learn any stable linear dynamic system using any a large type of loss functions. For an…

机器学习 · 计算机科学 2023-10-24 Lifu Wang , Tianyu Wang , Shengwei Yi , Bo Shen , Bo Hu , Xing Cao

In this paper, we address the issue of how to enhance the generalization performance of convolutional neural networks (CNN) in the early learning stage for image classification. This is motivated by real-time applications that require the…

计算机视觉与模式识别 · 计算机科学 2018-05-11 Xishuang Dong , Hsiang-Huang Wu , Yuzhong Yan , Lijun Qian

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

The efficiency of recurrent neural networks (RNNs) in dealing with sequential data has long been established. However, unlike deep, and convolution networks where we can attribute the recognition of a certain feature to every layer, it is…

机器学习 · 计算机科学 2020-01-15 Stefan Horoi , Guillaume Lajoie , Guy Wolf

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

信号处理 · 电气工程与系统科学 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

The Convolutional Neural Network (CNN) model, often used for image classification, requires significant training time to obtain high accuracy. To this end, distributed training is performed with the parameter server (PS) architecture using…

分布式、并行与集群计算 · 计算机科学 2019-01-18 Jay H. Park , Sunghwan Kim , Jinwon Lee , Myeongjae Jeon , Sam H. Noh

Representations learned by pre-training a neural network on a large dataset are increasingly used successfully to perform a variety of downstream tasks. In this work, we take a closer look at how features are encoded in such pre-trained…

机器学习 · 计算机科学 2023-11-15 Vedant Nanda , Till Speicher , John P. Dickerson , Soheil Feizi , Krishna P. Gummadi , Adrian Weller

Building on our prior explorations of convolutional neural networks (CNNs) for financial data processing, this paper introduces two significant enhancements to refine our CNN model's predictive performance and robustness for financial…

计算金融 · 定量金融 2024-08-23 Sina Montazeri , Haseebullah Jumakhan , Sonia Abrasiabian , Amir Mirzaeinia

Convolutional neural networks (CNNs) have shown very promising performance in recent years for different problems, including object recognition, face recognition, medical image analysis, etc. However, generally the trained CNN models are…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Roshan Reddy Yedla , Shiv Ram Dubey

In this paper, a straightforward enhancement learning algorithm based on Separation Index (SI) concept is proposed for Convolutional Neural Networks (CNNs). At first, the SI as a supervised complexity measure is explained its usage in…

机器学习 · 计算机科学 2022-01-17 Ali Karimi , Ahmad Kalhor

Convolutional neural networks (CNNs) have been successfully used in a range of tasks. However, CNNs are often viewed as "black-box" and lack of interpretability. One main reason is due to the filter-class entanglement -- an intricate…

计算机视觉与模式识别 · 计算机科学 2021-07-02 Haoyu Liang , Zhihao Ouyang , Yuyuan Zeng , Hang Su , Zihao He , Shu-Tao Xia , Jun Zhu , Bo Zhang

Pre-trained Deep Neural Network (DNN) models are increasingly used in smartphones and other user devices to enable prediction services, leading to potential disclosures of (sensitive) information from training data captured inside these…

密码学与安全 · 计算机科学 2019-07-16 Fan Mo , Ali Shahin Shamsabadi , Kleomenis Katevas , Andrea Cavallaro , Hamed Haddadi

The convolutional layers are core building blocks of neural network architectures. In general, a convolutional filter applies to the entire frequency spectrum of the input data. We explore artificially constraining the frequency spectra of…

机器学习 · 计算机科学 2019-11-22 Adam Dziedzic , John Paparrizos , Sanjay Krishnan , Aaron Elmore , Michael Franklin

Many state-of-the-art computer vision algorithms use large scale convolutional neural networks (CNNs) as basic building blocks. These CNNs are known for their huge number of parameters, high redundancy in weights, and tremendous computing…

计算机视觉与模式识别 · 计算机科学 2018-01-24 Qiangui Huang , Kevin Zhou , Suya You , Ulrich Neumann

While convolutional neural networks (CNNs) excel at clean image classification, they struggle to classify images corrupted with different common corruptions, limiting their real-world applicability. Recent work has shown that incorporating…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Lucas Piper , Arlindo L. Oliveira , Tiago Marques

The deep convolutional neural network (DCNN) in computer vision has given promising results. It is widely applied in many areas, from medicine, agriculture, self-driving car, biometric system, and almost all computer vision-based…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Gaurav Hirani , Waleed Abdulla