中文
相关论文

相关论文: Greedy Layerwise Learning Can Scale to ImageNet

200 篇论文

In recent years, Graph Neural Networks (GNNs) have shown superior performance on diverse applications on real-world datasets. To improve the model capacity and alleviate the over-smoothing problem, several methods proposed to incorporate…

机器学习 · 计算机科学 2021-12-28 Lanning Wei , Huan Zhao , Zhiqiang He

There is some theoretical evidence that deep neural networks with multiple hidden layers have a potential for more efficient representation of multidimensional mappings than shallow networks with a single hidden layer. The question is…

机器学习 · 计算机科学 2019-10-08 Bernhard Bermeitinger , Tomas Hrycej , Siegfried Handschuh

In recent developments in the field of Computer Vision, a rise is seen in the use of transformer-based architectures. They are surpassing the state-of-the-art set by CNN architectures in accuracy but on the other hand, they are…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Durvesh Malpure , Onkar Litake , Rajesh Ingle

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

机器学习 · 统计学 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

计算机视觉与模式识别 · 计算机科学 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Although deep convolutional neural networks (CNNs) have obtained outstanding performance in image superresolution (SR), their computational cost increases geometrically as CNN models get deeper and wider. Meanwhile, the features of…

图像与视频处理 · 电气工程与系统科学 2019-12-02 Seongmin Hwang , Gwanghuyn Yu , Cheolkon Jung , Jinyoung Kim

Neural networks have enabled state-of-the-art approaches to achieve incredible results on computer vision tasks such as object detection. However, such success greatly relies on costly computation resources, which hinders people with cheap…

计算机视觉与模式识别 · 计算机科学 2019-11-28 Chien-Yao Wang , Hong-Yuan Mark Liao , I-Hau Yeh , Yueh-Hua Wu , Ping-Yang Chen , Jun-Wei Hsieh

In this paper we explore tying together the ideas from Scattering Transforms and Convolutional Neural Networks (CNN) for Image Analysis by proposing a learnable ScatterNet. Previous attempts at tying them together in hybrid networks have…

计算机视觉与模式识别 · 计算机科学 2019-03-11 Fergal Cotter , Nick Kingsbury

Deep neural networks demonstrate to have a high performance on image classification tasks while being more difficult to train. Due to the complexity and vanishing gradient problem, it normally takes a lot of time and more computational…

计算机视觉与模式识别 · 计算机科学 2018-05-02 Mohammad Sadegh Ebrahimi , Hossein Karkeh Abadi

We present a novel method of using explainability techniques to design physics-aware neural networks. We demonstrate our approach by developing a convolutional neural network (CNN) for solving an inverse problem for shallow subsurface…

机器学习 · 计算机科学 2023-04-04 Jodie Crocker , Krishna Kumar , Brady R. Cox

We design a novel network architecture for learning discriminative image models that are employed to efficiently tackle the problem of grayscale and color image denoising. Based on the proposed architecture, we introduce two different…

计算机视觉与模式识别 · 计算机科学 2018-03-28 Stamatios Lefkimmiatis

Deep convolutional neural networks (CNNs) achieve remarkable performance on image classification tasks. Recent studies, however, have demonstrated that generalization abilities are more important than the depth of neural networks for…

计算机视觉与模式识别 · 计算机科学 2017-10-04 Atsushi Takeda

Convolutional neural networks (CNNs) learn abstract features to perform object classification, but understanding these features remains challenging due to difficult-to-interpret results or high computational costs. We propose an automatic…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Maren H. Wehrheim , Pamela Osuna-Vargas , Matthias Kaschube

Different from the conventional deep learning work based on an images content in computer vision, deep steganalysis is an art to detect the secret information embedded in an image via deep learning, pose challenge of detection weak…

多媒体 · 计算机科学 2018-04-19 Jianhua Yang , Yun-Qing Shi , Edward K. Wong , Xiangui Kang

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

机器学习 · 计算机科学 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

Residual networks (ResNets) represent a powerful type of convolutional neural network (CNN) architecture, widely adopted and used in various tasks. In this work we propose an improved version of ResNets. Our proposed improvements address…

计算机视觉与模式识别 · 计算机科学 2020-04-13 Ionut Cosmin Duta , Li Liu , Fan Zhu , Ling Shao

Deep learning has shown promising results in many machine learning applications. The hierarchical feature representation built by deep networks enable compact and precise encoding of the data. A kernel analysis of the trained deep networks…

机器学习 · 计算机科学 2017-03-22 Mandar Kulkarni , Shirish Karande

In this paper, we propose a novel deep neural network framework embedded with low-level features (LCNN) for salient object detection in complex images. We utilise the advantage of convolutional neural networks to automatically learn the…

计算机视觉与模式识别 · 计算机科学 2015-08-18 Hongyang Li , Huchuan Lu , Zhe Lin , Xiaohui Shen , Brian Price

In this paper, we study 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While efficient, the lacking of representational capability and the training difficulty impede 1-bit CNNs from…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Zechun Liu , Wenhan Luo , Baoyuan Wu , Xin Yang , Wei Liu , Kwang-Ting Cheng