中文
相关论文

相关论文: CRONOS: Enhancing Deep Learning with Scalable GPU …

200 篇论文

The existing convolutional neural network pruning algorithms can be divided into two categories: coarse-grained clipping and fine-grained clipping. This paper proposes a coarse and fine-grained automatic pruning algorithm, which can achieve…

计算机视觉与模式识别 · 计算机科学 2020-10-15 Jingfei Chang

The omnipresence of deep learning architectures such as deep convolutional neural networks (CNN)s is fueled by the synergistic combination of ever-increasing labeled datasets and specialized hardware. Despite the indisputable success, the…

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Priyank Kalgaonkar , Mohamed El-Sharkawy

We introduce a generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The model assumes that the images in the dataset are non-linear mappings of…

图像与视频处理 · 电气工程与系统科学 2021-03-12 Qing Zou , Abdul Haseeb Ahmed , Prashant Nagpal , Stanley Kruger , Mathews Jacob

In this paper, we propose a novel Convolutional Neural Network (CNN) architecture for learning multi-scale feature representations with good tradeoffs between speed and accuracy. This is achieved by using a multi-branch network, which has…

计算机视觉与模式识别 · 计算机科学 2019-08-01 Chun-Fu Chen , Quanfu Fan , Neil Mallinar , Tom Sercu , Rogerio Feris

In this paper, we introduce a new optimization algorithm that is well suited for solving parameter estimation problems. We call our new method cubic regularized Newton with affine scaling (CRNAS). In contrast to so-called first-order…

最优化与控制 · 数学 2024-07-08 Chenyu Wu , Nuozhou Wang , Casey Garner , Kevin Leder , Shuzhong Zhang

We consider the task of decentralized minimization of the sum of smooth strongly convex functions stored across the nodes of a network. For this problem, lower bounds on the number of gradient computations and the number of communication…

最优化与控制 · 数学 2020-11-16 Dmitry Kovalev , Adil Salim , Peter Richtárik

Convolution Neural Networks (CNN) have been extremely successful in solving intensive computer vision tasks. The convolutional filters used in CNNs have played a major role in this success, by extracting useful features from the inputs.…

计算机视觉与模式识别 · 计算机科学 2020-01-08 Pravendra Singh , Pratik Mazumder , Vinay P. Namboodiri

Neural Network has been successfully applied to many real-world problems, such as image recognition and machine translation. However, for the current architecture of neural networks, it is hard to perform complex cognitive tasks, for…

神经与进化计算 · 计算机科学 2018-04-11 Liyao Gao

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

计算机视觉与模式识别 · 计算机科学 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

We present a distributed algorithm that enables a group of robots to collaboratively optimize the parameters of a deep neural network model while communicating over a mesh network. Each robot only has access to its own data and maintains…

机器人学 · 计算机科学 2022-01-25 Javier Yu , Joseph A. Vincent , Mac Schwager

Deep Convolutional Neural Networks (CNNs) have recently evinced immense success for various image recognition tasks. However, a question of paramount importance is somewhat unanswered in deep learning research - is the selected CNN optimal…

计算机视觉与模式识别 · 计算机科学 2016-04-26 Sukrit Shankar , Duncan Robertson , Yani Ioannou , Antonio Criminisi , Roberto Cipolla

The non-convexity of the artificial neural network (ANN) training landscape brings inherent optimization difficulties. While the traditional back-propagation stochastic gradient descent (SGD) algorithm and its variants are effective in…

机器学习 · 计算机科学 2025-06-18 Yatong Bai , Tanmay Gautam , Somayeh Sojoudi

Convolutional neural networks (CNNs) play a key role in deep learning applications. However, the large storage overheads and the substantial computation cost of CNNs are problematic in hardware accelerators. Computing-in-memory (CIM)…

硬件体系结构 · 计算机科学 2021-05-26 Syuan-Hao Sie , Jye-Luen Lee , Yi-Ren Chen , Chih-Cheng Lu , Chih-Cheng Hsieh , Meng-Fan Chang , Kea-Tiong Tang

Convolutional Neural Networks (CNNs) have a large number of parameters and take significantly large hardware resources to compute, so edge devices struggle to run high-level networks. This paper proposes a novel method to reduce the…

计算机视觉与模式识别 · 计算机科学 2023-01-27 Athul Shibu , Abhishek Kumar , Heechul Jung , Dong-Gyu Lee

This dissertation is devoted to provide advanced nonconvex nonsmooth variational models of (Magnetic Resonance Image) MRI reconstruction, efficient learnable image reconstruction algorithms and parameter training algorithms that improve the…

最优化与控制 · 数学 2023-03-06 Wanyu Bian

The paper presents Multi-layer Auto Resonance Networks (ARN), a new neural model, for image recognition. Neurons in ARN, called Nodes, latch on to an incoming pattern and resonate when the input is within its 'coverage.' Resonance allows…

计算机视觉与模式识别 · 计算机科学 2020-10-12 Shilpa Mayannavar , Uday Wali , V M Aparanji

We propose a new variant of AMSGrad, a popular adaptive gradient based optimization algorithm widely used for training deep neural networks. Our algorithm adds prior knowledge about the sequence of consecutive mini-batch gradients and…

机器学习 · 统计学 2020-11-04 Jun-Kun Wang , Xiaoyun Li , Belhal Karimi , Ping Li

We propose a network for Congested Scene Recognition called CSRNet to provide a data-driven and deep learning method that can understand highly congested scenes and perform accurate count estimation as well as present high-quality density…

计算机视觉与模式识别 · 计算机科学 2018-04-12 Yuhong Li , Xiaofan Zhang , Deming Chen