English
Related papers

Related papers: Models Matter, So Does Training: An Empirical Stud…

200 papers

Deep convolutional neural networks (CNNs) have achieved remarkable success in various fields. However, training an excellent CNN is practically a trial-and-error process that consumes a tremendous amount of time and computer resources. To…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Dongyu Liu , Weiwei Cui , Kai Jin , Yuxiao Guo , Huamin Qu

We propose a new pipeline for optical flow computation, based on Deep Learning techniques. We suggest using a Siamese CNN to independently, and in parallel, compute the descriptors of both images. The learned descriptors are then compared…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 David Gadot , Lior Wolf

Convolutional Neural Networks (CNNs) dominate various computer vision tasks since Alex Krizhevsky showed that they can be trained effectively and reduced the top-5 error from 26.2 % to 15.3 % on the ImageNet large scale visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Martin Thoma

Deep neural networks, albeit their great success on feature learning in various computer vision tasks, are usually considered as impractical for online visual tracking because they require very long training time and a large number of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Hanxi Li , Yi Li , Fatih Porikli

Existing recurrent optical flow estimation networks are computationally expensive since they use a fixed large number of iterations to update the flow field for each sample. An efficient network should skip iterations when the flow…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Ri Cheng , Ruian He , Xuhao Jiang , Shili Zhou , Weimin Tan , Bo Yan

We focus on a convolutional neural network (CNN), which has recently been utilized for fluid flow analyses, from the perspective on the influence of various operations inside it by considering some canonical regression problems with fluid…

Fluid Dynamics · Physics 2021-08-18 Masaki Morimoto , Kai Fukami , Kai Zhang , Aditya G. Nair , Koji Fukagata

Transformer is a potentially powerful architecture for vision tasks. Although equipped with more parameters and attention mechanism, its performance is not as dominant as CNN currently. CNN is usually computationally cheaper and still the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Bei Tong , Xiaoyuan Yu

We present CompactFlowNet, the first real-time mobile neural network for optical flow prediction, which involves determining the displacement of each pixel in an initial frame relative to the corresponding pixel in a subsequent frame.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Andrei Znobishchev , Valerii Filev , Oleg Kudashev , Nikita Orlov , Humphrey Shi

It is widely believed that the practical success of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) owes to the fact that CNNs and RNNs use a more compact parametric representation than their Fully-Connected Neural…

Machine Learning · Statistics 2019-07-02 Simon S. Du , Yining Wang , Xiyu Zhai , Sivaraman Balakrishnan , Ruslan Salakhutdinov , Aarti Singh

Convolutional neural networks (CNNs) are the cutting edge model for supervised machine learning in computer vision. In recent years CNNs have outperformed traditional approaches in many computer vision tasks such as object detection, image…

Neural and Evolutionary Computing · Computer Science 2016-03-01 Nitzan Guberman

Large machine learning models based on Convolutional Neural Networks (CNNs) with rapidly increasing number of parameters, trained with massive amounts of data, are being deployed in a wide array of computer vision tasks from self-driving…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Rishab Parthasarathy , Rohan Bhowmik

Neural networks, especially convolutional neural networks (CNN), are one of the most common tools these days used in computer vision. Most of these networks work with real-valued data using real-valued features. Complex-valued convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Soumick Chatterjee , Pavan Tummala , Oliver Speck , Andreas Nürnberger

Scaling CNN training is necessary to keep up with growing datasets and reduce training time. We also see an emerging need to handle datasets with very large samples, where memory requirements for training are large. Existing training…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-18 Nikoli Dryden , Naoya Maruyama , Tom Benson , Tim Moon , Marc Snir , Brian Van Essen

This paper addresses the challenge of dense pixel correspondence estimation between two images. This problem is closely related to optical flow estimation task where ConvNets (CNNs) have recently achieved significant progress. While optical…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Iaroslav Melekhov , Aleksei Tiulpin , Torsten Sattler , Marc Pollefeys , Esa Rahtu , Juho Kannala

Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yahui Liu , Enver Sangineto , Wei Bi , Nicu Sebe , Bruno Lepri , Marco De Nadai

Convolutional Neural Networks (CNNs) achieve remarkable accuracy in vision tasks, yet their computational complexity challenges low-power edge deployment. In this work, we present COMET, a framework of CNN models that employ efficient…

Signal Processing · Electrical Eng. & Systems 2026-04-09 Boyang Chen , Mohd Tasleem Khan , George Goussetis , Mathini Sellathurai , Yuan Ding , João F. C. Mota , Jongeun Lee

We present an approach to utilize large amounts of web data for learning CNNs. Specifically inspired by curriculum learning, we present a two-step approach for CNN training. First, we use easy images to train an initial visual…

Computer Vision and Pattern Recognition · Computer Science 2015-10-09 Xinlei Chen , Abhinav Gupta

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

Machine Learning · Computer Science 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

Optical flow estimation is a challenging problem remaining unsolved. Recent deep learning based optical flow models have achieved considerable success. However, these models often train networks from the scratch on standard optical flow…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Qiaole Dong , Chenjie Cao , Yanwei Fu

We reduce training time in convolutional networks (CNNs) with a method that, for some of the mini-batches: a) scales down the resolution of input images via downsampling, and b) reduces the forward pass operations via pooling on the…

Machine Learning · Computer Science 2019-10-16 Zissis Poulos , Ali Nouri , Andreas Moshovos