English
Related papers

Related papers: Machine learning initialization to accelerate Stok…

200 papers

Conventional deep convolutional neural networks (CNNs) apply convolution operators uniformly in space across all feature maps for hundreds of layers - this incurs a high computational cost for real-time applications. For many problems such…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mengye Ren , Andrei Pokrovsky , Bin Yang , Raquel Urtasun

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

Accurate wind speed forecasting is of great importance for many economic, business and management sectors. This paper introduces a new model based on convolutional neural networks (CNNs) for wind speed prediction tasks. In particular, we…

Machine Learning · Computer Science 2020-07-27 Kevin Trebing , Siamak Mehrkanoon

The training of vision transformer (ViT) networks on small-scale datasets poses a significant challenge. By contrast, convolutional neural networks (CNNs) have an architectural inductive bias enabling them to perform well on such problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jianqiao Zheng , Xueqian Li , Simon Lucey

In this work, we investigate the application of trainable and spectrally initializable matrix transformations on the feature maps produced by convolution operations. While previous literature has already demonstrated the possibility of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Michele Alberti , Angela Botros , Narayan Schuez , Rolf Ingold , Marcus Liwicki , Mathias Seuret

This paper investigates the application of the latest machine learning technique deep neural networks for classifying road surface conditions (RSC) based on images from smartphones. Traditional machine learning techniques such as support…

Image and Video Processing · Electrical Eng. & Systems 2018-12-19 Guangyuan Pan , Liping Fu , Ruifan Yu , Matthew Muresan

Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Lars Lien Ankile , Morgan Feet Heggland , Kjartan Krange

Over the past decade, deep learning research has been accelerated by increasingly powerful hardware, which facilitated rapid growth in the model complexity and the amount of data ingested. This is becoming unsustainable and therefore…

Machine Learning · Computer Science 2024-02-08 Damian Owerko , Charilaos I. Kanatsoulis , Alejandro Ribeiro

Context. Solar filament oscillations have been observed for many years, but recent advances in telescope capabilities now enable daily monitoring of these periodic motions, offering valuable insights into the structure of filaments. A…

Solar and Stellar Astrophysics · Physics 2025-02-19 G. Castelló , M. Luna , J. Terradas

Recently, convolutional neural networks (CNN) have demonstrated impressive performance in various computer vision tasks. However, high performance hardware is typically indispensable for the application of CNN models due to the high…

Computer Vision and Pattern Recognition · Computer Science 2016-05-17 Jiaxiang Wu , Cong Leng , Yuhang Wang , Qinghao Hu , Jian Cheng

Spiking neural networks (SNNs) are well suited for resource-constrained applications as they do not need expensive multipliers. In a typical rate-encoded SNN, a series of binary spikes within a globally fixed time window is used to fire the…

Neural and Evolutionary Computing · Computer Science 2022-11-16 Zhanglu Yan , Jun Zhou , Weng-Fai Wong

Augmenting transformation knowledge onto a convolutional neural network's weights has often yielded significant improvements in performance. For rotational transformation augmentation, an important element to recent approaches has been the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Rohan Ghosh , Anupam K. Gupta

We study the first-order scattering transform as a candidate for reducing the signal processed by a convolutional neural network (CNN). We show theoretical and empirical evidence that in the case of natural images and sufficiently small…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Edouard Oyallon , Eugene Belilovsky , Sergey Zagoruyko , Michal Valko

Spherical CNNs generalize CNNs to functions on the sphere, by using spherical convolutions as the main linear operation. The most accurate and efficient way to compute spherical convolutions is in the spectral domain (via the convolution…

Machine Learning · Computer Science 2023-06-09 Carlos Esteves , Jean-Jacques Slotine , Ameesh Makadia

Remarkable progress has been made in image recognition, primarily due to the availability of large-scale annotated datasets and the revival of deep CNN. CNNs enable learning data-driven, highly representative, layered hierarchical image…

Computer Vision and Pattern Recognition · Computer Science 2016-02-11 Hoo-Chang Shin , Holger R. Roth , Mingchen Gao , Le Lu , Ziyue Xu , Isabella Nogues , Jianhua Yao , Daniel Mollura , Ronald M. Summers

Identifying the distribution of users' transportation modes is an essential part of travel demand analysis and transportation planning. With the advent of ubiquitous GPS-enabled devices (e.g., a smartphone), a cost-effective approach for…

Machine Learning · Computer Science 2018-04-10 Sina Dabiri , Kevin Heaslip

The success of building a high-resolution velocity model using machine learning is hampered by generalization limitations that often limit the success of the approach on field data. This is especially true when relying on neural operators…

Geophysics · Physics 2025-09-25 Xiao Ma , Tariq Alkhalifah

This article implements a Convolutional Neural Network (CNN)-based deep learning model for solar-wind prediction. Images from the Atmospheric Imaging Assembly (AIA) at 193\.A wavelength are used for training. Solar-wind speed is taken from…

Solar and Stellar Astrophysics · Physics 2021-09-15 Hemapriya Raju , Saurabh Das

We propose a new method for creating computationally efficient convolutional neural networks (CNNs) by using low-rank representations of convolutional filters. Rather than approximating filters in previously-trained networks with more…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Yani Ioannou , Duncan Robertson , Jamie Shotton , Roberto Cipolla , Antonio Criminisi

The goal of Specular Neutron and X-ray Reflectometry is to infer materials Scattering Length Density (SLD) profiles from experimental reflectivity curves. This paper focuses on investigating an original approach to the ill-posed…

Computational Physics · Physics 2021-01-26 Juan Manuel Carmona-Loaiza , Zamaan Raza