English
Related papers

Related papers: Deep Learning Framework From Scratch Using Numpy

200 papers

We consider deep neural networks, in which the output of each node is a quadratic function of its inputs. Similar to other deep architectures, these networks can compactly represent any function on a finite training set. The main goal of…

Machine Learning · Computer Science 2014-02-21 Roi Livni , Shai Shalev-Shwartz , Ohad Shamir

DeepLog is an operational neurosymbolic framework that unifies logic and deep learning within standard PyTorch workflows. While existing neurosymbolic systems focus on a particular paradigm and semantics, DeepLog serves as a universal…

Differentiable programming is the combination of classical neural networks modules with algorithmic ones in an end-to-end differentiable model. These new models, that use automatic differentiation to calculate gradients, have new learning…

Dynamical Systems · Mathematics 2020-05-05 Adrián Hernández , José M. Amigó

The article proposes formulating and codifying a set of applied numerical methods, coined as Deep Learning Discrete Calculus (DLDC), that uses the knowledge from discrete numerical methods to interpret the deep learning algorithms through…

Numerical Analysis · Mathematics 2022-12-01 Sourav Saha , Chanwook Park , Stefan Knapik , Jiachen Guo , Owen Huang , Wing Kam Liu

We introduce a neural network (NN) strictly governed by Newton's Law, with the nature required basis functions derived from the fundamental classic mechanics. Then, by classifying the training model as a quick procedure of 'force pattern'…

Machine Learning · Computer Science 2018-10-18 Junqing Qiu , Guoren Zhong , Yihua Lu , Kun Xin , Huihuan Qian , Xi Zhu

Deep learning is an established framework for learning hierarchical data representations. While compute power is in abundance, one of the main challenges in applying this framework to robotic grasping has been obtaining the amount of data…

Robotics · Computer Science 2017-04-19 Matthew Veres , Medhat Moussa , Graham W. Taylor

Deep Learning (DL) is one of the hottest trends in machine learning as DL approaches produced results superior to the state-of-the-art in problematic areas such as image processing and natural language processing (NLP). To foster the growth…

Machine Learning · Computer Science 2020-05-07 Ghadeer Al-Bdour , Raffi Al-Qurran , Mahmoud Al-Ayyoub , Ali Shatnawi

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies

Deep learning (DL) has achieved great success in many applications, but it has been less well analyzed from the theoretical perspective. The unexplainable success of black-box DL models has raised questions among scientists and promoted the…

Robotics · Computer Science 2023-08-25 Huu-Thiet Nguyen , Chien Chern Cheah , Kar-Ann Toh

Rapid progress in deep learning is leading to a diverse set of quickly changing models, with a dramatically growing demand for compute. However, as frameworks specialize performance optimization to patterns in popular networks, they…

Machine Learning · Computer Science 2022-08-31 Oliver Rausch , Tal Ben-Nun , Nikoli Dryden , Andrei Ivanov , Shigang Li , Torsten Hoefler

We present a comprehensive, stacking-based framework for combining deep learning with good old-fashioned machine learning, called Deep GOld. Our framework involves ensemble selection from 51 retrained pretrained deep networks as first-level…

Machine Learning · Computer Science 2022-11-14 Moshe Sipper

Deep learning (DL) allows computer models to learn, visualize, optimize, refine, and predict data. To understand its present state, examining the most recent advancements and applications of deep learning across various domains is…

Visual change detection, aiming at segmentation of video frames into foreground and background regions, is one of the elementary tasks in computer vision and video analytics. The applications of change detection include anomaly detection,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Murari Mandal , Santosh Kumar Vipparthi

We describe a layer-by-layer algorithm for training deep convolutional networks, where each step involves gradient updates for a two layer network followed by a simple clustering algorithm. Our algorithm stems from a deep generative model…

Machine Learning · Computer Science 2018-06-26 Eran Malach , Shai Shalev-Shwartz

Deep learning neural network technique (DNN) is one of the most efficient and general approach of multivariate data analysis of the collider experiments. The important step of the analysis is the optimization of the input space for…

High Energy Physics - Phenomenology · Physics 2020-08-26 Andrei Chernoded , Lev Dudko , Georgi Vorotnikov , Petr Volkov , Dmitri Ovchinnikov , Maxim Perfilov , Artem Shporin

Deep learning has enabled major advances in the fields of computer vision, natural language processing, and multimedia among many others. Developing a deep learning system is arduous and complex, as it involves constructing neural network…

Machine Learning · Computer Science 2017-08-04 Hao Dong , Akara Supratak , Luo Mai , Fangde Liu , Axel Oehmichen , Simiao Yu , Yike Guo

Clustering is a class of unsupervised learning methods that has been extensively applied and studied in computer vision. Little work has been done to adapt it to the end-to-end training of visual features on large scale datasets. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Mathilde Caron , Piotr Bojanowski , Armand Joulin , Matthijs Douze

Depth from focus (DFF) is one of the classical ill-posed inverse problems in computer vision. Most approaches recover the depth at each pixel based on the focal setting which exhibits maximal sharpness. Yet, it is not obvious how to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Caner Hazirbas , Sebastian Georg Soyer , Maximilian Christian Staab , Laura Leal-Taixé , Daniel Cremers

Translating neural networks from theory to clinical practice has unique challenges, specifically in the field of neuroimaging. In this paper, we present DeepNeuro, a deep learning framework that is best-suited to putting deep learning…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Andrew Beers , James Brown , Ken Chang , Katharina Hoebel , Elizabeth Gerstner , Bruce Rosen , Jayashree Kalpathy-Cramer

Deep Neural Networks are widely used in academy as well as corporate and public applications, including safety critical applications such as health care and autonomous driving. The ability to explain their output is critical for safety…

Machine Learning · Computer Science 2024-03-14 Florian Eilers , Xiaoyi Jiang