English
Related papers

Related papers: A Temporal Kernel Approach for Deep Learning with …

200 papers

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Time delay neural networks (TDNNs) are an effective acoustic model for large vocabulary speech recognition. The strength of the model can be attributed to its ability to effectively model long temporal contexts. However, current TDNN models…

Computation and Language · Computer Science 2018-02-21 Florian Kreyssig , Chao Zhang , Philip Woodland

This paper introduces kernel continual learning, a simple but effective variant of continual learning that leverages the non-parametric nature of kernel methods to tackle catastrophic forgetting. We deploy an episodic memory unit that…

Machine Learning · Computer Science 2021-07-16 Mohammad Mahdi Derakhshani , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

The state-of-the-art CNN models give good performance on sentence classification tasks. The purpose of this work is to empirically study desirable properties such as semantic coherence, attention mechanism and reusability of CNNs in these…

Computation and Language · Computer Science 2016-10-11 Madhusudan Lakshmana , Sundararajan Sellamanickam , Shirish Shevade , Keerthi Selvaraj

Unsupervised learning of time series data, also known as temporal clustering, is a challenging problem in machine learning. Here we propose a novel algorithm, Deep Temporal Clustering (DTC), to naturally integrate dimensionality reduction…

Machine Learning · Computer Science 2018-02-06 Naveen Sai Madiraju , Seid M. Sadat , Dimitry Fisher , Homa Karimabadi

We present a simple and effective deep convolutional neural network (CNN) model for video deblurring. The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps. It…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jinshan Pan , Haoran Bai , Jinhui Tang

The prediction of periodical time-series remains challenging due to various types of data distortions and misalignments. Here, we propose a novel model called Temporal embedding-enhanced convolutional neural Network (TeNet) to learn…

Machine Learning · Computer Science 2022-02-09 Jiajun Liu , Kun Zhao , Brano Kusy , Ji-rong Wen , Raja Jurdak

Time series anomaly detection plays a critical role in automated monitoring systems. Most previous deep learning efforts related to time series anomaly detection were based on recurrent neural networks (RNN). In this paper, we propose a…

Machine Learning · Computer Science 2019-06-03 Tailai Wen , Roy Keyes

Temporal Graph Neural Networks (TGNNs) are a family of graph neural networks designed to model and learn dynamic information from temporal graphs. Given their substantial empirical success, there is an escalating interest in TGNNs within…

Machine Learning · Computer Science 2024-12-17 Junwei Su , Shan Wu

We consider the prediction problem of a continuous-time stochastic process on an entire time-interval in terms of its recent past. The approach we adopt is based on functional kernel nonparametric regression estimation techniques where…

Statistics Theory · Mathematics 2007-06-13 Anestis Antoniadis , Efstathios Paparoditis , Theofanis Sapatinas

The work in this paper is driven by the question how to exploit the temporal cues available in videos for their accurate classification, and for human action recognition in particular? Thus far, the vision community has focused on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Ali Diba , Mohsen Fayyaz , Vivek Sharma , Amir Hossein Karami , Mohammad Mahdi Arzani , Rahman Yousefzadeh , Luc Van Gool

Deep learning-based blind super-resolution (SR) methods have recently achieved unprecedented performance in upscaling frames with unknown degradation. These models are able to accurately estimate the unknown downscaling kernel from a given…

Image and Video Processing · Electrical Eng. & Systems 2021-08-20 Lichuan Xiang , Royson Lee , Mohamed S. Abdelfattah , Nicholas D. Lane , Hongkai Wen

The growing availability and importance of time series data across various domains, including environmental science, epidemiology, and economics, has led to an increasing need for time-series causal discovery methods that can identify the…

Machine Learning · Computer Science 2024-04-03 Omar Faruque , Sahara Ali , Xue Zheng , Jianwu Wang

Dynamic Graph Neural Networks (DGNNs) have emerged as the predominant approach for processing dynamic graph-structured data. However, the influence of temporal information on model performance and robustness remains insufficiently explored,…

Machine Learning · Computer Science 2023-11-27 Xiangjian Jiang , Yanyi Pu

Imitation learning enables high-fidelity, vision-based learning of policies within rich, photorealistic environments. However, such techniques often rely on traditional discrete-time neural models and face difficulties in generalizing to…

Machine Learning · Computer Science 2021-08-18 Charles Vorbach , Ramin Hasani , Alexander Amini , Mathias Lechner , Daniela Rus

We introduce in this paper the principle of Deep Temporal Networks that allow to add time to convolutional networks by allowing deep integration principles not only using spatial information but also increasingly large temporal window. The…

Neural and Evolutionary Computing · Computer Science 2018-11-20 Marco Macanovic , Fabian Chersi , Felix Rutard , Sio-Hoi Ieng , Ryad Benosman

Human learners can readily understand speech, or a melody, when it is presented slower or faster than usual. Although deep convolutional neural networks (CNNs) are extremely powerful in extracting information from time series, they require…

Machine Learning · Computer Science 2022-07-01 Brandon G. Jacques , Zoran Tiganj , Aakash Sarkar , Marc W. Howard , Per B. Sederberg

Temporal networks are effective in capturing the evolving interactions of networks over time, such as social networks and e-commerce networks. In recent years, researchers have primarily concentrated on developing specific model…

Machine Learning · Computer Science 2025-07-11 Ziyue Chen , Tongya Zheng , Mingli Song

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang