English
Related papers

Related papers: Temporal Convolutional Attention-based Network For…

200 papers

Transformer networks have achieved remarkable success across diverse domains, leveraging a variety of architectural innovations, including residual connections. However, traditional residual connections, which simply sum the outputs of…

Machine Learning · Computer Science 2025-07-25 Mike Heddes , Adel Javanmard , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

Encoder-decoder models have become an effective approach for sequence learning tasks like machine translation, image captioning and speech recognition, but have yet to show competitive results for handwritten text recognition. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Johannes Michael , Roger Labahn , Tobias Grüning , Jochen Zöllner

Convolutional Neural Networks (CNNs) are used for a wide range of image-related tasks such as image classification and object detection. However, a large pre-trained CNN model contains a lot of redundancy considering the task-specific edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-09 Zhuwei Qin , Fuxun Yu , Xiang Chen

Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between…

Machine Learning · Computer Science 2019-09-20 Shun-Yao Shih , Fan-Keng Sun , Hung-yi Lee

Many time-series classification problems involve developing metrics that are invariant to temporal misalignment. In human activity analysis, temporal misalignment arises due to various reasons including differing initial phase, sensor…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Suhas Lohit , Qiao Wang , Pavan Turaga

Near-field channel estimation is a fundamental challenge in the sixth-generation (6G) wireless communication, where extremely large antenna arrays (ELAA) enable near-field communication (NFC) but introduce significant signal processing…

Signal Processing · Electrical Eng. & Systems 2025-05-21 Vu Tung Lam , Do Hai Son , Tran Thi Thuy Quynh , Le Trung Thanh

We propose the Temporal Point Cloud Networks (TPCN), a novel and flexible framework with joint spatial and temporal learning for trajectory prediction. Unlike existing approaches that rasterize agents and map information as 2D images or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Maosheng Ye , Tongyi Cao , Qifeng Chen

Recent studies have applied deep learning methods such as convolutional recurrent neural networks (CRNs) and Transformers to brain disease classification based on dynamic functional connectivity networks (dFCNs), such as Alzheimer's disease…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Zhixiang Zhang , Biao Jie , Zhengdong Wang , Jie Zhou , Yang Yang

Understanding how neuronal networks reorganize in response to external stimuli and give rise to behavior is a central challenge in neuroscience and artificial intelligence. However, existing methods often fail to capture the evolving…

Neurons and Cognition · Quantitative Biology 2025-06-02 Moein Khajehnejad , Forough Habibollahi , Ahmad Khajehnejad , Chris French , Brett J. Kagan , Adeel Razi

Since the beginning of this decade, CNN has been a very successful tool in the field of Computer Vision tasks.The invention of CNN was inspired from neuroscience and it shares a lot of anatomical similarities with our visual system.Inspired…

Image and Video Processing · Electrical Eng. & Systems 2020-10-12 Kaushik Das , Qianni Zhang

The Dual-Path Convolution Recurrent Network (DPCRN) was proposed to effectively exploit time-frequency domain information. By combining the DPRNN module with Convolution Recurrent Network (CRN), the DPCRN obtained a promising performance in…

Sound · Computer Science 2023-06-16 Liang Wan , Hongqing Liu , Yi Zhou , Jie Ji

In recent years, channel attention mechanism has been widely investigated due to its great potential in improving the performance of deep convolutional neural networks (CNNs) in many vision tasks. However, in most of the existing methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Yue Zhao , Junzhou Chen , Zirui Zhang , Ronghui Zhang

Encoder-decoder based Sequence to Sequence learning (S2S) has made remarkable progress in recent years. Different network architectures have been used in the encoder/decoder. Among them, Convolutional Neural Networks (CNN) and Self…

Computation and Language · Computer Science 2018-07-05 Kaitao Song , Xu Tan , Di He , Jianfeng Lu , Tao Qin , Tie-Yan Liu

In recent years, mining the knowledge from asynchronous sequences by Hawkes process is a subject worthy of continued attention, and Hawkes processes based on the neural network have gradually become the most hotly researched fields,…

Machine Learning · Computer Science 2021-12-30 Lu-ning Zhang , Jian-wei Liu , Zhi-yan Song , Xin Zuo

Pose-driven human-image animation diffusion models have shown remarkable capabilities in realistic human video synthesis. Despite the promising results achieved by previous approaches, challenges persist in achieving temporally consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jeongho Kim , Min-Jung Kim , Junsoo Lee , Jaegul Choo

The fusion technique is the key to the multimodal emotion recognition task. Recently, cross-modal attention-based fusion methods have demonstrated high performance and strong robustness. However, cross-modal attention suffers from redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Feng Liu , Ziwang Fu , Yunlong Wang , Qijian Zheng

Training deep recurrent neural network (RNN) architectures is complicated due to the increased network complexity. This disrupts the learning of higher order abstracts using deep RNN. In case of feed-forward networks training deep…

Computation and Language · Computer Science 2018-08-07 Murali Karthick Baskar , Martin Karafiat , Lukas Burget , Karel Vesely , Frantisek Grezl , Jan Honza Cernocky

Spatiotemporal predictive learning aims to generate future frames by learning from historical frames. In this paper, we investigate existing methods and present a general framework of spatiotemporal predictive learning, in which the spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Cheng Tan , Zhangyang Gao , Lirong Wu , Yongjie Xu , Jun Xia , Siyuan Li , Stan Z. Li

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction…

Machine Learning · Computer Science 2019-10-22 Shenghao Qin , Jiacheng Zhu , Jimmy Qin , Wenshuo Wang , Ding Zhao

Time series anomaly detection plays a critical role in automated monitoring systems. Most previous deep learning efforts related to time series anomaly detection were based on recurrent neural networks (RNN). In this paper, we propose a…

Machine Learning · Computer Science 2019-06-03 Tailai Wen , Roy Keyes
‹ Prev 1 8 9 10 Next ›