English
Related papers

Related papers: Class-Specific Attention (CSA) for Time-Series Cla…

200 papers

Missing data in time series is a pervasive problem that puts obstacles in the way of advanced analysis. A popular solution is imputation, where the fundamental challenge is to determine what values should be filled in. This paper proposes…

Machine Learning · Computer Science 2023-07-06 Wenjie Du , David Cote , Yan Liu

In multi-task learning (MTL) for visual scene understanding, it is crucial to transfer useful information between multiple tasks with minimal interferences. In this paper, we propose a novel architecture that effectively transfers…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Sunkyung Kim , Hyesong Choi , Dongbo Min

Remaining useful life prediction plays a crucial role in the health management of industrial systems. Given the increasing complexity of systems, data-driven predictive models have attracted significant research interest. Upon reviewing the…

Machine Learning · Computer Science 2024-01-30 Zhixin Huang , Yujiang He , Bernhard Sick

We propose a novel architecture for object classification, called Self-Attention Capsule Networks (SACN). SACN is the first model that incorporates the Self-Attention mechanism as an integral layer within the Capsule Network (CapsNet).…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Assaf Hoogi , Brian Wilcox , Yachee Gupta , Daniel L. Rubin

Self-attention has been successfully applied to video representation learning due to the effectiveness of modeling long range dependencies. Existing approaches build the dependencies merely by computing the pairwise correlations along…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Xudong Guo , Xun Guo , Yan Lu

In recent years, there has been an ever increasing amount of multivariate time series (MTS) data in various domains, typically generated by a large family of sensors such as wearable devices. This has led to the development of novel…

Machine Learning · Computer Science 2022-02-08 Kang Gu , Soroush Vosoughi , Temiloluwa Prioleau

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

Machine Learning · Computer Science 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao

In the real world, the class of a time series is usually labeled at the final time, but many applications require to classify time series at every time point. e.g. the outcome of a critical patient is only determined at the end, but he…

Machine Learning · Computer Science 2022-08-16 Chenxi Sun , Moxian Song , Derun Can , Baofeng Zhang , Shenda Hong , Hongyan Li

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

While deep learning, particularly convolutional neural networks (CNNs), has revolutionized remote sensing (RS) change detection (CD), existing approaches often miss crucial features due to neglecting global context and incomplete change…

Multimedia · Computer Science 2024-07-04 Yuhao Gao , Gensheng Pei , Mengmeng Sheng , Zeren Sun , Tao Chen , Yazhou Yao

This research identifies a gap in weakly-labelled multivariate time-series classification (TSC), where state-of-the-art TSC models do not per-form well. Weakly labelled time-series are time-series containing noise and significant…

Machine Learning · Computer Science 2021-09-20 Surayez Rahman , Chang Wei Tan

Deep Neural Networks (DNNs) have achieved remarkable success in many computer vision tasks recently, but the huge number of parameters and the high computation overhead hinder their deployments on resource-constrained edge devices. It is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mengran Liu , Weiwei Fang , Xiaodong Ma , Wenyuan Xu , Naixue Xiong , Yi Ding

Apart from the high accuracy of machine learning models, what interests many researchers in real-life problems (e.g., fraud detection, credit scoring) is to find hidden patterns in data; particularly when dealing with their challenging…

Neural Cellular Automata (NCA) offer a robust and interpretable approach to image classification, making them a promising choice for microscopy image analysis. However, a performance gap remains between NCA and larger, more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Chen Yang , Michael Deutges , Jingsong Liu , Han Li , Nassir Navab , Carsten Marr , Ario Sadafi

Channel attention mechanisms endeavor to recalibrate channel weights to enhance representation abilities of networks. However, mainstream methods often rely solely on global average pooling as the feature squeezer, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yangbo Jiang , Zhiwei Jiang , Le Han , Zenan Huang , Nenggan Zheng

Multivariate long-term time series forecasting is critical for applications such as weather prediction, and traffic analysis. In addition, the implementation of Transformer variants has improved prediction accuracy. Following these…

Machine Learning · Computer Science 2025-05-06 Minhyuk Lee , HyeKyung Yoon , MyungJoo Kang

Conventional time series classification approaches based on bags of patterns or shapelets face significant challenges in dealing with a vast amount of feature candidates from high-dimensional multivariate data. In contrast, deep neural…

Machine Learning · Computer Science 2023-06-07 Raneen Younis , Abdul Hakmeh , Zahra Ahmadi

This paper is a contribution towards interpretability of the deep learning models in different applications of time-series. We propose a temporal attention layer that is capable of selecting the relevant information to perform various…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Phongtharin Vinayavekhin , Subhajit Chaudhury , Asim Munawar , Don Joven Agravante , Giovanni De Magistris , Daiki Kimura , Ryuki Tachibana

The extraction of modular object-centric representations for downstream tasks is an emerging area of research. Learning grounded representations of objects that are guaranteed to be stable and invariant promises robust performance across…

Machine Learning · Computer Science 2024-01-26 Avinash Kori , Francesco Locatello , Fabio De Sousa Ribeiro , Francesca Toni , Ben Glocker

This paper investigates different methods and various neural network architectures applicable in the time series classification domain. The data is obtained from a fleet of gas sensors that measure and track quantities such as oxygen and…

Machine Learning · Computer Science 2023-07-06 Mohamed Abouelnaga , Julien Vitay , Aida Farahani