English
Related papers

Related papers: Gradient-based Model Shortcut Detection for Time S…

200 papers

Time series analysis is a field of data science which is interested in analyzing sequences of numerical values ordered in time. Time series are particularly interesting because they allow us to visualize and understand the evolution of a…

Machine Learning · Computer Science 2020-10-02 Hassan Ismail Fawaz

Fine-grained categorization can benefit from part-based features which reveal subtle visual differences between object categories. Handcrafted features have been widely used for part detection and classification. Although a recent trend…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Ting Sun , Lin Sun , Dit-Yan Yeung

Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Manxi Lin , Nina Weng , Kamil Mikolaj , Zahra Bashir , Morten Bo Søndergaard Svendsen , Martin Tolsgaard , Anders Nymark Christensen , Aasa Feragen

There exist several data-driven approaches that enable us model time series data including traditional regression-based modeling approaches (i.e., ARIMA). Recently, deep learning techniques have been introduced and explored in the context…

Machine Learning · Computer Science 2021-12-20 Saroj Gopali , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin

Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these…

Machine Learning · Computer Science 2018-04-20 Guokun Lai , Wei-Cheng Chang , Yiming Yang , Hanxiao Liu

Deep neural networks often fail to generalize outside of their training distribution, in particular when only a single data domain is available during training. While test-time adaptation has yielded encouraging results in this setting, we…

Machine Learning · Computer Science 2022-12-26 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

This research identifies a gap in weakly-labelled multivariate time-series classification (TSC), where state-of-the-art TSC models do not per-form well. Weakly labelled time-series are time-series containing noise and significant…

Machine Learning · Computer Science 2021-09-20 Surayez Rahman , Chang Wei Tan

Training a neural network (NN) typically relies on some type of curve-following method, such as gradient descent (GD) (and stochastic gradient descent (SGD)), ADADELTA, ADAM or limited memory algorithms. Convergence for these algorithms…

Machine Learning · Computer Science 2023-05-08 Michael A Kouritzin , Stephen Styles , Beatrice-Helen Vritsiou

Transfer learning for deep neural networks is the process of first training a base network on a source dataset, and then transferring the learned features (the network's weights) to a second network to be trained on a target dataset. This…

Machine Learning · Computer Science 2019-01-29 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller

Recent studies have noted an intriguing phenomenon termed Neural Collapse, that is, when the neural networks establish the right correlation between feature spaces and the training targets, their last-layer features, together with the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yining Wang , Junjie Sun , Chenyue Wang , Mi Zhang , Min Yang

While deep learning has shown promise in improving the automated diagnosis of disease based on chest X-rays, deep networks may exhibit undesirable behavior related to shortcuts. This paper studies the case of spurious class skew in which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Sarah Jabbour , David Fouhey , Ella Kazerooni , Michael W. Sjoding , Jenna Wiens

Heterophily is a prevalent property of real-world graphs and is well known to impair the performance of homophilic Graph Neural Networks (GNNs). Prior work has attempted to adapt GNNs to heterophilic graphs through non-local neighbor…

Machine Learning · Computer Science 2026-04-22 Xiangmeng Wang , Qian Li , Haiyang Xia , Hao Miao , Qing Li , Guandong Xu

Time series classification is an increasing research topic due to the vast amount of time series data that are being created over a wide variety of fields. The particularity of the data makes it a challenging task and different approaches…

Machine Learning · Statistics 2018-06-13 Amaia Abanda , Usue Mori , Jose A. Lozano

Multivariate time series classification is an important task with widespread domains of applications. Recently, deep neural networks (DNN) have achieved state-of-the-art performance in time series classification. However, they often require…

Machine Learning · Computer Science 2024-09-17 Jesus Barreda , Ashley Gomez , Ruben Puga , Kaixiong Zhou , Li Zhang

This paper explores the connection between learning trajectories of Deep Neural Networks (DNNs) and their generalization capabilities when optimized using (stochastic) gradient descent algorithms. Instead of concentrating solely on the…

Machine Learning · Computer Science 2023-11-01 Jingwen Fu , Zhizheng Zhang , Dacheng Yin , Yan Lu , Nanning Zheng

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high…

Training deep neural networks often requires careful hyper-parameter tuning and significant computational resources. In this paper, we propose ConvTimeNet (CTN): an off-the-shelf deep convolutional neural network (CNN) trained on diverse…

Machine Learning · Computer Science 2019-05-03 Kathan Kashiparekh , Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic

Convolutional Neural Networks (CNN) has achieved a great success in image recognition task by automatically learning a hierarchical feature representation from raw data. While the majority of Time-Series Classification (TSC) literature is…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Nima Hatami , Yann Gavet , Johan Debayle

Aspect Category Detection (ACD) aims to identify implicit and explicit aspects in a given review sentence. The state-of-the-art approaches for ACD use Deep Neural Networks (DNNs) to address the problem as a multi-label classification task.…

Computation and Language · Computer Science 2024-04-09 Murtadha Ahmed , Qun Chen