English
Related papers

Related papers: Adaptive Fine-Tuning via Pattern Specialization fo…

200 papers

The paper describes the deep learning approach for forecasting non-stationary time series with using time trend correction in a neural network model. Along with the layers for predicting sales values, the neural network model includes a…

Machine Learning · Computer Science 2022-05-25 Bohdan M. Pavlyshenko

Machine Learning has considerably improved medical image analysis in the past years. Although data-driven approaches are intrinsically adaptive and thus, generic, they often do not perform the same way on data from different imaging…

Image and Video Processing · Electrical Eng. & Systems 2020-07-02 Marie Kloenne , Sebastian Niehaus , Leonie Lampe , Alberto Merola , Janis Reinelt , Ingo Roeder , Nico Scherf

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a…

Machine Learning · Computer Science 2022-05-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

When fine-tuning Deep Neural Networks (DNNs) to new data, DNNs are prone to overwriting network parameters required for task-specific functionality on previously learned tasks, resulting in a loss of performance on those tasks. We propose…

Machine Learning · Computer Science 2025-01-22 Christopher Angelini , Nidhal Bouaynaya

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy than traditional hand-crafted feature-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qiang Wang , Shaohuai Shi , Shizhen Zheng , Kaiyong Zhao , Xiaowen Chu

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long term prediction of the dynamics of the unknown system. In many real-world applications,…

Machine Learning · Computer Science 2022-06-07 Victor Churchill , Dongbin Xiu

The success of Deep Neural Networks (DNNs) highly depends on data quality. Moreover, predictive uncertainty makes high performing DNNs risky for real-world deployment. In this paper, we aim to address these two issues by proposing a unified…

Machine Learning · Computer Science 2020-09-28 Krishanu Sarker , Xiulong Yang , Yang Li , Saeid Belkasim , Shihao Ji

The task of clustering unlabeled time series and sequences entails a particular set of challenges, namely to adequately model temporal relations and variable sequence lengths. If these challenges are not properly handled, the resulting…

Machine Learning · Statistics 2019-02-19 Daniel J. Trosten , Andreas S. Strauman , Michael Kampffmeyer , Robert Jenssen

Deep learning has shown impressive results in a variety of time series forecasting tasks, where modeling the conditional distribution of the future given the past is the essence. However, when this conditional distribution is…

Machine Learning · Computer Science 2024-02-27 Siqi Liu , Andreas Lehrmann

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

A Deep Neural Network (DNN) based algorithm is proposed for the detection and classification of faults in industrial plants. The proposed algorithm has the ability to classify faults, especially incipient faults that are difficult to detect…

Machine Learning · Computer Science 2022-12-02 Piyush Agarwal , Jorge Ivan Mireles Gonzalez , Ali Elkamel , Hector Budman

Time series forecasting methods generally fall into two main categories: Channel Independent (CI) and Channel Dependent (CD) strategies. While CI overlooks important covariate relationships, CD captures all dependencies without distinction,…

Machine Learning · Computer Science 2025-05-21 Yifan Hu , Guibin Zhang , Peiyuan Liu , Disen Lan , Naiqi Li , Dawei Cheng , Tao Dai , Shu-Tao Xia , Shirui Pan

Deep Neural Networks (DNNs) are a promising tool for Global Navigation Satellite System (GNSS) positioning in the presence of multipath and non-line-of-sight errors, owing to their ability to model complex errors using data. However,…

Robotics · Computer Science 2022-06-23 Ashwin V. Kanhere , Shubh Gupta , Akshay Shetty , Grace Gao

Accurate forecasting of long-term time series has important applications for decision making and planning. However, it remains challenging to capture the long-term dependencies in time series data. To better extract long-term dependencies,…

Machine Learning · Computer Science 2024-05-15 Feifei Li , Suhan Guo , Feng Han , Jian Zhao , Furao Shen

Deep Learning has the hierarchical network architecture to represent the complicated features of input patterns. Such architecture is well known to represent higher learning capability compared with some conventional models if the best set…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Takumi Ichimura , Shin Kamada

In this paper, we develop a general theory for adaptive nonparametric estimation of the mean function of a non-stationary and nonlinear time series model using deep neural networks (DNNs). We first consider two types of DNN estimators,…

Statistics Theory · Mathematics 2024-05-06 Daisuke Kurisu , Riku Fukami , Yuta Koike

Recently, methods have been developed to accurately predict the testing performance of a Deep Neural Network (DNN) on a particular task, given statistics of its underlying topological structure. However, further leveraging this newly found…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Stuart Synakowski , Fabian Benitez-Quiroz , Aleix M. Martinez

Conventional DNN training paradigms typically rely on one training set and one validation set, obtained by partitioning an annotated dataset used for training, namely gross training set, in a certain way. The training set is used for…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Boyu Zhang , A. K. Qin , Hong Pan , Timos Sellis

Accurate precipitation estimates at individual locations are crucial for weather forecasting and spatial analysis. This study presents a paradigm shift by leveraging Deep Neural Networks (DNNs) to surpass traditional methods like Kriging…