中文
相关论文

相关论文: Optimizing Hyperparameters in CNNs using Bilevel P…

200 篇论文

Bilevel optimization has been applied to a wide variety of machine learning models, and numerous stochastic bilevel optimization algorithms have been developed in recent years. However, most existing algorithms restrict their focus on the…

机器学习 · 计算机科学 2023-03-28 Hongchang Gao , Bin Gu , My T. Thai

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

应用统计 · 统计学 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Complex networks theory has commonly been used for modelling and understanding the interactions taking place between the elements composing complex systems. More recently, the use of generative models has gained momentum, as they allow…

物理与社会 · 物理学 2016-05-19 Massimiliano Zanin , Marco Correia , Pedro A. C. Sousa , Jorge Cruz

Hyperparameter optimization is a challenging problem in developing deep neural networks. Decision of transfer layers and trainable layers is a major task for design of the transfer convolutional neural networks (CNN). Conventional transfer…

神经与进化计算 · 计算机科学 2021-03-08 Chen Li , JinZhe Jiang , YaQian Zhao , RenGang Li , EnDong Wang , Xin Zhang , Kun Zhao

Convolutional Neural Network is known as ConvNet have been extensively used in many complex machine learning tasks. However, hyperparameters optimization is one of a crucial step in developing ConvNet architectures, since the accuracy and…

计算机视觉与模式识别 · 计算机科学 2017-12-21 Pushparaja Murugan

Time Series Classification (TSC) has drawn a lot of attention in literature because of its broad range of applications for different domains, such as medical data mining, weather forecasting. Although TSC algorithms are designed for…

机器学习 · 计算机科学 2021-10-12 Syed Rawshon Jamil

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

计算机视觉与模式识别 · 计算机科学 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

Time Series Classification and Extrinsic Regression are important and challenging machine learning tasks. Deep learning has revolutionized natural language processing and computer vision and holds great promise in other fields such as time…

The availability of large amounts of time series data, paired with the performance of deep-learning algorithms on a broad class of problems, has recently led to significant interest in the use of sequence-to-sequence models for time series…

机器学习 · 计算机科学 2019-02-27 Vitaly Kuznetsov , Zelda Mariet

In this paper we survey the most recent advances in supervised machine learning and high-dimensional models for time series forecasting. We consider both linear and nonlinear alternatives. Among the linear methods we pay special attention…

计量经济学 · 经济学 2021-04-12 Ricardo P. Masini , Marcelo C. Medeiros , Eduardo F. Mendes

When artificial neural networks have demonstrated exceptional practical success in a variety of domains, investigations into their theoretical characteristics, such as their approximation power, statistical properties, and generalization…

机器学习 · 统计学 2023-10-06 Shijin Gong , Xinyu Zhang

Learning processes are useful methodologies able to improve knowledge of real phenomena. These are often dependent on hyperparameters, variables set before the training process and regulating the learning procedure. Hyperparameters…

最优化与控制 · 数学 2023-11-10 Flavia Esposito , Laura Selicato , Caterina Sportelli

This paper addresses a multi-label predictive fault classification problem for multidimensional time-series data. While fault (event) detection problems have been thoroughly studied in literature, most of the state-of-the-art techniques…

机器学习 · 计算机科学 2020-01-29 Wenyu Zhang , Devesh K. Jha , Emil Laftchiev , Daniel Nikovski

Convolutional neural network (CNN) is one of the most prominent architectures and algorithm in Deep Learning. It shows a remarkable improvement in the recognition and classification of objects. This method has also been proven to be very…

计算机视觉与模式识别 · 计算机科学 2016-10-10 Vina Ayumi , L. M. Rasdi Rere , Mohamad Ivan Fanany , Aniati Murni Arymurthy

As deep learning techniques advance more than ever, hyper-parameter optimization is the new major workload in deep learning clusters. Although hyper-parameter optimization is crucial in training deep learning models for high model…

机器学习 · 计算机科学 2019-11-26 Ahnjae Shin , Dong-Jin Shin , Sungwoo Cho , Do Yoon Kim , Eunji Jeong , Gyeong-In Yu , Byung-Gon Chun

Air quality forecasting has been regarded as the key problem of air pollution early warning and control management. In this paper, we propose a novel deep learning model for air quality (mainly PM2.5) forecasting, which learns the…

机器学习 · 计算机科学 2019-11-26 Shengdong Du , Tianrui Li , Yan Yang , Shi-Jinn Horng

Deep Learning (DL) models can be used to tackle time series analysis tasks with great success. However, the performance of DL models can degenerate rapidly if the data are not appropriately normalized. This issue is even more apparent when…

We study the feature-based newsvendor problem, in which a decision-maker has access to historical data consisting of demand observations and exogenous features. In this setting, we investigate feature selection, aiming to derive sparse,…

机器学习 · 计算机科学 2022-09-13 Breno Serrano , Stefan Minner , Maximilian Schiffer , Thibaut Vidal

In many scenarios, one uses a large training set to train a model with the goal of performing well on a smaller testing set with a different distribution. Learning a weight for each data point of the training set is an appealing solution,…

机器学习 · 统计学 2023-10-27 Anastasia Ivanova , Pierre Ablin

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…