English
Related papers

Related papers: Joint Neural Architecture and Hyperparameter Searc…

200 papers

Despite remarkable progress achieved, most neural architecture search (NAS) methods focus on searching for one single accurate and robust architecture. To further build models with better generalization capability and performance, model…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Minghao Chen , Houwen Peng , Jianlong Fu , Haibin Ling

Recently, there has been a growing interest in automating the process of neural architecture design, and the Differentiable Architecture Search (DARTS) method makes the process available within a few GPU days. However, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Hanwen Liang , Shifeng Zhang , Jiacheng Sun , Xingqiu He , Weiran Huang , Kechen Zhuang , Zhenguo Li

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

Machine Learning · Computer Science 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

Satellite Image Time Series (SITS) of the Earth's surface provide detailed land cover maps, with their quality in the spatial and temporal dimensions consistently improving. These image time series are integral for developing systems that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 James Brock , Zahraa S. Abdallah

Tensor network methods provide a scalable solution to represent high-dimensional data. However, their efficacy is often limited by static, expert-defined structures that fail to adapt to evolving data correlations. We address this…

Computational Engineering, Finance, and Science · Computer Science 2026-03-31 Zheng Guo , Aditya Deshpande , Xinyu Wang , Brian C. Kiedrowski , Alex A. Gorodetsky

Efficient hyperparameter or architecture search methods have shown remarkable results, but each of them is only applicable to searching for either hyperparameters (HPs) or architectures. In this work, we propose a unified pipeline, AutoHAS,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xuanyi Dong , Mingxing Tan , Adams Wei Yu , Daiyi Peng , Bogdan Gabrys , Quoc V. Le

Differentiable ARchiTecture Search (DARTS) has attracted much attention due to its simplicity and significant improvement in efficiency. However, the excessive accumulation of the skip connection, when training epochs become large, makes it…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Chao Li , Jia Ning , Han Hu , Kun He

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To…

Machine Learning · Computer Science 2025-09-03 Zhao Wei , Chin Chun Ooi , Yew-Soon Ong

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

Cross-temporal forecast reconciliation aims to ensure consistency across forecasts made at different temporal and cross-sectional levels. We explore the relationships between sequential, iterative, and optimal combination approaches, and…

Methodology · Statistics 2024-10-28 Daniele Girolimetto , Tommaso Di Fonzo

Most applications demand high-performance deep neural architectures costing limited resources. Neural architecture searching is a way of automatically exploring optimal deep neural networks in a given huge search space. However, all…

Machine Learning · Computer Science 2020-06-01 Yunhe Wang , Yixing Xu , Dacheng Tao

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

Machine Learning · Computer Science 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Due to increasing privacy concerns, neural network (NN) based secure inference (SI) schemes that simultaneously hide the client inputs and server models attract major research interests. While existing works focused on developing secure…

Cryptography and Security · Computer Science 2020-02-18 Song Bian , Weiwen Jiang , Qing Lu , Yiyu Shi , Takashi Sato

Accurately predicting the behavior of complex dynamical systems, characterized by high-dimensional multivariate time series(MTS) in interconnected sensor networks, is crucial for informed decision-making in various applications to minimize…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Krishna Sai Sudhir Aripirala , Shivam Gupta , Venkataramana Runkana

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

Topological Data Analysis (TDA) has emerged as a powerful tool for extracting meaningful features from complex data structures, driving significant advancements in fields such as neuroscience, biology, machine learning, and financial…

Machine Learning · Computer Science 2025-04-02 ZiXin Lin , Nur Fariha Syaqina Zulkepli

\textit{Differentiable ARchiTecture Search} (DARTS) has recently become the mainstream of neural architecture search (NAS) due to its efficiency and simplicity. With a gradient-based bi-level optimization, DARTS alternately optimizes the…

Machine Learning · Computer Science 2021-06-22 Miao Zhang , Steven Su , Shirui Pan , Xiaojun Chang , Ehsan Abbasnejad , Reza Haffari

Differentiable architecture search (DARTS) yields highly efficient gradient-based neural architecture search (NAS) by relaxing the discrete operation selection to optimize continuous architecture parameters that maps NAS from the discrete…

Machine Learning · Computer Science 2023-06-13 Jiuling Zhang , Zhiming Ding

Click-Through Rate (CTR) prediction is one of the most important machine learning tasks in recommender systems, driving personalized experience for billions of consumers. Neural architecture search (NAS), as an emerging field, has…

Information Retrieval · Computer Science 2020-07-14 Qingquan Song , Dehua Cheng , Hanning Zhou , Jiyan Yang , Yuandong Tian , Xia Hu

Automatic Time Series Forecasting (TSF) model design which aims to help users to efficiently design suitable forecasting model for the given time series data scenarios, is a novel research topic to be urgently solved. In this paper, we…

Machine Learning · Computer Science 2022-03-29 Chunnan Wang , Xingyu Chen , Chengyue Wu , Hongzhi Wang