English
Related papers

Related papers: MONAQ: Multi-Objective Neural Architecture Queryin…

200 papers

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

Designing convolutional neural networks (CNN) for mobile devices is challenging because mobile models need to be small and fast, yet still accurate. Although significant efforts have been dedicated to design and improve mobile CNNs on all…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , Quoc V. Le

Hardware-Aware Neural Architecture Search (HW-NAS) requires joint optimization of accuracy and latency under device constraints. Traditional supernet-based methods require multiple GPU days per dataset. Large Language Model (LLM)-driven…

Machine Learning · Computer Science 2025-12-08 Hengyi Zhu , Grace Li Zhang , Shaoyi Huang

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

The automated machine learning (AutoML) field has become increasingly relevant in recent years. These algorithms can develop models without the need for expert knowledge, facilitating the application of machine learning techniques in the…

Machine Learning · Computer Science 2022-12-14 Andrea Falanti , Eugenio Lomurno , Danilo Ardagna , Matteo Matteucci

Effective analysis of time series data presents significant challenges due to the complex temporal dependencies and cross-channel interactions in multivariate data. Inspired by the way human analysts visually inspect time series to uncover…

Machine Learning · Computer Science 2025-10-10 Qinghua Liu , Sam Heshmati , Zheda Mai , Zubin Abraham , John Paparrizos , Liu Ren

The ongoing advancements in network architecture design have led to remarkable achievements in deep learning across various challenging computer vision tasks. Meanwhile, the development of neural architecture search (NAS) has provided…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Zhichao Lu , Ran Cheng , Yaochu Jin , Kay Chen Tan , Kalyanmoy Deb

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

The majority of IoT devices like smartwatches, smart plugs, HVAC controllers, etc., are powered by hardware with a constrained specification (low memory, clock speed and processor) which is insufficient to accommodate and execute large,…

Neural architecture search (NAS) has been successfully used to design numerous high-performance neural networks. However, NAS is typically compute-intensive, so most existing approaches restrict the search to decide the operations and…

Machine Learning · Computer Science 2022-10-17 Thomas Chun Pong Chau , Łukasz Dudziak , Hongkai Wen , Nicholas Donald Lane , Mohamed S Abdelfattah

Neural Architecture Search (NAS) automates neural network design, reducing dependence on human expertise. While NAS methods are computationally intensive and dataset-specific, auxiliary predictors reduce the models needing training,…

Machine Learning · Computer Science 2024-10-01 Eugenio Lomurno , Samuele Mariani , Matteo Monti , Matteo Matteucci

In this work, we employ neural architecture search (NAS) to enhance the efficiency of deploying diverse machine learning (ML) tasks on in-memory computing (IMC) architectures. Initially, we design three fundamental components inspired by…

Machine Learning · Computer Science 2024-06-12 Md Hasibul Amin , Mohammadreza Mohammadi , Ramtin Zand

As Large Language Models (LLMs) demonstrate exceptional performance across various domains, deploying LLMs on edge devices has emerged as a new trend. Quantization techniques, which reduce the size and memory requirements of LLMs, are…

Computation and Language · Computer Science 2025-05-07 Binrui Zeng , Bin Ji , Xiaodong Liu , Jie Yu , Shasha Li , Jun Ma , Xiaopeng Li , Shangwen Wang , Xinran Hong , Yongtao Tang

Hardware-aware Neural Architecture Search approaches (HW-NAS) automate the design of deep learning architectures, tailored specifically to a given target hardware platform. Yet, these techniques demand substantial computational resources,…

Machine Learning · Computer Science 2024-04-22 Nilotpal Sinha , Peyman Rostami , Abd El Rahman Shabayek , Anis Kacem , Djamila Aouada

Neural Architecture Search (NAS) is challenged by the trade-off between search space exploration and efficiency, especially for complex tasks. While recent LLM-based NAS methods have shown promise, they often suffer from static search…

Machine Learning · Computer Science 2025-07-29 Fei Kong , Xiaohan Shan , Yanwei Hu , Jianmin Li

Recent breakthroughs in Neural Architectural Search (NAS) have achieved state-of-the-art performance in many tasks such as image classification and language understanding. However, most existing works only optimize for model accuracy and…

Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we…

Computation and Language · Computer Science 2025-07-01 Yaxuan Kong , Yiyuan Yang , Yoontae Hwang , Wenjie Du , Stefan Zohren , Zhangyang Wang , Ming Jin , Qingsong Wen

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Artificial intelligence (AI) is widely used in various fields including healthcare, autonomous vehicles, robotics, traffic monitoring, and agriculture. Many modern AI applications in these fields are multi-tasking in nature (i.e. perform…

Machine Learning · Computer Science 2024-12-04 Md Hafizur Rahman , Md Mashfiq Rizvee , Sumaiya Shomaji , Prabuddha Chakraborty

Large Language Models (LLMs) have emerged as powerful tools capable of accomplishing a broad spectrum of tasks. Their abilities span numerous areas, and one area where they have made a significant impact is in the domain of code generation.…

Neural and Evolutionary Computing · Computer Science 2024-04-18 Muhammad U. Nasir , Sam Earle , Christopher Cleghorn , Steven James , Julian Togelius