English
Related papers

Related papers: RandomNet: Towards Fully Automatic Neural Architec…

200 papers

An important goal of AutoML is to automate-away the design of neural networks on new tasks in under-explored domains. Motivated by this goal, we study the problem of enabling users to discover the right neural operations given data from…

Machine Learning · Computer Science 2021-11-05 Nicholas Roberts , Mikhail Khodak , Tri Dao , Liam Li , Christopher Ré , Ameet Talwalkar

This paper introduces a novel framework for designing efficient neural network architectures specifically tailored to tiny machine learning (TinyML) platforms. By leveraging large language models (LLMs) for neural architecture search (NAS),…

Machine Learning · Computer Science 2025-04-15 Christophe El Zeinaty , Wassim Hamidouche , Glenn Herrou , Daniel Menard , Merouane Debbah

We reduce the computational cost of Neural AutoML with transfer learning. AutoML relieves human effort by automating the design of ML algorithms. Neural AutoML has become popular for the design of deep learning architectures, however, this…

Machine Learning · Computer Science 2019-01-29 Catherine Wong , Neil Houlsby , Yifeng Lu , Andrea Gesmundo

This paper studies the best practices for automatic machine learning (AutoML). While previous AutoML efforts have predominantly focused on unimodal data, the multimodal aspect remains under-explored. Our study delves into classification and…

Machine Learning · Computer Science 2024-12-24 Zhiqiang Tang , Zihan Zhong , Tong He , Gerald Friedland

In neural architecture search, the structure of the neural network to best model a given dataset is determined by an automated search process. Efficient Neural Architecture Search (ENAS), proposed by Pham et al. (2018), has recently…

Machine Learning · Computer Science 2019-06-19 Prabhant Singh , Tobias Jacobs , Sebastien Nicolas , Mischa Schmidt

Automated Machine Learning (AutoML) has become increasingly popular in recent years due to its ability to reduce the amount of time and expertise required to design and develop machine learning systems. This is very important for the…

Machine Learning · Computer Science 2024-04-16 Hernán Ceferino Vázquez , Jorge Sanchez , Rafael Carrascosa

To defend deep neural networks from adversarial attacks, adversarial training has been drawing increasing attention for its effectiveness. However, the accuracy and robustness resulting from the adversarial training are limited by the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yuwei Ou , Yuqi Feng , Yanan Sun

Combining multiple modalities carrying complementary information through multimodal learning (MML) has shown considerable benefits for diagnosing multiple pathologies. However, the robustness of multimodal models to missing modalities is…

Machine Learning · Computer Science 2024-07-31 Hava Chaptoukaev , Vincenzo Marcianó , Francesco Galati , Maria A. Zuluaga

Conventional video models rely on a single stream to capture the complex spatial-temporal features. Recent work on two-stream video models, such as SlowFast network and AssembleNet, prescribe separate streams to learn complementary…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Xinyu Gong , Heng Wang , Zheng Shou , Matt Feiszli , Zhangyang Wang , Zhicheng Yan

For the goal of automated design of high-performance deep convolutional neural networks (CNNs), Neural Architecture Search (NAS) methodology is becoming increasingly important for both academia and industries.Due to the costly stochastic…

Machine Learning · Computer Science 2021-10-12 Shengran Hu , Ran Cheng , Cheng He , Zhichao Lu , Jing Wang , Miao Zhang

Medical Image Segmentation (MIS) includes diverse tasks, from bone to organ segmentation, each with its own challenges in finding the best segmentation model. The state-of-the-art AutoML-related MIS-framework nnU-Net automates many aspects…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Jannis Becktepe , Leona Hennig , Steffen Oeltze-Jafra , Marius Lindauer

Multimodal models are expected to be a critical component to future advances in artificial intelligence. This field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural…

Computation and Language · Computer Science 2024-06-11 Sai Munikoti , Ian Stewart , Sameera Horawalavithana , Henry Kvinge , Tegan Emerson , Sandra E Thompson , Karl Pazdernik

A main driver behind the digitization of industry and society is the belief that data-driven model building and decision making can contribute to higher degrees of automation and more informed decisions. Building such models from data often…

Network Architecture Search (NAS) methods have recently gathered much attention. They design networks with better performance and use a much shorter search time compared to traditional manual tuning. Despite their efficiency in model…

Machine Learning · Computer Science 2021-09-13 Yiren Zhao , Xitong Gao , Ilia Shumailov , Nicolo Fusi , Robert Mullins

Current neural architecture search (NAS) methods are often limited by their predefined, restrictive search spaces. While recent large language model (LLM)-assisted NAS methods enable open-ended search spaces, they often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuiko Sakuma , Masakazu Yoshimura , Marcel Gröpl , Zitang Sun , Junji Otsuka , Atsushi Irie , Takeshi Ohashi

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

Machine Learning · Computer Science 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture…

Machine Learning · Statistics 2020-09-23 Alexis Cooper , Xin Zhou , Scott Heidbrink , Daniel M. Dunlavy

Deep neural networks have recently become a popular solution to keyword spotting systems, which enable the control of smart devices via voice. In this paper, we apply neural architecture search to search for convolutional neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Tong Mo , Yakun Yu , Mohammad Salameh , Di Niu , Shangling Jui

Machine learning is a powerful method for modeling in different fields such as education. Its capability to accurately predict students' success makes it an ideal tool for decision-making tasks related to higher education. The accuracy of…

Machine Learning · Computer Science 2021-05-03 Leila Zahedi , Farid Ghareh Mohammadi , Shabnam Rezapour , Matthew W. Ohland , M. Hadi Amini