English
Related papers

Related papers: Data Aware Differentiable Neural Architecture Sear…

200 papers

Current neural architecture search (NAS) methods are often limited by their predefined, restrictive search spaces. While recent large language model (LLM)-assisted NAS methods enable open-ended search spaces, they often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuiko Sakuma , Masakazu Yoshimura , Marcel Gröpl , Zitang Sun , Junji Otsuka , Atsushi Irie , Takeshi Ohashi

The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design…

Machine Learning · Computer Science 2023-12-11 Simon Schrodi , Danny Stoll , Binxin Ru , Rhea Sukthanker , Thomas Brox , Frank Hutter

The increasing popularity of deep learning models has created new opportunities for developing AI-based recommender systems. Designing recommender systems using deep neural networks requires careful architecture design, and further…

Information Retrieval · Computer Science 2024-11-13 Tunhou Zhang , Dehua Cheng , Yuchen He , Zhengxing Chen , Xiaoliang Dai , Liang Xiong , Yudong Liu , Feng Cheng , Yufan Cao , Feng Yan , Hai Li , Yiran Chen , Wei Wen

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

Neural and Evolutionary Computing · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources.…

Machine Learning · Computer Science 2024-02-13 Ruiyang Qin , Yuting Hu , Zheyu Yan , Jinjun Xiong , Ahmed Abbasi , Yiyu Shi

For network architecture search (NAS), it is crucial but challenging to simultaneously guarantee both effectiveness and efficiency. Towards achieving this goal, we develop a differentiable NAS solution, where the search space includes…

Machine Learning · Computer Science 2019-05-07 Jianlong Chang , Xinbang Zhang , Yiwen Guo , Gaofeng Meng , Shiming Xiang , Chunhong Pan

Despite the significant advances achieved in Artificial Neural Networks (ANNs), their design process remains notoriously tedious, depending primarily on intuition, experience and trial-and-error. This human-dependent process is often…

Artificial Intelligence · Computer Science 2025-02-20 Mohamed Shahawy , Elhadj Benkhelifa , David White

Neural Architecture Search (NAS) has garnered significant research interest due to its capability to discover architectures superior to manually designed ones. Learning text representation is crucial for text classification and other…

With the growing demand for vision applications and deployment across edge devices, the development of hardware-friendly architectures that maintain performance during device deployment becomes crucial. Neural architecture search (NAS)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Sweta Priyadarshi , Tianyu Jiang , Hsin-Pai Cheng , Sendil Krishna , Viswanath Ganapathy , Chirag Patel

Recent advances in Tiny Machine Learning (TinyML) empower low-footprint embedded devices for real-time on-device Machine Learning. While many acknowledge the potential benefits of TinyML, its practical implementation presents unique…

Machine Learning · Computer Science 2024-05-17 Haoyu Ren , Xue Li , Darko Anicic , Thomas A. Runkler

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

Federated learning is a recently proposed distributed machine learning paradigm for privacy preservation, which has found a wide range of applications where data privacy is of primary concern. Meanwhile, neural architecture search has…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-15 Hangyu Zhu , Haoyu Zhang , Yaochu Jin

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Differentiable architecture search (DARTS) yields highly efficient gradient-based neural architecture search (NAS) by relaxing the discrete operation selection to optimize continuous architecture parameters that maps NAS from the discrete…

Machine Learning · Computer Science 2023-06-13 Jiuling Zhang , Zhiming Ding

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Neural architecture search, which aims to automatically search for architectures (e.g., convolution, max pooling) of neural networks that maximize validation performance, has achieved remarkable progress recently. In many application…

Machine Learning · Computer Science 2020-06-24 Ishika Singh , Haoyi Zhou , Kunlin Yang , Meng Ding , Bill Lin , Pengtao Xie

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

Machine Learning · Computer Science 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Automated neural network design has received ever-increasing attention with the evolution of deep convolutional neural networks (CNNs), especially involving their deployment on embedded and mobile platforms. One of the biggest problems that…

Machine Learning · Computer Science 2021-03-04 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Arjun Sridhar , Yiran Chen

We report a neural architecture search framework, BioNAS, that is tailored for biomedical researchers to easily build, evaluate, and uncover novel knowledge from interpretable deep learning models. The introduction of knowledge…

Machine Learning · Statistics 2019-09-04 Zijun Zhang , Linqi Zhou , Liangke Gou , Ying Nian Wu