English
Related papers

Related papers: CoLLM-NAS: Collaborative Large Language Models for…

200 papers

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

Neural and Evolutionary Computing · Computer Science 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

Neural architecture search (NAS) provides a systematic framework for automating the design of neural network architectures, yet its widespread adoption is hindered by prohibitive computational requirements. Existing zero-cost proxy methods,…

Computation and Language · Computer Science 2025-03-25 Zhen-Song Chen , Hong-Wei Ding , Xian-Jia Wang , Witold Pedrycz

Neural Architecture Search (NAS) methods, which automatically learn entire neural model or individual neural cell architectures, have recently achieved competitive or state-of-the-art (SOTA) performance on variety of natural language…

Computation and Language · Computer Science 2020-10-12 Ansel MacLaughlin , Jwala Dhamala , Anoop Kumar , Sriram Venkatapathy , Ragav Venkatesan , Rahul Gupta

Neural architecture search (NAS) relies on a good controller to generate better architectures or predict the accuracy of given architectures. However, training the controller requires both abundant and high-quality pairs of architectures…

Machine Learning · Computer Science 2020-11-04 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Capitalizing on the remarkable advancements in Large Language Models (LLMs), there is a burgeoning initiative to harness LLMs for instruction following robotic navigation. Such a trend underscores the potential of LLMs to generalize…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Gengze Zhou , Yicong Hong , Zun Wang , Xin Eric Wang , Qi Wu

Crafting neural network architectures manually is a formidable challenge often leading to suboptimal and inefficient structures. The pursuit of the perfect neural configuration is a complex task, prompting the need for a metaheuristic…

Neural and Evolutionary Computing · Computer Science 2024-02-01 Abdelrahman Elsaid

Neural Architecture Search (NAS) has received increasing attention because of its exceptional merits in automating the design of Deep Neural Network (DNN) architectures. However, the performance evaluation process, as a key part of NAS,…

Neural and Evolutionary Computing · Computer Science 2024-10-10 Xiaotian Song , Xiangning Xie , Zeqiong Lv , Gary G. Yen , Weiping Ding , Jiancheng Lv , Yanan Sun

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

Machine Learning · Computer Science 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

Large Language Models (LLMs) have demonstrated remarkable improvements in reasoning and planning through increased test-time compute, often by framing problem-solving as a search process. While methods like Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-06-06 Nathan Herr , Tim Rocktäschel , Roberta Raileanu

Adaptive Large Neighborhood Search (ALNS) is a prominent metaheuristic and a widely adopted approach for production and logistics optimization. However, it has long relied on hand-crafted components built on expert experience, which makes…

Neural and Evolutionary Computing · Computer Science 2026-05-20 Shaohua Yu , Tianyu Chen , Linyan Liu , Jakob Puchinger

In recent years, the field of indoor navigation has witnessed groundbreaking advancements through the integration of Large Language Models (LLMs). Traditional navigation approaches relying on pre-built maps or reinforcement learning exhibit…

Robotics · Computer Science 2025-04-23 Anlong Zhang , Jianmin Ji

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

Machine Learning · Computer Science 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

This study presents a novel framework for smart search in digital archival systems, leveraging the capabilities of Large Language Models (LLMs) to enhance information retrieval. By employing a Retrieval-Augmented Generation (RAG) approach,…

Artificial Intelligence · Computer Science 2025-01-14 Ha Dung Nguyen , Thi-Hoang Anh Nguyen , Thanh Binh Nguyen

State-of-the-art Neural Network Architectures (NNAs) are challenging to design and implement efficiently in hardware. In the past couple of years, this has led to an explosion in research and development of automatic Neural Architecture…

Neural and Evolutionary Computing · Computer Science 2020-09-15 Philip Colangelo , Oren Segal , Alex Speicher , Martin Margala

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information about thousands of…

Machine Learning · Computer Science 2023-03-31 Vasco Lopes , Bruno Degardin , Luís A. Alexandre

Finding a well-performing architecture is often tedious for both DL practitioners and researchers, leading to tremendous interest in the automation of this task by means of neural architecture search (NAS). Although the community has made…

Machine Learning · Computer Science 2020-11-04 Marius Lindauer , Frank Hutter

Over the past few years, as large language models have ushered in an era of intelligence emergence, there has been an intensified focus on scaling networks. Currently, many network architectures are designed manually, often resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Kai Liu , Ruohui Wang , Jianfei Gao , Kai Chen

Point cloud architecture design has become a crucial problem for 3D deep learning. Several efforts exist to manually design architectures with high accuracy in point cloud tasks such as classification, segmentation, and detection. Recent…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Guohao Li , Mengmeng Xu , Silvio Giancola , Ali Thabet , Bernard Ghanem