English
Related papers

Related papers: LLM as a Tool, Not an Agent: Code-Mined Tree Trans…

200 papers

Large language models (LLMs) often struggle with complex reasoning tasks due to their limitations in addressing the vast reasoning space and inherent ambiguities of natural language. We propose the Mixture-of-Search-Agents (MoSA) paradigm,…

Artificial Intelligence · Computer Science 2025-02-27 Sen Yang , Yafu Li , Wai Lam , Yu Cheng

Recent advances demonstrate that increasing inference-time computation can significantly boost the reasoning capabilities of large language models (LLMs). Although repeated sampling (i.e., generating multiple candidate outputs) is a highly…

Artificial Intelligence · Computer Science 2025-11-10 Yuichi Inoue , Kou Misaki , Yuki Imajuku , So Kuroki , Taishi Nakamura , Takuya Akiba

Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to bring tangible benefits in a large number of applications in the past few years. Architecture topology and architecture size have been regarded as…

Machine Learning · Computer Science 2021-01-27 Xuanyi Dong , Lu Liu , Katarzyna Musial , Bogdan Gabrys

Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, often getting stuck…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Antonio Jimeno Yepes , Pieter Barnard

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

Machine Learning · Computer Science 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Large language models (LLMs) have demonstrated remarkable potential in solving complex tasks across diverse domains, typically by employing agentic workflows that follow detailed instructions and operational sequences. However, constructing…

Current neural architecture search (NAS) strategies focus only on finding a single, good, architecture. They offer little insight into why a specific network is performing well, or how we should modify the architecture if we want further…

Machine Learning · Computer Science 2021-02-22 Binxin Ru , Xingchen Wan , Xiaowen Dong , Michael Osborne

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

Machine Learning · Computer Science 2019-07-22 Martin Wistuba

Large Language Models (LLMs) have emerged as one of the most significant technological advancements in artificial intelligence in recent years. Their ability to understand, generate, and reason with natural language has transformed how we…

Artificial Intelligence · Computer Science 2025-07-03 Yanfei Zhang

The integration of large language models (LLMs) with external tools has significantly expanded the capabilities of AI agents. However, as the diversity of both LLMs and tools increases, selecting the optimal model-tool combination becomes a…

Computation and Language · Computer Science 2026-01-08 Jinyang Wu , Guocheng Zhai , Ruihan Jin , Jiahao Yuan , Yuhao Shen , Shuai Zhang , Zhengqi Wen , Jianhua Tao

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

Machine Learning · Computer Science 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

In this paper, we present a novel multi-objective hardware-aware neural architecture search (NAS) framework, namely HSCoNAS, to automate the design of deep neural networks (DNNs) with high accuracy but low latency upon target hardware. To…

Machine Learning · Computer Science 2021-03-16 Xiangzhong Luo , Di Liu , Shuo Huai , Weichen Liu

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

Computation and Language · Computer Science 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Leveraging multiple Large Language Models(LLMs) has proven effective for addressing complex, high-dimensional tasks, but current approaches often rely on static, manually engineered multi-agent configurations. To overcome these constraints,…

Machine Learning · Computer Science 2025-07-21 Xiaowen Ma , Chenyang Lin , Yao Zhang , Volker Tresp , Yunpu Ma

Automated neural network architecture design remains a significant challenge in computer vision. Task diversity and computational constraints require both effective architectures and efficient search methods. Large Language Models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Raghuvir Duvvuri , Chandini Vysyaraju , Avi Goyal , Dmitry Ignatov , Radu Timofte

Although large language models (LLMs) have revolutionized natural language processing capabilities, their practical implementation as autonomous multi-agent systems (MAS) for industrial problem-solving encounters persistent barriers.…

Computation and Language · Computer Science 2025-10-30 Hui Yi Leong , Yuheng Li , Yuqing Wu , Wenwen Ouyang , Wei Zhu , Jiechao Gao , Wei Han

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Recently, Neural Architecture Search (NAS) has successfully identified neural network architectures that exceed human designed ones on large-scale image classification. In this paper, we study NAS for semantic image segmentation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Chenxi Liu , Liang-Chieh Chen , Florian Schroff , Hartwig Adam , Wei Hua , Alan Yuille , Li Fei-Fei

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Gated recurrent networks such as those composed of Long Short-Term Memory (LSTM) nodes have recently been used to improve state of the art in many sequential processing tasks such as speech recognition and machine translation. However, the…

Neural and Evolutionary Computing · Computer Science 2018-06-11 Aditya Rawal , Risto Miikkulainen