English
Related papers

Related papers: Matryoshka Pilot: Learning to Drive Black-Box LLMs…

200 papers

Large Language Models (LLMs) have shown promise in solving natural language-described planning tasks, but their direct use often leads to inconsistent reasoning and hallucination. While hybrid LLM-symbolic planning pipelines have emerged as…

Artificial Intelligence · Computer Science 2024-09-25 Sukai Huang , Nir Lipovetzky , Trevor Cohn

Pre-trained Language Models (PLMs) are trained on large amounts of unlabeled data, yet they exhibit remarkable reasoning skills. However, the trustworthiness challenges posed by these black-box models have become increasingly evident in…

Computation and Language · Computer Science 2025-08-26 Yunxiao Zhao , Hao Xu , Zhiqiang Wang , Xiaoli Li , Jiye Liang , Ru Li

Large Language Models (LLM) are evolving and have significantly revolutionized the landscape of software development. If used well, they can significantly accelerate the software development cycle. At the same time, the community is very…

Software Engineering · Computer Science 2024-09-04 Zachariah Sollenberger , Jay Patel , Christian Munley , Aaron Jarmusch , Sunita Chandrasekaran

This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background,…

Robotics · Computer Science 2024-06-26 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Black-box Large Language Models (LLMs) have shown great power in solving various tasks and are considered general problem solvers. However, LLMs still fail in many specific tasks although understand the task instruction. In this paper, we…

Computation and Language · Computer Science 2024-08-13 Wangtao Sun , Xuanqing Yu , Shizhu He , Jun Zhao , Kang Liu

Significantly simplifying the creation of optimization models for real-world business problems has long been a major goal in applying mathematical optimization more widely to important business and societal decisions. The recent…

Artificial Intelligence · Computer Science 2024-02-27 Segev Wasserkrug , Leonard Boussioux , Dick den Hertog , Farzaneh Mirzazadeh , Ilker Birbil , Jannis Kurtz , Donato Maragno

In modern industrial production, multiple robots often collaborate to complete complex manufacturing tasks. Large language models (LLMs), with their strong reasoning capabilities, have shown potential in coordinating robots for simple…

Robotics · Computer Science 2026-03-04 Xiangyu Su , Juzhan Xu , Oliver van Kaick , Kai Xu , Ruizhen Hu

We study secret elicitation: discovering knowledge that an AI possesses but does not explicitly verbalize. As a testbed, we train three families of large language models (LLMs) to possess specific knowledge that they apply downstream but…

Machine Learning · Computer Science 2025-11-03 Bartosz Cywiński , Emil Ryd , Rowan Wang , Senthooran Rajamanoharan , Neel Nanda , Arthur Conmy , Samuel Marks

Large Language Models (LLMs) have catalyzed transformative advances across a spectrum of natural language processing tasks through few-shot or zero-shot prompting, bypassing the need for parameter tuning. While convenient, this modus…

Artificial Intelligence · Computer Science 2024-03-12 Zhen Tan , Jie Peng , Tianlong Chen , Huan Liu

Large Reasoning Models (LRMs) are powerful, but they still suffer from inefficient and off-target reasoning. Currently, training-free methods are limited to either rigid heuristics or descriptive, non-actionable analyses. In this paper, we…

Artificial Intelligence · Computer Science 2025-10-15 Sunzhu Li , Zhiyu Lin , Shuling Yang , Jiale Zhao , Wei Chen

While large language models (LLMs) have shown great potential across various domains, their applications in robotics remain largely limited to static prompt-based behaviors and still face challenges in complex tasks under zero-shot or…

The increasing scale of general-purpose Pre-trained Language Models (PLMs) necessitates the study of more efficient adaptation across different downstream tasks. In this paper, we establish a Black-box Discrete Prompt Learning (BDPL) to…

Computation and Language · Computer Science 2023-02-24 Shizhe Diao , Zhichao Huang , Ruijia Xu , Xuechun Li , Yong Lin , Xiao Zhou , Tong Zhang

Large Language Models (LLMs) have been shown to be capable of performing high-level planning for long-horizon robotics tasks, yet existing methods require access to a pre-defined skill library (e.g. picking, placing, pulling, pushing,…

Machine Learning · Computer Science 2024-05-03 Murtaza Dalal , Tarun Chiruvolu , Devendra Chaplot , Ruslan Salakhutdinov

This study presents the LLM-Agent-Controller, a multi-agent large language model (LLM) system developed to address a wide range of problems in control engineering (Control Theory). The system integrates a central controller agent with…

Artificial Intelligence · Computer Science 2025-05-27 Rasoul Zahedifar , Sayyed Ali Mirghasemi , Mahdieh Soleymani Baghshah , Alireza Taheri

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models…

Robotics · Computer Science 2025-04-16 Hao Sha , Yao Mu , Yuxuan Jiang , Li Chen , Chenfeng Xu , Ping Luo , Shengbo Eben Li , Masayoshi Tomizuka , Wei Zhan , Mingyu Ding

In the realm of data-driven AI technology, the application of open-source large language models (LLMs) in robotic task planning represents a significant milestone. Recent robotic task planning methods based on open-source LLMs typically…

Robotics · Computer Science 2024-04-03 Yike Wu , Jiatao Zhang , Nan Hu , LanLing Tang , Guilin Qi , Jun Shao , Jie Ren , Wei Song

Large Language Models (LLMs) are transforming the robotics domain by enabling robots to comprehend and execute natural language instructions. The cornerstone benefits of LLM include processing textual data from technical manuals,…

Language models can be used to solve long-horizon planning problems in two distinct modes: a fast 'System-1' mode, directly generating plans without any explicit search or backtracking, and a slow 'System-2' mode, planning step-by-step by…

Artificial Intelligence · Computer Science 2025-04-16 Swarnadeep Saha , Archiki Prasad , Justin Chih-Yao Chen , Peter Hase , Elias Stengel-Eskin , Mohit Bansal

Undeniably, Large Language Models (LLMs) have stirred an extraordinary wave of innovation in the machine learning research domain, resulting in substantial impact across diverse fields such as reinforcement learning, robotics, and computer…

Machine Learning · Computer Science 2024-05-10 Xingyou Song , Yingtao Tian , Robert Tjarko Lange , Chansoo Lee , Yujin Tang , Yutian Chen

We introduce MPLSandbox, an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs). It can automatically identify the…