English
Related papers

Related papers: ORThought: Benchmarking and Automating Logistics O…

200 papers

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

While logical reasoning evaluation of Large Language Models (LLMs) has attracted significant attention, existing benchmarks predominantly rely on multiple-choice formats that are vulnerable to random guessing, leading to overestimated…

Computation and Language · Computer Science 2025-02-25 Qin Zhu , Fei Huang , Runyu Peng , Keming Lu , Bowen Yu , Qinyuan Cheng , Xipeng Qiu , Xuanjing Huang , Junyang Lin

Hyperparameter optimization is critical in modern machine learning, requiring expert knowledge, numerous trials, and high computational and human resources. Despite the advancements in Automated Machine Learning (AutoML), challenges in…

Machine Learning · Computer Science 2025-02-27 Siyi Liu , Chen Gao , Yong Li

While server-side Large Language Models (LLMs) demonstrate proficiency in function calling and complex reasoning, deploying Small Language Models (SLMs) directly on devices brings opportunities to improve latency and privacy but also…

Computation and Language · Computer Science 2024-10-15 Yicheng Fu , Raviteja Anantha , Jianpeng Cheng

Large language models (LLMs) perform well on step-by-step reasoning benchmarks such as mathematics and code generation, yet their ability to carry out robust long-horizon planning under realistic constraints remains insufficiently…

Artificial Intelligence · Computer Science 2026-04-21 Petr Anokhin , Roman Khalikov , Stefan Rebrikov , Viktor Volkov , Artyom Sorokin , Vincent Bissonnette

This paper explores how Large Language Models (LLMs) can automate consensus-seeking in supply chain management (SCM), where frequent decisions on problems such as inventory levels and delivery times require coordination among companies.…

Artificial Intelligence · Computer Science 2024-11-18 Valeria Jannelli , Stefan Schoepf , Matthias Bickel , Torbjørn Netland , Alexandra Brintrup

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Prompt engineering plays a critical role in adapting large language models (LLMs) to complex reasoning and labeling tasks without the need for extensive fine-tuning. In this paper, we propose a novel prompt optimization pipeline for frame…

Computation and Language · Computer Science 2025-12-23 Do Minh Duc , Quan Xuan Truong , Nguyen Tat Dat , Nguyen Van Vinh

Large Language Model (LLM)-based agents have achieved notable success on short-horizon and highly structured tasks. However, their ability to maintain coherent decision-making over long horizons in realistic and dynamic environments remains…

Artificial Intelligence · Computer Science 2026-03-18 Linghua Zhang , Jun Wang , Jingtong Wu , Zhisong Zhang

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Multiple-choice reasoning benchmarks face dual challenges: rapid saturation from advancing models and data contamination that undermines static evaluations. Ad-hoc hardening methods (paraphrasing, perturbation) attempt to increase…

Computation and Language · Computer Science 2026-05-11 Hanmeng Liu , Shichao Weng , Xiulai Liu , Zhicai Zhang , Anli Yan , Xiaozhang Liu

Large Language Models (LLMs) have recently demonstrated impressive capabilities across various real-world applications. However, due to the current text-in-text-out paradigm, it remains challenging for LLMs to handle dynamic and complex…

Artificial Intelligence · Computer Science 2024-10-25 Timothy Wei , Annabelle Miin , Anastasia Miin

Service system performance depends on how participants respond to design choices, but modeling these responses is hard due to the complexity of human behavior. We introduce an LLM-powered multi-agent simulation (LLM-MAS) framework for…

Artificial Intelligence · Computer Science 2026-04-07 Yanyuan Wang , Xiaowei Zhang

LLM-based agents have demonstrated strong potential for autonomous machine learning, yet their applicability to health data remains limited. Existing systems often struggle to generalize across heterogeneous health data modalities, rely…

Artificial Intelligence · Computer Science 2026-02-03 Tong Xia , Weibin Li , Gang Liu , Yong Li

Automated optimization modeling via Large Language Models (LLMs) has emerged as a promising approach to assist complex human decision-making. While post-training has become a pivotal technique to enhance LLMs' capabilities in this domain,…

Machine Learning · Computer Science 2026-02-13 Weiting Liu , Han Wu , Yufei Kuang , Xiongwei Han , Tao Zhong , Jianfeng Feng , Wenlian Lu

Training large language models (LLMs) with synthetic reasoning data has become a popular approach to enhancing their reasoning capabilities, while a key factor influencing the effectiveness of this paradigm is the quality of the generated…

Artificial Intelligence · Computer Science 2026-03-24 Zhuojie Yang , Wentao Wan , Keze Wang

In this study, we introduce the concept of OKR-Agent designed to enhance the capabilities of Large Language Models (LLMs) in task-solving. Our approach utilizes both self-collaboration and self-correction mechanism, facilitated by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yi Zheng , Chongyang Ma , Kanle Shi , Haibin Huang

Large Language Models (LLMs) have shown remarkable capabilities in solving diverse tasks. However, their proficiency in iteratively optimizing complex solutions through learning from previous feedback remains insufficiently explored. To…

Artificial Intelligence · Computer Science 2025-06-13 Xiaozhe Li , Jixuan Chen , Xinyu Fang , Shengyuan Ding , Haodong Duan , Qingwen Liu , Kai Chen

Artificial intelligence is increasingly catalyzing scientific automation, with multimodal large language model (MLLM) agents evolving from lab assistants into self-driving lab operators. This transition imposes stringent safety requirements…

Artificial Intelligence · Computer Science 2026-03-13 Qianpu Sun , Xiaowei Chi , Yuhan Rui , Ying Li , Kuangzhi Ge , Jiajun Li , Sirui Han , Shanghang Zhang

Complex agentic AI systems, powered by a coordinated ensemble of Large Language Models (LLMs), tool and memory modules, have demonstrated remarkable capabilities on intricate, multi-turn tasks. However, this success is shadowed by…

Computation and Language · Computer Science 2026-01-07 Guibin Zhang , Haiyang Yu , Kaiming Yang , Bingli Wu , Fei Huang , Yongbin Li , Shuicheng Yan