English
Related papers

Related papers: Beyond GPT-5: Making LLMs Cheaper and Better via P…

200 papers

Training capable Large Language Model (LLM) agents is critically bottlenecked by the high cost and static nature of real-world interaction data. We address this by introducing GenEnv, a framework that establishes a difficulty-aligned…

Computation and Language · Computer Science 2025-12-24 Jiacheng Guo , Ling Yang , Peter Chen , Qixin Xiao , Yinjie Wang , Xinzhe Juan , Jiahao Qiu , Ke Shen , Mengdi Wang

GPT-4V has attracted considerable attention due to its extraordinary capacity for integrating and processing multimodal information. At the same time, its ability of face recognition raises new safety concerns of privacy leakage. Despite…

Computation and Language · Computer Science 2024-08-26 Yuanwei Wu , Yue Huang , Yixin Liu , Xiang Li , Pan Zhou , Lichao Sun

Can a single LLM-based optimization system match specialized tools across fundamentally different domains? We show that when optimization problems are formulated as improving a text artifact evaluated by a scoring function, a single…

Web navigation is a unique domain that can automate many repetitive real-life tasks and is challenging as it requires long-horizon sequential decision making beyond typical multimodal large language model (MLLM) tasks. Yet, specialized…

Large language models (LLMs) are increasingly used in applications forming multi-request workflows like document summarization, search-based copilots, and multi-agent programming. While these workflows unlock richer functionality, they also…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Md. Monzurul Amin Ifath , Israat Haque

Fine-tuning pretrained LLMs has been shown to be an effective strategy for reaching state-of-the-art performance on specific tasks like machine translation. However, this process of adaptation often implies sacrificing general-purpose…

Computation and Language · Computer Science 2025-06-23 Ricardo Rei , Nuno M. Guerreiro , José Pombal , João Alves , Pedro Teixeirinha , Amin Farajian , André F. T. Martins

This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm practice and technical interviews. We began by crawling the…

Software Engineering · Computer Science 2025-03-04 Lun Wang , Chuanqi Shi , Shaoshui Du , Yiyi Tao , Yixian Shen , Hang Zheng , Yanxin Shen , Xinyu Qiu

We study multi-turn multi-agent orchestration, where multiple large language model (LLM) agents interact over multiple turns by iteratively proposing answers or casting votes until reaching consensus. Using four LLMs (Gemini 2.5 Pro, GPT-5,…

Large language models (LLMs) exhibit strong reasoning capabilities but typically require expensive post-training to reach high performance. Recent test-time alignment methods offer a lightweight alternative, but have been explored mainly…

Computation and Language · Computer Science 2026-03-20 Arushi Rai , Qiang Zhang , Hanqing Zeng , Yunkai Zhang , Dipesh Tamboli , Xiangjun Fan , Zhuokai Zhao , Lizhu Zhang

Large Language Models (LLMs) like GPT and LLaMA are revolutionizing the AI industry with their sophisticated capabilities. Training these models requires vast GPU clusters and significant computing time, posing major challenges in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-30 Jiangfei Duan , Shuo Zhang , Zerui Wang , Lijuan Jiang , Wenwen Qu , Qinghao Hu , Guoteng Wang , Qizhen Weng , Hang Yan , Xingcheng Zhang , Xipeng Qiu , Dahua Lin , Yonggang Wen , Xin Jin , Tianwei Zhang , Peng Sun

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Although Large Vision-Language Models (LVLMs) have achieved impressive results, their high computational costs pose a significant barrier to wide application. To enhance inference efficiency, most existing approaches can be categorized as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Wei Suo , Ji Ma , Mengyang Sun , Lin Yuanbo Wu , Peng Wang , Yanning Zhang

Large language models (LLMs) achieve state-of-the-art accuracy on complex reasoning tasks by generating multiple chain-of-thought (CoT) traces, but using a fixed token budget per query leads to over-computation on easy inputs and…

Artificial Intelligence · Computer Science 2026-02-03 Katrina Brown , Aneesh Muppidi , Rana Shahout

The integration of Large Language Models (LLMs) like GPT-4o into robotic systems represents a significant advancement in embodied artificial intelligence. These models can process multi-modal prompts, enabling them to generate more…

Robotics · Computer Science 2024-09-10 Wenxiao Zhang , Xiangrui Kong , Conan Dewitt , Thomas Braunl , Jin B. Hong

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

Computation and Language · Computer Science 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

Large language models (LLMs) have demonstrated remarkable success as foundational models, benefiting various downstream applications through fine-tuning. Recent studies on loss scaling have demonstrated the superior performance of larger…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-25 Sajal Dash , Isaac Lyngaas , Junqi Yin , Xiao Wang , Romain Egele , Guojing Cong , Feiyi Wang , Prasanna Balaprakash

Large Language Models (LLMs) are becoming increasingly powerful and capable of handling complex tasks, e.g., building single agents and multi-agent systems. Compared to single agents, multi-agent systems have higher requirements for the…

Computation and Language · Computer Science 2024-08-29 Wei Wang , Dan Zhang , Tao Feng , Boyan Wang , Jie Tang

Design automation has the potential to substantially improve the efficiency of analog integrated circuit (IC) design. However, existing algorithms and tools typically focus on individual stages, such as device sizing, placement, or routing,…

Hardware Architecture · Computer Science 2026-04-24 Xian Rong Qin , Yong Zhang , Ying Hu , Tao Su , Bo-Wen Jia , Ning Xu

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

Cryptography and Security · Computer Science 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

Large language models have demonstrated remarkable few-shot performance on many natural language understanding tasks. Despite several demonstrations of using large language models in complex, strategic scenarios, there lacks a comprehensive…

Computation and Language · Computer Science 2024-07-23 Anthony Costarelli , Mat Allen , Roman Hauksson , Grace Sodunke , Suhas Hariharan , Carlson Cheng , Wenjie Li , Joshua Clymer , Arjun Yadav