中文
相关论文

相关论文: HexAGenT: Efficient Agentic LLM Serving via Workfl…

200 篇论文

Autonomous machine learning agents have revolutionized scientific discovery, yet they remain constrained by a Generate-Execute-Feedback paradigm. Previous approaches suffer from a severe Execution Bottleneck, as hypothesis evaluation relies…

计算与语言 · 计算机科学 2026-04-08 Jingsheng Zheng , Jintian Zhang , Yujie Luo , Yuren Mao , Yunjun Gao , Lun Du , Huajun Chen , Ningyu Zhang

High-quality code documentation is crucial for software development especially in the era of AI. However, generating it automatically using Large Language Models (LLMs) remains challenging, as existing approaches often produce incomplete,…

软件工程 · 计算机科学 2025-05-27 Dayu Yang , Antoine Simoulin , Xin Qian , Xiaoyi Liu , Yuwei Cao , Zhaopu Teng , Grey Yang

Specialized accelerators such as GPUs, TPUs, FPGAs, and custom ASICs have been increasingly deployed to train deep learning models. These accelerators exhibit heterogeneous performance behavior across model architectures. Existing…

分布式、并行与集群计算 · 计算机科学 2020-08-24 Deepak Narayanan , Keshav Santhanam , Fiodar Kazhamiaka , Amar Phanishayee , Matei Zaharia

Large language model (LLM)-based systems are becoming increasingly popular for solving tasks by constructing executable workflows that interleave LLM calls, information retrieval, tool use, code execution, memory updates, and verification.…

The integration of Large Language Models (LLMs) into wearable sensing is creating a new class of mobile applications capable of nuanced human activity understanding. However, the reliability of these systems is critically undermined by…

密码学与安全 · 计算机科学 2025-12-25 Yihan Wang , Huanqi Yang , Shantanu Pal , Weitao Xu

Large Language Models (LLMs) excel at code-related tasks but often struggle in realistic software repositories, where project-specific APIs and cross-file dependencies are crucial. Retrieval-augmented methods mitigate this by injecting…

软件工程 · 计算机科学 2026-04-22 George Ma , Anurag Koul , Qi Chen , Yawen Wu , Sachit Kuhar , Yu Yu , Aritra Sengupta , Varun Kumar , Murali Krishna Ramanathan

Existing MLLMs encounter significant challenges in modeling the temporal context within long videos. Currently, mainstream Agent-based methods use external tools to assist a single MLLM in answering long video questions. Despite such…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Boyu Chen , Zhengrong Yue , Siran Chen , Zikang Wang , Yang Liu , Peng Li , Yali Wang

Recent studies have begun to explore proactive large language model (LLM) agents that provide unobtrusive assistance by automatically leveraging contextual information, such as in code editing and in-app suggestions. However, most focus on…

Recent multimodal LLMs have shown promise in chart-based visual question answering, but their performance declines sharply on unannotated charts-those requiring precise visual interpretation rather than relying on textual shortcuts. To…

人工智能 · 计算机科学 2026-01-08 Rachneet Kaur , Nishan Srishankar , Zhen Zeng , Sumitra Ganesh , Manuela Veloso

The integration of Artificial Intelligence (AI) with High-Performance Computing (HPC) is transforming scientific workflows from human-directed pipelines into adaptive systems capable of autonomous decision-making. Large language models…

Recent progress in Large Language Models (LLMs) has drawn attention to their potential for accelerating drug discovery. However, a central problem remains: translating theoretical ideas into robust implementations in the highly specialized…

机器学习 · 计算机科学 2025-03-06 Sizhe Liu , Yizhou Lu , Siyu Chen , Xiyang Hu , Jieyu Zhao , Yingzhou Lu , Yue Zhao

As demand for Large Language Models (LLMs) and AI agents grows rapidly, optimizing systems for efficient LLM inference becomes critical. While significant efforts have targeted system-level engineering, little has been explored from a…

机器学习 · 统计学 2026-05-19 J. G. Dai , Tianze Deng , Yueying Li , Tianyi Peng

The rapid adoption of Large Language Models (LLMs) has driven a growing demand for efficient inference, particularly in latency-sensitive applications such as chatbots and personalized assistants. Unlike traditional deep neural networks,…

硬件体系结构 · 计算机科学 2025-10-06 Shubham Negi , Kaushik Roy

The integration of Large Language Models (LLMs) into applications ranging from interactive chatbots to multi-agent systems has introduced a wide spectrum of service-level objectives (SLOs) for responsiveness. These include latency-sensitive…

分布式、并行与集群计算 · 计算机科学 2025-12-23 Wei Zhang , Zhiyu Wu , Yi Mu , Rui Ning , Banruo Liu , Nikhil Sarda , Myungjin Lee , Fan Lai

Recent developments in large language models (LLMs) have demonstrated their remarkable proficiency in a range of tasks. Compared to in-house homogeneous GPU clusters, deploying LLMs in cloud environments with diverse types of GPUs is…

分布式、并行与集群计算 · 计算机科学 2025-11-07 Youhe Jiang , Fangcheng Fu , Xiaozhe Yao , Taiyi Wang , Bin Cui , Ana Klimovic , Eiko Yoneki

As automated trading gains traction in the financial market, algorithmic investment strategies are increasingly prominent. While Large Language Models (LLMs) and Agent-based models exhibit promising potential in real-time market analysis…

多智能体系统 · 计算机科学 2025-02-20 Xiangyu Li , Yawen Zeng , Xiaofen Xing , Jin Xu , Xiangmin Xu

The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological…

计算与语言 · 计算机科学 2025-01-22 Yaoxiang Wang , Zhiyong Wu , Junfeng Yao , Jinsong Su

As large language models (LLMs) take on complex tasks, their inputs are supplemented with longer contexts that incorporate domain knowledge. Yet using long contexts is challenging, as nothing can be generated until the whole context is…

Multi-agent systems, where multiple agents (generative AI models + tools) collaborate, are emerging as an effective pattern for solving long-running, complex tasks in numerous domains. However, specifying their parameters (such as models,…

软件工程 · 计算机科学 2024-08-29 Victor Dibia , Jingya Chen , Gagan Bansal , Suff Syed , Adam Fourney , Erkang Zhu , Chi Wang , Saleema Amershi

Recovering accurate architecture from large-scale legacy software is hindered by architectural drift, missing relations, and the limited context of Large Language Models (LLMs). We present ArchAgent, a scalable agent-based framework that…

软件工程 · 计算机科学 2026-01-21 Rusheng Pan , Bingcheng Mao , Tianyi Ma , Zhenhua Ling