English
Related papers

Related papers: CTFusion: A CTF-based Benchmark for LLM Agent Eval…

200 papers

Significant focus has been placed on integrating large language models (LLMs) with various tools in developing general-purpose agents. This poses a challenge to LLMs' tool-use capabilities. However, there are evident gaps between existing…

Computation and Language · Computer Science 2024-11-25 Jize Wang , Zerun Ma , Yining Li , Songyang Zhang , Cailian Chen , Kai Chen , Xinyi Le

Cyber threat intelligence (CTI) is central to modern cybersecurity, providing critical insights for detecting and mitigating evolving threats. With the natural language understanding and reasoning capabilities of large language models…

Cryptography and Security · Computer Science 2025-10-15 Yutong Cheng , Yang Liu , Changze Li , Dawn Song , Peng Gao

Computational Fluid Dynamics (CFD) is critical for scientific advancement but is hindered by operational complexity and high expertise barriers. This paper introduces ChatCFD, a Large Language Model (LLM)-driven multi-agent system designed…

Computation and Language · Computer Science 2026-02-10 E Fan , Kang Hu , Zhuowen Wu , Jiangyang Ge , Jiawei Miao , Yuzhi Zhang , He Sun , Weizong Wang , Tianhan Zhang

This paper presents a novel, structured decision support framework that systematically aligns diverse artificial intelligence (AI) agent architectures, reactive, cognitive, hybrid, and learning, with the comprehensive National Institute of…

Artificial Intelligence · Computer Science 2025-10-03 Masike Malatji

Significant advancements have occurred in the application of Large Language Models (LLMs) for social simulations. Despite this, their abilities to perform teaming in task-oriented social events are underexplored. Such capabilities are…

Artificial Intelligence · Computer Science 2025-08-18 Yuan Li , Lichao Sun , Yixuan Zhang

While integrating tools like Code Interpreter and Search has significantly enhanced Large Language Model (LLM) reasoning in models like ChatGPT Agent and Gemini-Pro, practical guidance on optimal tool use is lacking. The core challenge is…

Computation and Language · Computer Science 2025-10-03 Yongchao Chen , Jiefeng Chen , Rui Meng , Ji Yin , Na Li , Chuchu Fan , Chi Wang , Tomas Pfister , Jinsung Yoon

The rapid proliferation of large language models (LLMs) has intensified the requirement for reliable safety evaluation to uncover model vulnerabilities. To this end, numerous LLM safety evaluation benchmarks are proposed. However, existing…

Computation and Language · Computer Science 2025-08-22 Xiangyang Zhu , Yuan Tian , Chunyi Li , Kaiwei Zhang , Wei Sun , Guangtao Zhai

Designing realistic and adaptive networked threat scenarios remains a core challenge in cybersecurity research and training, still requiring substantial manual effort. While large language models (LLMs) show promise for automated synthesis,…

Cryptography and Security · Computer Science 2025-10-30 Ana M. Rodriguez , Jaime Acosta , Anantaa Kotal , Aritran Piplai

As software systems grow in scale and complexity, vulnerability management is increasingly strained by high alert volumes, fragmented toolchains, and manual triage processes. We introduce AgenticVM, a multi-agent framework that integrates…

Cryptography and Security · Computer Science 2026-05-05 Asrul Arifin , Hussain Ahmad , Yiyao Zhang , Diksha Goel

Large Language Models (LLMs) hold immense potential for revolutionizing Customer Experience Management (CXM), particularly in contact center operations. However, evaluating their practical utility in complex operational environments is…

Machine Learning · Computer Science 2025-05-20 Raghav Garg , Kapil Sharma , Karan Gupta

As large language models (LLMs) are increasingly used in multi-agent systems, questions of fairness should extend beyond resource distribution and procedural design to include the fairness of how agents communicate. Drawing from…

Artificial Intelligence · Computer Science 2025-05-20 Ruta Binkyte

Understanding how cognitive biases influence adversarial decision-making is essential for developing effective cyber defenses. Capture-the-Flag (CTF) competitions provide an ecologically valid testbed to study attacker behavior at scale,…

Cryptography and Security · Computer Science 2025-10-08 Carolina Carreira , Anu Aggarwal , Alejandro Cuevas , Maria José Ferreira , Hanan Hibshi , Cleotilde Gonzalez

Large Language Models (LLMs) are increasingly applied to forecasting. To evaluate this capability while mitigating pre-training data contamination, several living benchmarks have been proposed. However, existing benchmarks either lack the…

Machine Learning · Computer Science 2026-05-19 Mingtian Tan , Mihir Parmar , Palash Goyal , Chun-Liang Li , Nanyun Peng , Thomas Hartvigsen , Jinsung Yoon , Tomas Pfister

Test-time scaling (TTS) has emerged as a promising, training-free approach for enhancing large language model (LLM) performance. However, the efficacy of existing methods, such as Best-of-N and Self-Consistency, is fundamentally constrained…

Computation and Language · Computer Science 2025-09-30 Zhende Song , Shengji Tang , Peng Ye , Jiayuan Fan , Lei Bai , Tao Chen , Wanli Ouyang

Large language model (LLM) agents have shown increasing promise for collaborative task completion. However, existing multi-agent frameworks often rely on static workflows, fixed roles, and limited inter-agent communication, reducing their…

Multiagent Systems · Computer Science 2026-02-13 Chengxuan Xia , Qianye Wu , Sixuan Tian , Yilun Hao

Large language model (LLM) based agentic workflows have become a popular paradigm for coordinating multiple specialized agents to solve complex tasks. To improve serving efficiency, existing LLM systems employ prefix caching to reuse…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-11 Zaifeng Pan , Ajjkumar Patel , Zhengding Hu , Yipeng Shen , Yue Guan , Wan-Lu Li , Lianhui Qin , Yida Wang , Yufei Ding

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

Computation and Language · Computer Science 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin

Since the introduction of the Model Context Protocol (MCP), the number of available tools for Large Language Models (LLMs) has increased significantly. These task-specific tool sets offer an alternative to general-purpose tools such as web…

Computation and Language · Computer Science 2025-12-12 Reza Esfandiarpoor , Vishwas Suryanarayanan , Stephen H. Bach , Vishal Chowdhary , Anthony Aue

The integration of Large Language Models (LLMs) into the financial domain is driving a paradigm shift from passive information retrieval to dynamic, agentic interaction. While general-purpose tool learning has witnessed a surge in…

Artificial Intelligence · Computer Science 2026-03-10 Jiaxuan Lu , Kong Wang , Yemin Wang , Qingmei Tang , Hongwei Zeng , Xiang Chen , Jiahao Pi , Shujian Deng , Lingzhi Chen , Yi Fu , Kehua Yang , Xiao Sun

The increasing prevalence of large language models (LLMs) has significantly advanced text generation, but the human-like quality of LLM outputs presents major challenges in reliably distinguishing between human-authored and LLM-generated…

Computation and Language · Computer Science 2024-12-18 Zhen Tao , Yanfang Chen , Dinghao Xi , Zhiyu Li , Wei Xu