English
Related papers

Related papers: AutoPT: How Far Are We from the End2End Automated …

200 papers

The introduction of genome engineering technology has transformed biomedical research, making it possible to make precise changes to genetic information. However, creating an efficient gene-editing system requires a deep understanding of…

ChatGPT is a generative pretrained transformer language model created using artificial intelligence implemented as chatbot which can provide very detailed responses to a wide variety of questions. As a very contemporary phenomenon, this…

Cryptography and Security · Computer Science 2023-07-14 Sheetal Temara

Autonomous agent systems powered by Large Language Models (LLMs) have demonstrated promising capabilities in automating complex tasks. However, current evaluations largely rely on success rates without systematically analyzing the…

Artificial Intelligence · Computer Science 2025-08-19 Ruofan Lu , Yichen Li , Yintong Huo

The overwhelming success of GPT-4 in early 2023 highlighted the transformative potential of large language models (LLMs) across various sectors, including national security. This article explores the implications of LLM integration within…

Cryptography and Security · Computer Science 2024-07-08 William N. Caballero , Phillip R. Jenkins

Sample size calculations for power analysis are critical for clinical research and trial design, yet their complexity and reliance on statistical expertise create barriers for many researchers. We introduce PowerGPT, an AI-powered system…

Autonomous agents powered by large language models (LLMs) promise to accelerate scientific discovery end-to-end, but rigorously evaluating their capacity for verifiable discovery remains a central challenge. Existing benchmarks face a…

Artificial Intelligence · Computer Science 2026-02-04 Zhen Wang , Fan Bai , Zhongyan Luo , Jinyan Su , Kaiser Sun , Xinle Yu , Jieyuan Liu , Kun Zhou , Claire Cardie , Mark Dredze , Eric P. Xing , Zhiting Hu

Safety- and security-critical systems have to be thoroughly tested against their specifications. The state of practice is to have _natural language_ specifications, from which test cases are derived manually - a process that is slow,…

Software Engineering · Computer Science 2025-11-25 Kuangxiangzi Liu , Dhiman Chakraborty , Alexander Liggesmeyer , Andreas Zeller

Large language models (LLMs) have achieved remarkable results on tasks framed as reasoning problems, yet their true ability to perform procedural reasoning, executing multi-step, rule-based computations remains unclear. Unlike algorithmic…

Artificial Intelligence · Computer Science 2025-11-20 Mahdi Samiei , Mahdi Mansouri , Mahdieh Soleymani Baghshah

Large language model (LLM) agents have demonstrated remarkable capabilities in software engineering and cybersecurity tasks, including code generation, vulnerability discovery, and automated testing. One critical but underexplored…

Software Engineering · Computer Science 2025-10-17 Bin Liu , Yanjie Zhao , Guoai Xu , Haoyu Wang

Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and boosting the effectiveness of code generation methods.…

Software Engineering · Computer Science 2025-02-10 Niels Mündler , Mark Niklas Müller , Jingxuan He , Martin Vechev

With the rapid advancement of large language models (LLMs) in code generation, their applications in hardware design are receiving growing attention. However, existing LLMs face several challenges when generating Verilog code for finite…

Software Engineering · Computer Science 2025-12-15 Qiuming Luo , Yanming Lei , Kunzhong Wu , Yixuan Cao , Chengjian Liu

Autonomous UI agents powered by AI have tremendous potential to boost human productivity by automating routine tasks such as filing taxes and paying bills. However, a major challenge in unlocking their full potential is security, which is…

Cryptography and Security · Computer Science 2025-05-20 Ivan Evtimov , Arman Zharmagambetov , Aaron Grattafiori , Chuan Guo , Kamalika Chaudhuri

Privacy policies serve as the primary conduit through which online service providers inform users about their data collection and usage procedures. However, in a bid to be comprehensive and mitigate legal risks, these policy documents are…

Computation and Language · Computer Science 2023-09-20 Chenhao Tang , Zhengliang Liu , Chong Ma , Zihao Wu , Yiwei Li , Wei Liu , Dajiang Zhu , Quanzheng Li , Xiang Li , Tianming Liu , Lei Fan

Problem-solving therapy (PST) is a structured psychological approach that helps individuals manage stress and resolve personal issues by guiding them through problem identification, solution brainstorming, decision-making, and outcome…

Computation and Language · Computer Science 2025-02-20 Elham Aghakhani , Lu Wang , Karla T. Washington , George Demiris , Jina Huh-Yoo , Rezvaneh Rezapour

Timely and effective vulnerability patching is essential for cybersecurity defense, for which various approaches have been proposed yet still struggle to generate valid and correct patches for real-world vulnerabilities. In this paper, we…

Cryptography and Security · Computer Science 2025-04-04 Yu Nong , Haoran Yang , Long Cheng , Hongxin Hu , Haipeng Cai

Machine learning (ML) is crucial in network anomaly detection for proactive threat hunting, reducing detection and response times significantly. However, challenges in model training, maintenance, and frequent false positives impact its…

Cryptography and Security · Computer Science 2023-09-29 Tarek Ali , Panos Kostakos

Advanced persistent threats (APTs) are sophisticated cyber attacks that can remain undetected for extended periods, making their mitigation particularly challenging. Given their persistence, significant effort is required to detect them and…

Cryptography and Security · Computer Science 2025-02-05 Parth Atulbhai Gandhi , Prasanna N. Wudali , Yonatan Amaru , Yuval Elovici , Asaf Shabtai

The advances made by Large Language Models (LLMs) have led to the pursuit of LLM agents that can solve intricate, multi-step reasoning tasks. As with any research pursuit, benchmarking and evaluation are key corner stones to efficient and…

Artificial Intelligence · Computer Science 2024-04-10 Luca Gioacchini , Giuseppe Siracusano , Davide Sanvito , Kiril Gashteovski , David Friede , Roberto Bifulco , Carolin Lawrence

Ensuring the safety of large language models (LLMs) is paramount, yet identifying potential vulnerabilities is challenging. While manual red teaming is effective, it is time-consuming, costly and lacks scalability. Automated red teaming…

Cryptography and Security · Computer Science 2024-12-24 Bojian Jiang , Yi Jing , Tianhao Shen , Tong Wu , Qing Yang , Deyi Xiong

Despite the impressive capabilities of large language models (LLMs), they currently exhibit two primary limitations, \textbf{\uppercase\expandafter{\romannumeral 1}}: They struggle to \textbf{autonomously solve the real world engineering…

Artificial Intelligence · Computer Science 2024-11-05 Bin Lei , Yuchen Li , Yiming Zeng , Tao Ren , Yi Luo , Tianyu Shi , Zitian Gao , Zeyu Hu , Weitai Kang , Qiuwu Chen