English
Related papers

Related papers: Mage: Multi-Axis Evaluation of LLM-Generated Execu…

200 papers

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in aligning visual inputs with natural language outputs. Yet, the extent to which generated tokens depend on visual modalities remains poorly understood,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ruoyu Chen , Xiaoqing Guo , Kangwei Liu , Siyuan Liang , Shiming Liu , Qunli Zhang , Laiyuan Wang , Hua Zhang , Xiaochun Cao

Retrieval Augmented Generation (RAG) has advanced software engineering tasks but remains underexplored in unit test generation. To bridge this gap, we investigate the efficacy of RAG-based unit test generation for machine learning (ML/DL)…

Software Engineering · Computer Science 2025-10-20 Jiho Shin , Nima Shiri Harzevili , Reem Aleithan , Hadi Hemmati , Song Wang

The capabilities of Large Language Models (LLMs) in code generation have been extensively studied, particularly for implementing target functionalities from natural-language descriptions. Alternatively, input-output (I/O) examples provide…

Software Engineering · Computer Science 2025-05-13 Yingjie Fu , Bozhou Li , Linyi Li , Wentao Zhang , Tao Xie

While Retrieval-Augmented Generation (RAG) is increasingly adopted to ground Large Language Models (LLMs) in software artifacts, the optimal configuration of its components remains an open question for software engineering (SE) tasks. The…

Software Engineering · Computer Science 2026-05-15 Qiang Ke , Yanjie Zhao , Hongjin Leng , Shengming Zhao , Haoyu Wang

The procedural generation of levels and content in video games is a challenging AI problem. Often such generation relies on an intelligent way of evaluating the content being generated so that constraints are satisfied and/or objectives…

Artificial Intelligence · Computer Science 2019-04-22 Ahmed Khalifa , Michael Cerny Green , Gabriella Barros , Julian Togelius

Text-to-video generation models have shown significant progress in the recent years. However, they still struggle with generating complex dynamic scenes based on compositional text prompts, such as attribute binding for multiple objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Kaiyi Huang , Yukun Huang , Xuefei Ning , Zinan Lin , Yu Wang , Xihui Liu

Compiler pass selection and phase ordering present a significant challenge in achieving optimal program performance, particularly for objectives like code size reduction. Standard compiler heuristics offer general applicability but often…

Software Engineering · Computer Science 2025-10-16 Haolin Pan , Chao Zha , Jinyuan Dong , Mingjie Xing , Yanjun Wu

Instruction tuning of large vision-language models (LVLMs) increasingly depends on massive multimodal corpora, yet these datasets contain samples with substantial redundancy, low visual dependency, and highly imbalanced coverage of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shristi Das Biswas , Kaushik Roy

Mobile graphical user interface (GUI) agents driven by vision-language models (VLMs) perceive the screen as rendered pixels and choose actions from what they see, so they cannot reliably separate trusted interface elements from…

Cryptography and Security · Computer Science 2026-05-28 Ruoqi Guo , Yi Liu , Gelei Deng , Yiheng Xiong , Yuekang Li , Ying Zhang , Leo Yu Zhang , Lida Zhao , Ji Jie , Yuxiao Lu

Robustness is a critical factor for reliable code generation by large language models, yet most evaluations focus on correctness and overlook key issues such as missing input validation and inadequate error handling. In this work, we…

Software Engineering · Computer Science 2025-09-24 Zike Li , Mingwei Liu , Anji Li , Kaifeng He , Yanlin Wang , Xin Peng , Zibin Zheng

Symbolic execution is a powerful verification tool for hardware designs, but suffers from the path explosion problem. We introduce a new approach, piecewise composition, which leverages the modular structure of hardware to transfer the work…

Cryptography and Security · Computer Science 2023-04-13 Kaki Ryan , Cynthia Sturton

Current paradigms for code verification rely heavily on external mechanisms-such as execution-based unit tests or auxiliary LLM judges-which are often labor-intensive or limited by the judging model's own capabilities. This raises a…

Software Engineering · Computer Science 2026-02-10 Yicheng He , Zheng Zhao , Zhou Kaiyu , Bryan Dai , Jie Fu , Yonghui Yang

Large Language Models (LLMs) have shown great promise in tool-making, yet existing frameworks often struggle to efficiently construct reliable toolsets and are limited to single-task settings. To address these challenges, we propose GATE…

Computation and Language · Computer Science 2025-02-21 Jianwen Luo , Yiming Huang , Jinxiang Meng , Fangyu Lei , Shizhu He , Xiao Liu , Shanshan Jiang , Bin Dong , Jun Zhao , Kang Liu

In the current era of generative AI breakthroughs, generating panoramic scenes from a single input image remains a key challenge. Most existing methods use diffusion-based iterative or simultaneous multi-view inpainting. However, the lack…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zhipeng Cai , Matthias Mueller , Reiner Birkl , Diana Wofk , Shao-Yen Tseng , JunDa Cheng , Gabriela Ben-Melech Stan , Vasudev Lal , Michael Paulitsch

While Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation, they often produce solutions that lack guarantees of correctness, robustness, and efficiency. This limitation is particularly acute in domains…

Software Engineering · Computer Science 2025-09-04 Yueke Zhang , Yifan Zhang , Kevin Leach , Yu Huang

Retrieval-augmented generation (RAG) has been widely adopted to augment large language models (LLMs) with external knowledge for knowledge-intensive tasks. However, its effectiveness is often undermined by the presence of noisy (i.e.,…

Information Retrieval · Computer Science 2025-10-09 Minghao Tang , Shiyu Ni , Jiafeng Guo , Keping Bi

Large Language Model (LLM)-based agents demonstrate advanced reasoning capabilities, yet practical constraints frequently limit outputs to single responses, leaving significant performance potential unrealized. This paper introduces MARINE…

Multiagent Systems · Computer Science 2025-12-10 Hongwei Zhang , Ji Lu , Yongsheng Du , Yanqin Gao , Lingjun Huang , Baoli Wang , Fang Tan , Peng Zou

Diagnosing failures in LLM agents remains largely manual. Practitioners inspect a small subset of execution traces, form ad-hoc hypotheses, and iterate. This process misses patterns that only emerge across trace populations and does not…

Artificial Intelligence · Computer Science 2026-05-22 Akshay Manglik , Apaar Shanker , Kaustubh Deshpande , Jason Qin , Yash Maurya , Veronica Chatrath , Vijay S. Kalmath , Levi Lentz , Yuan , Xue

Automated question-answering (QA) systems increasingly rely on retrieval-augmented generation (RAG) to ground large language models (LLMs) in authoritative medical knowledge, ensuring clinical accuracy and patient safety in Artificial…

Computation and Language · Computer Science 2026-03-05 Aswini Sivakumar , Vijayan Sugumaran , Yao Qiang

Large language models (LLMs) have been observed to suddenly exhibit advanced reasoning abilities during reinforcement learning (RL), resembling an ``aha moment'' triggered by simple outcome-based rewards. While RL has proven effective in…

Machine Learning · Computer Science 2025-06-13 Xiaoqing Zhang , Huabin Zheng , Ang Lv , Yuhan Liu , Zirui Song , Xiuying Chen , Rui Yan , Flood Sung