English
Related papers

Related papers: SeaView: Software Engineering Agent Visual Interfa…

200 papers

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

The rise of large language models (LLMs) has led to dramatic improvements across a wide range of natural language tasks. Their performance on certain tasks can be further enhanced by incorporating test-time reasoning techniques. These…

Software Engineering · Computer Science 2026-01-13 Saurabh Pujar , Ira Ceka , Irene Manotas , Gail Kaiser , Baishakhi Ray , Shyam Ramji

Large language model (LLM) agents have demonstrated remarkable capabilities in software engineering and cybersecurity tasks, including code generation, vulnerability discovery, and automated testing. One critical but underexplored…

Software Engineering · Computer Science 2025-10-17 Bin Liu , Yanjie Zhao , Guoai Xu , Haoyu Wang

The rapid evolution of Multi-modal Large Language Models (MLLMs) has advanced workflow automation; however, existing research mainly targets performance upper bounds in static environments, overlooking robustness for stochastic real-world…

Artificial Intelligence · Computer Science 2026-01-14 Daocheng Fu , Jianbiao Mei , Rong Wu , Xuemeng Yang , Jia Xu , Ding Wang , Pinlong Cai , Yong Liu , Licheng Wen , Botian Shi

Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in…

Information Retrieval · Computer Science 2025-09-03 Xinyu Geng , Peng Xia , Zhen Zhang , Xinyu Wang , Qiuchen Wang , Ruixue Ding , Chenxi Wang , Jialong Wu , Yida Zhao , Kuan Li , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

Numerous software analysis tools exist today, yet applying them to diverse open-source projects remains challenging due to environment setup, dependency resolution, and tool configuration. LLM-based agents offer a potential solution, yet no…

Software Engineering · Computer Science 2026-04-20 Islem Bouzenia , Cristian Cadar , Michael Pradel

We introduce SasAgent, a multi-agent AI system powered by large language models (LLMs) that automates small-angle scattering (SAS) data analysis by leveraging tools from the SasView software and enables user interaction via text input.…

Artificial Intelligence · Computer Science 2025-09-09 Lijie Ding , Changwoo Do

Recent advances in coding agents have made them capable of planning, editing, running, and testing complex code bases. Despite their growing ability in coding tasks, these systems still struggle to infer and track user intent, especially…

Software Engineering · Computer Science 2026-02-02 Xuhui Zhou , Valerie Chen , Zora Zhiruo Wang , Graham Neubig , Maarten Sap , Xingyao Wang

Accurate visual understanding is imperative for advancing autonomous systems and intelligent robots. Despite the powerful capabilities of vision-language models (VLMs) in processing complex visual scenes, precisely recognizing obscured or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Huaxiang Zhang , Yaojia Mu , Guo-Niu Zhu , Zhongxue Gan

LLM-based web agents have recently made significant progress, but much of it has occurred in closed-source systems, widening the gap with open-source alternatives. Progress has been held back by two key challenges: first, a narrow focus on…

Machine learning and Large language models (LLMs) for vulnerability detection has received significant attention in recent years. Unfortunately, state-of-the-art techniques show that LLMs are unsuccessful in even distinguishing the…

Cryptography and Security · Computer Science 2025-08-05 Mohammed Sayagh , Mohammad Ghafari

The rapid proliferation of large language models (LLMs) has intensified the requirement for reliable safety evaluation to uncover model vulnerabilities. To this end, numerous LLM safety evaluation benchmarks are proposed. However, existing…

Computation and Language · Computer Science 2025-08-22 Xiangyang Zhu , Yuan Tian , Chunyi Li , Kaiwei Zhang , Wei Sun , Guangtao Zhai

The rapid advancement of Large Language Models (LLMs) and their integration into autonomous agent systems has created unprecedented opportunities for document analysis, decision support, and knowledge retrieval. However, the complexity of…

Machine Learning · Computer Science 2026-01-13 Tzu-Hsuan Lin , Chih-Hsuan Kao

Recent advancements in Large Language Models (LLMs) have led to the development of intelligent LLM-based agents capable of interacting with graphical user interfaces (GUIs). These agents demonstrate strong reasoning and adaptability,…

Artificial Intelligence · Computer Science 2025-04-16 Wenjia Jiang , Yangyang Zhuang , Chenxi Song , Xu Yang , Joey Tianyi Zhou , Chi Zhang

Large Language Model (LLM) agents have shown strong results on multi-turn tool-use tasks, yet they operate in isolation during training, failing to leverage experiences accumulated across episodes. Existing experience-augmented methods…

Machine Learning · Computer Science 2026-03-20 Prince Zizhuang Wang , Shuli Jiang

Large Language Models (LLMs) increasingly act as function-call agents that invoke external tools to tackle tasks beyond their static knowledge. However, they typically invoke tools one at a time without a global view of task structure. As…

Artificial Intelligence · Computer Science 2026-05-22 Yan Jiang , Hao Zhou , Lizhong GU , Tianlong Li , Ruinan Jin , Wanqi Zhou , Ai Han

AI agents are increasingly being deployed to automate tasks, often based on underspecified user instructions. Making unwarranted assumptions to compensate for the missing information and failing to ask clarifying questions can lead to…

Artificial Intelligence · Computer Science 2026-02-24 Sanidhya Vijayvargiya , Xuhui Zhou , Akhila Yerukola , Maarten Sap , Graham Neubig

Context. LLM-based autonomous agents in software engineering rely on large, proprietary models, limiting local deployment. This has spurred interest in Small Language Models (SLMs), but their practical effectiveness and efficiency within…

Software Engineering · Computer Science 2025-12-12 Arihant Tripathy , Ch Pavan Harshit , Karthik Vaidhyanathan

Effort estimation is a crucial activity in agile software development, where teams collaboratively review, discuss, and estimate the effort required to complete user stories in a product backlog. Current practices in agile effort estimation…

Software Engineering · Computer Science 2025-09-19 Thanh-Long Bui , Hoa Khanh Dam , Rashina Hoda