English
Related papers

Related papers: CodeWatcher: IDE Telemetry Data Extraction Tool fo…

200 papers

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

While LLM-Based agents, which use external tools to solve complex problems, have made significant progress, benchmarking their ability is challenging, thereby hindering a clear understanding of their limitations. In this paper, we propose…

Computation and Language · Computer Science 2024-11-07 Chuyu Zhang , Songyang Zhang , Yingfan Hu , Haowen Shen , Kuikun Liu , Zerun Ma , Fengzhe Zhou , Wenwei Zhang , Xuming He , Dahua Lin , Kai Chen

We introduce a novel dataset tailored for code generation, aimed at aiding developers in common tasks. Our dataset provides examples that include a clarified intent, code snippets associated, and an average of three related unit tests. It…

Computation and Language · Computer Science 2024-09-26 Nathanaël Beau , Benoît Crabbé

Artificial Intelligence (AI) has the potential to fundamentally change the educational landscape. So far, much of the physics education research relating to AI has focused on lecture-based assessment and the ability of ChatGPT to answer…

Physics Education · Physics 2024-01-02 Andrew Low , Z. Yasemin Kalender

Code Large Language Models (CodeLLMs) are increasingly used in code generation tasks across a wide range of applications. However, their performance is often inconsistent across different programming languages (PLs), with low-resource PLs…

Software Engineering · Computer Science 2025-10-02 Kaixin Wang , Tianlin Li , Xiaoyu Zhang , Aishan Liu , Xianglong Liu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , and Bin Shi

Large language models (LLMs) have demonstrated strong capabilities in code generation, underscoring the critical need for rigorous and comprehensive evaluation. Existing evaluation approaches fall into three categories, including…

Software Engineering · Computer Science 2025-10-21 Xinchen Wang , Pengfei Gao , Chao Peng , Ruida Hu , Cuiyun Gao

Although Large Language Models (LLMs) have demonstrated remarkable code-generation ability, they still struggle with complex tasks. In real-world software development, humans usually tackle complex tasks through collaborative teamwork, a…

Software Engineering · Computer Science 2024-05-14 Yihong Dong , Xue Jiang , Zhi Jin , Ge Li

The integration of Large Language Models (LLMs), especially ChatGPT, into education is poised to revolutionize students' learning experiences by introducing innovative conversational learning methodologies. To empower students to fully…

Human-Computer Interaction · Computer Science 2024-09-18 Zixin Chen , Jiachen Wang , Meng Xia , Kento Shigyo , Dingdong Liu , Rong Zhang , Huamin Qu

Video Temporal Grounding (VTG) strives to accurately pinpoint event timestamps in a specific video using linguistic queries, significantly impacting downstream tasks like video browsing and editing. Unlike traditional task-specific models,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yongxin Guo , Jingyu Liu , Mingda Li , Dingxin Cheng , Xiaoying Tang , Dianbo Sui , Qingbin Liu , Xi Chen , Kevin Zhao

Digital art portfolios serve as impactful mediums for artists to convey their visions, weaving together visuals, audio, interactions, and narratives. However, without technical backgrounds, design students often find it challenging to…

Human-Computer Interaction · Computer Science 2023-11-27 Tao Long , Weirui Peng

In this paper, we define visual log of a software system as data capturing the interactions between its users and its graphic user interface (GUI), such as screen-shots and screen recordings. We vision that mining such visual log could be…

Software Engineering · Computer Science 2016-10-28 Hung Pham , Tam Nguyen , Phong Vu , Tung Nguyen

Tool design and use reflect the ability to understand and manipulate the physical world through creativity, planning, and foresight. As such, these capabilities are often regarded as measurable indicators of intelligence across biological…

Robotics · Computer Science 2025-07-18 George Jiayuan Gao , Tianyu Li , Junyao Shi , Yihan Li , Zizhe Zhang , Nadia Figueroa , Dinesh Jayaraman

This paper introduces the Event Capture Annotation Tool (ECAT), a user-friendly, open-source interface tool for annotating events and their participants in video, capable of extracting the 3D positions and orientations of objects in video…

Computation and Language · Computer Science 2016-10-06 Tuan Do , Nikhil Krishnaswamy , James Pustejovsky

With their exceptional natural language processing capabilities, tools based on Large Language Models (LLMs) like ChatGPT and Co-Pilot have swiftly become indispensable resources in the software developer's toolkit. While recent studies…

Software Engineering · Computer Science 2024-01-08 Gustavo Pinto , Cleidson de Souza , João Batista Neto , Alberto de Souza , Tarcísio Gotto , Edward Monteiro

Issue tracking systems serve as the primary tool for incorporating external users and customizing a software project to meet the users' requirements. However, the limited number of contributors and the challenge of identifying the best…

Software Engineering · Computer Science 2024-02-07 Joy Krishan Das , Saikat Mondal , Chanchal K. Roy

Chat LLMs such as GPT-3.5-turbo and GPT-4 have shown promise in assisting humans in coding, particularly by enabling them to conversationally provide feedback. However, current approaches assume users have expert debugging skills, limiting…

Human-Computer Interaction · Computer Science 2024-10-10 Hao Yan , Thomas D. Latoza , Ziyu Yao

Large language models (LLMs) have revolutionized code generation, automating programming with remarkable efficiency. However, these advancements challenge programming skills, ethics, and assessment integrity, making the detection of…

Computation and Language · Computer Science 2025-07-18 Daniil Orel , Dilshod Azizov , Preslav Nakov

Developing web-based GIS applications, commonly known as CyberGIS dashboards, for querying and visualizing GIS data in environmental research often demands repetitive and resource-intensive efforts. While Generative AI offers automation…

Artificial Intelligence · Computer Science 2025-02-14 Haowen Xu , Xiao-Ying Yu

Creating animation takes time, effort, and technical expertise. To help novices with animation, we present LogoMotion, an AI code generation approach that helps users create semantically meaningful animation for logos. LogoMotion…

Human-Computer Interaction · Computer Science 2025-02-25 Vivian Liu , Rubaiat Habib Kazi , Li-Yi Wei , Matthew Fisher , Timothy Langlois , Seth Walker , Lydia Chilton

WebAssembly enables near-native execution in web applications and is increasingly adopted for tasks that demand high performance and robust security. However, its assembly-like syntax, implicit stack machine, and low-level data types make…

Software Engineering · Computer Science 2024-06-10 Weike Fang , Zhejian Zhou , Junzhou He , Weihang Wang