English
Related papers

Related papers: GazeCopilot: Evaluating Novel Gaze-Informed Prompt…

200 papers

Large Language Models (LLMs) are rapidly transforming software engineering, with coding assistants embedded in an IDE becoming increasingly prevalent. While research has focused on improving the tools and understanding developer…

Multimodal large language models (LMMs) excel in world knowledge and problem-solving abilities. Through the use of a world-facing camera and contextual AI, emerging smart accessories aim to provide a seamless interface between humans and…

Human-Computer Interaction · Computer Science 2024-02-01 Robert Konrad , Nitish Padmanaban , J. Gabriel Buckmaster , Kevin C. Boyle , Gordon Wetzstein

API misuse introduces security vulnerabilities, system failures, and increases maintenance costs, all of which remain critical challenges in software development. Existing detection approaches rely on static analysis or machine…

Software Engineering · Computer Science 2025-09-23 Saikat Mondal , Chanchal K. Roy , Hong Wang , Juan Arguello , Samantha Mathan

Currently, large pre-trained language models are widely applied in neural code completion systems. Though large code models significantly outperform their smaller counterparts, around 70\% of displayed code completions from Github Copilot…

Software Engineering · Computer Science 2024-08-12 Zhensu Sun , Xiaoning Du , Fu Song , Shangwen Wang , Mingze Ni , Li Li , David Lo

The rapid adoption of Artificial Intelligence(AI) programming assistants such as GitHub Copilot introduces new challenges in how these software tools address human needs. Many existing evaluation frameworks address technical aspects such as…

Software Engineering · Computer Science 2025-08-07 Soroush Heydari

Previous studies have illustrated the potential of analysing gaze behaviours in collaborative learning to provide educationally meaningful information for students to reflect on their learning. Over the past decades, machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junyuan Liang , Qi Zhou , Sahan Bulathwela , Mutlu Cukurova

When graduates of computing degree programs enter the software industry, they will most likely join teams working on legacy code bases developed by people other than themselves. In these so-called brownfield software development settings,…

Software Engineering · Computer Science 2025-06-13 Md Istiak Hossain Shihab , Christopher Hundhausen , Ahsun Tariq , Summit Haque , Yunhan Qiao , Brian Mulanda

Following the gaze of other people and analyzing the target they are looking at can help us understand what they are thinking, and doing, and predict the actions that may follow. Existing methods for gaze following struggle to perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Feiyang Liu , Dan Guo , Jingyuan Xu , Zihao He , Shengeng Tang , Kun Li , Meng Wang

Smart glasses are accelerating progress toward more seamless and personalized LLM-based assistance by integrating multimodal inputs. Yet, these inputs rely on obtrusive explicit prompts. The advent of gaze tracking on smart devices offers a…

Human-Computer Interaction · Computer Science 2026-01-27 Jiexin Ding , Yizhuo Zhang , Xinyun Liu , Ke chen , Yuntao Wang , Shwetak Patel , Akshay Gadre

AI-powered code assistants, such as Copilot, are quickly becoming a ubiquitous component of contemporary coding contexts. Among these environments, computational notebooks, such as Jupyter, are of particular interest as they provide rich…

Human-Computer Interaction · Computer Science 2023-01-27 Andrew M. McNutt , Chenglong Wang , Robert A. DeLine , Steven M. Drucker

With the increasing adoption of AI-driven tools in software development, large language models (LLMs) have become essential for tasks like code generation, bug fixing, and optimization. Tools like ChatGPT, GitHub Copilot, and Codeium…

Software Engineering · Computer Science 2024-10-01 Md Sultanul Islam Ovi , Nafisa Anjum , Tasmina Haque Bithe , Md. Mahabubur Rahman , Mst. Shahnaj Akter Smrity

The rapid integration of AI-powered coding assistants into developer workflows has raised significant privacy and trust concerns. As developers entrust proprietary code to services like OpenAI's GPT, Google's Gemini, and GitHub Copilot, the…

Cryptography and Security · Computer Science 2025-09-26 Amir AL-Maamari

The emergence of advanced multimodal large language models (MLLMs) has significantly enhanced AI assistants' ability to process complex information across modalities. Recently, egocentric videos, by directly capturing user focus, actions,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Taiying Peng , Jiacheng Hua , Miao Liu , Feng Lu

This paper presents an AI-assisted programming tool called Copilot for Xcode for program composition and design to support human software developers. By seamlessly integrating cloud-based Large Language Models (LLM) with Apple's local…

Software Engineering · Computer Science 2023-07-28 Chee Wei Tan , Shangxin Guo , Man Fai Wong , Ching Nam Hang

This study investigates the real-world impact of the generative AI (GenAI) tool GitHub Copilot on developer activity and perceived productivity. We conducted a mixed-methods case study in NAV IT, a large public sector agile organization. We…

Software Engineering · Computer Science 2026-04-30 Viktoria Stray , Elias Goldmann Brandtzæg , Viggo Tellefsen Wivestad , Astri Barbala , Nils Brede Moe

With the rapid development of large language models in code generation, AI-powered editors such as GitHub Copilot and Cursor are revolutionizing software development practices. At the same time, studies have identified potential defects in…

Software Engineering · Computer Science 2026-02-19 Yuan Huang , Yukang Zhou , Xiangping Chen , Zibin Zheng

Imitation learning for acquiring generalizable policies often requires a large volume of demonstration data, making the process significantly costly. One promising strategy to address this challenge is to leverage the cognitive and…

Robotics · Computer Science 2025-06-09 Yutaro Ishida , Takamitsu Matsubara , Takayuki Kanai , Kazuhiro Shintani , Hiroshi Bito

AI Code Completion (e.g., GitHub's Copilot) has revolutionized how computer science students interact with programming languages. However, AI code completion has been studied from the developers' perspectives, not the students' perspectives…

The availability of generative Artificial Intelligence (AI) tools such as ChatGPT or GitHub Copilot is reshaping the way in which software is developed, evolved, and maintained. Oftentimes, developers leave traces of such an usage in…

AI-powered programming assistants are increasingly gaining popularity, with GitHub Copilot alone used by over a million developers worldwide. These tools are far from perfect, however, producing code suggestions that may be incorrect in…

Human-Computer Interaction · Computer Science 2024-02-26 Kasra Ferdowsi , Ruanqianqian Huang , Michael B. James , Nadia Polikarpova , Sorin Lerner