English
Related papers

Related papers: Screen Reader Programmers in the Vibe Coding Era: …

200 papers

Generative AI tools have become more prevalent in engineering workflows, particularly through chatbots and code assistants. As the perceived accuracy of these tools improves, questions arise about whether and how those who work in…

Human-Computer Interaction · Computer Science 2025-06-18 Emanuel Moss , Elizabeth Watkins , Christopher Persaud , Passant Karunaratne , Dawn Nafus

AI-powered coding assistants can support students in programming courses by providing on-demand explanations and debugging help. However, existing research often focuses on individual tools, leaving a gap in evidence-based design…

Human-Computer Interaction · Computer Science 2026-03-25 Boxuan Ma , Yinjie Xie , Huiyong Li , Gen Li , Li Chen , Atsushi Shimada , Shin'Ichi Konomi

When designing a program, both novice programmers and seasoned developers alike often sketch out -- or, perhaps more famously, whiteboard -- their ideas. Yet despite the introduction of natively multimodal Generative AI models, work on…

Computers and Society · Computer Science 2026-02-12 David H. Smith , S. Moonwara A. Monisha , Annapurna Vadaparty , Leo Porter , Daniel Zingaro

AI coding agents are increasingly acting as autonomous contributors by generating and submitting pull requests (PRs). However, we lack empirical evidence on how these agent-generated PRs differ from human contributions, particularly in how…

Software Engineering · Computer Science 2026-04-07 Daniel Ogenrwot , John Businge

We present a case study of using generative user interfaces, or ``vibe coding,'' a method leveraging large language models (LLMs) for generating code via natural language prompts, to support rapid prototyping in user-centered design (UCD).…

Human-Computer Interaction · Computer Science 2025-07-29 Tianyi Li , Tanay Maheshwari , Alex Voelker

People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI…

Human-Computer Interaction · Computer Science 2024-07-15 Jingyi Xie , Rui Yu , He Zhang , Sooyeon Lee , Syed Masum Billah , John M. Carroll

As the boundaries of human computer interaction expand, Generative AI emerges as a key driver in reshaping user interfaces, introducing new possibilities for personalized, multimodal and cross-platform interactions. This integration…

Human-Computer Interaction · Computer Science 2024-11-18 J. Bieniek , M. Rahouti , D. C. Verma

Generative AI is reshaping software work, yet we lack clear guidance on where developers most need support and how to design it responsibly. We report a large-scale, mixed-methods study of N=860 developers examining where, why, and how they…

Software Engineering · Computer Science 2026-01-05 Rudrajit Choudhuri , Carmen Badea , Christian Bird , Jenna Butler , Rob DeLine , Brian Houck

Can visual artworks created using generative visual algorithms inspire human creativity in storytelling? We asked writers to write creative stories from a starting prompt, and provided them with visuals created by generative AI models from…

Human-Computer Interaction · Computer Science 2021-10-29 Safinah Ali , Devi Parikh

Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers…

Software Engineering · Computer Science 2024-04-23 Hussein Mozannar , Gagan Bansal , Adam Fourney , Eric Horvitz

Generative AI creates new opportunities for programming education, but many existing systems remain overly directive, producing lengthy explanations and premature solutions that can overwhelm K-12 novices. In this paper, we present a…

Human-Computer Interaction · Computer Science 2026-05-19 Cassandra Lucas , Anshul Bihani , Rohini Kukka , Chun-Hua Tsai , Jaydeb Sarker , Mia Mohammad Imran

Automating the transformation of user interface (UI) designs into front-end code holds significant promise for accelerating software development and democratizing design workflows. While multimodal large language models (MLLMs) can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yilei Jiang , Yaozhi Zheng , Yuxuan Wan , Jiaming Han , Qunzhong Wang , Michael R. Lyu , Xiangyu Yue

Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is…

Software Engineering · Computer Science 2025-05-14 Glaucia Melo , Paulo Alencar , Donald Cowan

Adapting production-level computer vision tools to bespoke scientific datasets is a critical "last mile" bottleneck. Current solutions are impractical: fine-tuning requires large annotated datasets scientists often lack, while manual code…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xuefei , Wang , Kai A. Horstmann , Ethan Lin , Jonathan Chen , Alexander R. Farhang , Sophia Stiles , Atharva Sehgal , Jonathan Light , David Van Valen , Yisong Yue , Jennifer J. Sun

Programming assistants have reshaped the experience of programming into one where programmers spend less time writing and more time critically examining code. In this paper, we explore how programming assistants can be extended to…

Human-Computer Interaction · Computer Science 2024-03-06 Litao Yan , Alyssa Hwang , Zhiyuan Wu , Andrew Head

As generative AI becomes integral to software development, the risk of over-reliance and diminished critical thinking grows. This study introduces "Ceci," our Caring Empathic C IDE designed to support novice programmers by prioritizing…

Software Engineering · Computer Science 2026-04-22 Justin Rainier Go , Kurt Christian Andaya , Roemer Gabriel Caliboso , Aaron Daniel Go , Jocelynn Cu

The rapid adoption of Artificial Intelligence(AI) programming assistants such as GitHub Copilot introduces new challenges in how these software tools address human needs. Many existing evaluation frameworks address technical aspects such as…

Software Engineering · Computer Science 2025-08-07 Soroush Heydari

Vibe coding, a term coined by Andrej Karpathy in February 2025, has quickly become a compelling and controversial natural language programming paradigm in AI-assisted software development. Centered on iterative co-design with an AI…

Software Engineering · Computer Science 2025-09-17 Veronica Pimenova , Sarah Fakhoury , Christian Bird , Margaret-Anne Storey , Madeline Endres

The integration of artificial intelligence (AI) continues to increase and evolve, including in software engineering (SE). This integration involves processes traditionally entrusted to humans, such as coding. However, the impact on…

Software Engineering · Computer Science 2025-01-07 Adam Alami , Neil A. Ernst

AI-powered code assistants are widely used to generate code completions, significantly boosting developer productivity. However, these tools typically present suggestions without explaining their rationale, leaving their decision-making…

Human-Computer Interaction · Computer Science 2025-09-23 Runlong Ye , Zeling Zhang , Boushra Almazroua , Michael Liut