English
Related papers

Related papers: Geno: A Developer Tool for Authoring Multimodal In…

200 papers

Recent advances in interactive technologies have highlighted the prominence of audio signals for semantic encoding. This paper explores a new task, where audio signals are used as conditioning inputs to generate motions that align with the…

Sound · Computer Science 2025-05-30 Zi-An Wang , Shihao Zou , Shiyao Yu , Mingyuan Zhang , Chao Dong

This paper describes a new modelling language for the effective design of Java annotations. Since their inclusion in the 5th edition of Java, annotations have grown from a useful tool for the addition of meta-data to play a central role in…

Programming Languages · Computer Science 2019-10-02 Irene Córdoba , Juan de Lara

Earnings calls represent a uniquely rich and semi-structured source of financial communication, blending scripted managerial commentary with unscripted analyst dialogue. Although recent advances in financial sentiment analysis have…

Computation and Language · Computer Science 2025-09-05 Alejandro Álvarez Castro , Joaquín Ordieres-Meré

The present study proposes a novel approach to dream recording by combining non-invasive brain-machine interfaces (BMI), thought-typing software, and generative AI-assisted multimodal software. This method aims to sublimate conscious…

Human-Computer Interaction · Computer Science 2023-04-21 Todd Kelsey

DevBots are automated tools that perform various tasks in order to support software development. They are a growing trend and have been used in repositories to automate repetitive tasks, as code generators, and as collaborators in eliciting…

Software Engineering · Computer Science 2023-12-12 Vinicius Soares Silva Marques

Large language models (LLMs) have recently been applied in software engineering to perform tasks such as translating code between programming languages, generating code from natural language, and autocompleting code as it is being written.…

Human-Computer Interaction · Computer Science 2023-02-15 Steven I. Ross , Fernando Martinez , Stephanie Houde , Michael Muller , Justin D. Weisz

Several works have developed end-to-end pipelines for generating lip-synced talking faces with various real-world applications, such as teaching and language translation in videos. However, these prior works fail to create realistic-looking…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sahil Goyal , Shagun Uppal , Sarthak Bhagat , Yi Yu , Yifang Yin , Rajiv Ratn Shah

Multimodal Large Language Models (MLLMs) have shown great potential in revolutionizing Graphical User Interface (GUI) automation. However, existing GUI models mostly rely on learning from nearly error-free offline trajectories, thus lacking…

Artificial Intelligence · Computer Science 2025-06-10 Penghao Wu , Shengnan Ma , Bo Wang , Jiaheng Yu , Lewei Lu , Ziwei Liu

Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designers often struggle to craft effective prompts and find it…

Human-Computer Interaction · Computer Science 2025-11-19 Weiyan Shi , Sunaya Upadhyay , Geraldine Quek , Kenny Tsu Wei Choo

Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments to the copilots due to the complexity of conveying…

Human-Computer Interaction · Computer Science 2025-05-09 Xiyun Hu , Dizhi Ma , Fengming He , Zhengzhe Zhu , Shao-Kang Hsia , Chenfei Zhu , Ziyi Liu , Karthik Ramani

Determining how voice assistants should broker consent to share data with third party software has proven to be a complex problem. Devices often require users to switch to companion smartphone apps in order to navigate permissions menus for…

Human-Computer Interaction · Computer Science 2022-04-22 William Seymour , Mark Cote , Jose Such

This paper describes a new modelling language for the effective design and validation of Java annotations. Since their inclusion in the 5th edition of Java, annotations have grown from a useful tool for the addition of meta-data to play a…

Programming Languages · Computer Science 2019-10-02 Irene Córdoba , Juan de Lara

To enhance productivity and to streamline workflows, there is a growing trend to embed large language model (LLM) functionality into applications, from browser-based web apps to native apps that run on personal computers. Here, we introduce…

Human-Computer Interaction · Computer Science 2024-08-01 Lukas Teufelberger , Xintong Liu , Zhipeng Li , Max Moebus , Christian Holz

The proliferation of Large Language Models like ChatGPT has significantly advanced language understanding and generation, impacting a broad spectrum of applications. However, these models predominantly excel in text-based tasks, overlooking…

Computation and Language · Computer Science 2023-11-23 Xiao Liu , Jianfeng Lin , Jiawei Zhang

Chatbot is a machine with the ability to answer automatically through a conversational interface. A chatbot is considered as one of the most exceptional and promising expressions of human computer interaction. Voice-based chatbots or…

Human-Computer Interaction · Computer Science 2022-08-24 Sagina Athikkal , John Jenq

The current software development tools show the same form of interaction as when they started back, in the mid 70's. However, since the appearance of visual languages and due to their own nature, they can be handled by tools which have…

Human-Computer Interaction · Computer Science 2012-05-04 Carlos Alberto Fernandez-y-Fernandez , Jose Angel Quintanar

Voice assistants provide users a new way of interacting with digital products, allowing them to retrieve information and complete tasks with an increased sense of control and flexibility. Such products are comprised of several machine…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-27 Shachaf Poran , Gil Amsalem , Amit Beka , Dmitri Goldenberg

Communication network engineering in enterprise environments is traditionally a complex, time-consuming, and error-prone manual process. Most research on network engineering automation has concentrated on configuration synthesis, often…

Networking and Internet Architecture · Computer Science 2025-08-27 Beni Ifland , Elad Duani , Rubin Krief , Miro Ohana , Aviram Zilberman , Andres Murillo , Ofir Manor , Ortal Lavi , Hikichi Kenji , Asaf Shabtai , Yuval Elovici , Rami Puzis

Software development is a complex task that necessitates cooperation among multiple members with diverse skills. Numerous studies used deep learning to improve specific phases in a waterfall model, such as design, coding, and testing.…

Software Engineering · Computer Science 2024-06-06 Chen Qian , Wei Liu , Hongzhang Liu , Nuo Chen , Yufan Dang , Jiahao Li , Cheng Yang , Weize Chen , Yusheng Su , Xin Cong , Juyuan Xu , Dahai Li , Zhiyuan Liu , Maosong Sun

Interactive articles help readers engage with complex ideas through exploration, yet creating them remains costly, requiring both domain expertise and web development skills. Recent LLM-based agents can automate content creation, but…

Computation and Language · Computer Science 2026-03-03 Yinghao Tang , Yupeng Xie , Yingchaojie Feng , Tingfeng Lan , Wei Chen