English
Related papers

Related papers: Jess+: designing embodied AI for interactive music…

200 papers

Music has always been thought of as a "human" endeavor -- when praising a piece of music, we emphasize the composer's creativity and the emotions the music invokes. Because music also heavily relies on patterns and repetition in the form of…

Sound · Computer Science 2024-01-05 Nicholas Yan

Dance performance traditionally follows a unidirectional relationship where movement responds to music. While AI has advanced in various creative domains, its application in dance has primarily focused on generating choreography from…

Sound · Computer Science 2025-06-16 Olga Vechtomova , Jeff Bos

In this paper, we propose Emotionally paired Music and Image Dataset (EMID), a novel dataset designed for the emotional matching of music and images, to facilitate auditory-visual cross-modal tasks such as generation and retrieval. Unlike…

Multimedia · Computer Science 2024-08-12 Jialing Zou , Jiahao Mei , Guangze Ye , Tianyu Huai , Qiwei Shen , Daoguo Dong

While Artificial Intelligence (AI) technologies are being progressively developed, artists and researchers are investigating their role in artistic practices. In this work, we present an AI-based Brain-Computer Interface (BCI) in which…

Artificial Intelligence · Computer Science 2022-02-08 Piera Riccio , Kristin Bergaust , Boel Christensen-Scheel , Juan-Carlos De Martin , Maria A. Zuluaga , Stefano Nichele

This paper presents an integrative review and experimental validation of artificial intelligence (AI) agents applied to music analysis and education. We synthesize the historical evolution from rule-based models to contemporary approaches…

Artificial Intelligence · Computer Science 2025-11-19 Antonio Manuel Martínez-Heredia , Dolores Godrid Rodríguez , Andrés Ortiz García

The term embodied intelligence (EI) conveys the notion that body morphology, material properties, interaction with the environment, and control strategies can be purposefully integrated into the process of robotic design to generate…

Robotics · Computer Science 2025-10-31 Nestor O. Perez-Arancibia

The Global Games Jam (GGJ) attracts many people who are passionate about games development, coming from a range of educational backgrounds. Therefore, the event can be experienced by novices and student developers as an opportunity for…

Computers and Society · Computer Science 2013-05-21 Michael James Scott , Gheorghita Ghinea

Musical performance requires prediction to operate instruments, to perform in groups and to improvise. In this paper, we investigate how a number of digital musical instruments (DMIs), including two of our own, have applied predictive…

Sound · Computer Science 2018-12-21 Charles P. Martin , Kai Olav Ellefsen , Jim Torresen

Games are a popular form of entertainment. However, many computer games present unnecessary barriers to players with sensory, motor and cognitive impairments. In order to overcome such pitfalls, an awareness of their impact and a…

Computers and Society · Computer Science 2015-12-31 Michael James Scott , Gheorghita Ghinea , Ian Hamilton

As immersive technologies evolve, immersive computational notebooks offer new opportunities for interacting with code, data, and outputs. However, scaling these environments remains a challenge, particularly when analysts manually arrange…

Human-Computer Interaction · Computer Science 2025-09-17 Sungwon In , Eric Krokos , Kirsten Whitley , Chris North , Yalong Yang

Several studies report that people diagnosed with autism spectrum disorder (ASD) have low employment rates and major difficulties in maintaining occupation (Hendricks, 2010). Adopting smart and interactive technology, promoted by Industry…

Human-Computer Interaction · Computer Science 2023-04-28 Carla Dei , Matteo Meregalli Falerni , Matteo Lavit Nicora , Mattia Chiappini , Matteo Malosio , Fabio Alexander Storm

As technologies become more and more pervasive, there is a need for considering the affective dimension of interaction with computer systems to make them more human-like. Current demands for this matter include accurate emotion recognition,…

Human-Computer Interaction · Computer Science 2018-06-13 Barbara Giżycka , Grzegorz J. Nalepa , Paweł Jemioło

This paper explores the integration of generative AI into the field of art therapy. Leveraging proven text-to-image models, we introduce a novel technical design to complement art therapy. The resulting AI-based tools shall enable patients…

Artificial Intelligence · Computer Science 2024-12-05 Yannis Valentin Schmutz , Tetiana Kravchenko , Souhir Ben Souissi , Mascha Kurpicz-Briki

In order to collaborate and co-create with humans, an AI system must be capable of both reactive and anticipatory behavior. We present a case study of such a system in the domain of musical improvisation. We consider a duo consisting of a…

Artificial Intelligence · Computer Science 2019-06-06 Oscar Thörn , Peter Fögel , Peter Knudsen , Luis de Miranda , Alessandro Saffiotti

In this paper, we explore how performers' embodied interactions with a Neural Audio Synthesis model allow the exploration of the latent space of such a model, mediated through movements sensed by e-textiles. We provide background and…

Experiential AI is proposed as a new research agenda in which artists and scientists come together to dispel the mystery of algorithms and make their mechanisms vividly apparent. It addresses the challenge of finding novel ways of opening…

Computers and Society · Computer Science 2019-08-08 Drew Hemment , Ruth Aylett , Vaishak Belle , Dave Murray-Rust , Ewa Luger , Jane Hillston , Michael Rovatsos , Frank Broz

Despite the proliferation of Blockchain Metaverse projects, the inclusion of physically disabled individuals in the Metaverse remains distant, with limited standards and regulations in place. However, the article proposes a concept of the…

Computers and Society · Computer Science 2023-11-16 Petar Radanliev , David De Roure , Peter Novitzky , Ivo Sluganovic

High-quality datasets for learning-based modelling of polyphonic symbolic music remain less readily-accessible at scale than in other domains, such as language modelling or image classification. Deep learning algorithms show great potential…

Sound · Computer Science 2022-04-04 Omar Peracha

AI-based technologies have significant potential to enhance inclusive education and clinical-rehabilitative contexts for children with Special Educational Needs and Disabilities. AI can enhance learning experiences, empower students, and…

Computers and Society · Computer Science 2025-05-22 Valeria Cesaroni , Eleonora Pasqua , Piercosma Bisconti , Martina Galletti

Generative AI's emphasis on automation and efficiency challenges design education, where learning is grounded in exploration, reflection, and responsibility. This work introduces AI Craftsmanship, a value-oriented framework drawing on…

Human-Computer Interaction · Computer Science 2026-04-09 Tuan-Ting Huang , Janet Yi-Ching Huang , Stephan Wensveen