English
Related papers

Related papers: Semantic-Aware Interpretable Multimodal Music Auto…

200 papers

This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as ``music-words'' -- from symbolic music data. These patterns are fundamental to musical structure and reflect the cognitive…

The determination of musical key is a fundamental aspect of music theory and perception, providing a harmonic context for melodies and chord progressions. Automating this process, known as automatic key detection, is a significant task in…

Sound · Computer Science 2025-05-26 Henrique Perez G. Silva

Understanding complete musical scores entails integrated reasoning over pitch, rhythm, harmony, and large-scale structure, yet the ability of Large Language Models and Vision--Language Models to interpret full musical notation remains…

This vision paper presents the case for MUSIC, a programmable framework for building distributed mobile IoT applications for urban sensing. The Mobile Urban Sensing, Inference and Control (MUSIC) framework is contextualized for scenarios…

Networking and Internet Architecture · Computer Science 2018-10-01 Shiva R. Iyer , Soumie Kumar , Kate Boxer , Fatima Zarinni , Lakshminarayanan Subramanian

Mechanistic interpretability seeks to understand the neural mechanisms that enable specific behaviors in Large Language Models (LLMs) by leveraging causality-based methods. While these approaches have identified neural circuits that copy…

Computation and Language · Computer Science 2023-08-29 Vedant Palit , Rohan Pandey , Aryaman Arora , Paul Pu Liang

Real-world problems are often dependent on multiple data modalities, making multimodal fusion essential for leveraging diverse information sources. In high-stakes domains, such as in healthcare, understanding how each modality contributes…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Mafalda Malafaia , Thalea Schlender , Tanja Alderliesten , Peter A. N. Bosman

As artificial intelligence becomes increasingly pervasive and powerful, the ability to audit AI-based systems is growing in importance. However, explainability for artificial intelligence systems is not a one-size-fits-all solution;…

Human-Computer Interaction · Computer Science 2025-10-13 Nicola Rossberg , Bennett Kleinberg , Barry O'Sullivan , Luca Longo , Andrea Visentin

The Folksodriven framework makes it possible for data scientists to define an ontology environment where searching for buried patterns that have some kind of predictive power to build predictive models more effectively. It accomplishes this…

Information Retrieval · Computer Science 2017-01-02 Massimiliano Dal Mas

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

Given the massive market of advertising and the sharply increasing online multimedia content (such as videos), it is now fashionable to promote advertisements (ads) together with the multimedia content. It is exhausted to find relevant ads…

Multimedia · Computer Science 2020-01-06 Huaizheng Zhang , Yong Luo , Qiming Ai , Yonggang Wen

This paper presents an automated approach for interpretable feature recommendation for solving signal data analytics problems. The method has been tested by performing experiments on datasets in the domain of prognostics where…

Machine Learning · Statistics 2017-11-07 Snehasis Banerjee , Tanushyam Chattopadhyay , Ayan Mukherjee

Knowledge tracing models have enabled a range of intelligent tutoring systems to provide feedback to students. However, existing methods for knowledge tracing in learning sciences are predominantly reliant on statistical data and…

Computation and Language · Computer Science 2025-07-08 Hyeongdon Moon , Richard Davis , Seyed Parsa Neshaei , Pierre Dillenbourg

This paper investigates foundation models tailored for music informatics, a domain currently challenged by the scarcity of labeled data and generalization issues. To this end, we conduct an in-depth comparative study among various…

Sound · Computer Science 2023-11-07 Minz Won , Yun-Ning Hung , Duc Le

While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music necessitate tailored approaches. Music Audio-Visual Question Answering (Music AVQA) particularly…

Music exists in various modalities, such as score images, symbolic scores, MIDI, and audio. Translations between each modality are established as core tasks of music information retrieval, such as automatic music transcription…

Sound · Computer Science 2026-04-08 Jongmin Jung , Dongmin Kim , Sihun Lee , Seola Cho , Hyungjoon Soh , Irmak Bukey , Chris Donahue , Dasaem Jeong

Recent advancements in music large language models (LLMs) have significantly improved music understanding tasks, which involve the model's ability to analyze and interpret various musical elements. These improvements primarily focused on…

Sound · Computer Science 2025-09-24 Zhuoyuan Mao , Mengjie Zhao , Qiyu Wu , Hiromi Wakaki , Yuki Mitsufuji

State-of-the-art clustering algorithms use heuristics to partition the feature space and provide little insight into the rationale for cluster membership, limiting their interpretability. In healthcare applications, the latter poses a…

Machine Learning · Statistics 2018-12-04 Dimitris Bertsimas , Agni Orfanoudaki , Holly Wiberg

The field of computational pathology has witnessed great advancements since deep neural networks have been widely applied. These networks usually require large numbers of annotated data to train vast parameters. However, it takes…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yixiao Zhang , Adam Kortylewski , Qing Liu , Seyoun Park , Benjamin Green , Elizabeth Engle , Guillermo Almodovar , Ryan Walk , Sigfredo Soto-Diaz , Janis Taube , Alex Szalay , Alan Yuille

In natural language processing (NLP), the semantic similarity task requires large-scale, high-quality human-annotated labels for fine-tuning or evaluation. By contrast, in cases of music similarity, such labels are expensive to collect and…

Sound · Computer Science 2021-09-10 Xinran Zhang , Maosong Sun , Jiafeng Liu , Xiaobing Li

There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models…

Machine Learning · Computer Science 2020-08-17 Gregor Stiglic , Primoz Kocbek , Nino Fijacko , Marinka Zitnik , Katrien Verbert , Leona Cilar