English
Related papers

Related papers: ONOTE: Benchmarking Omnimodal Notation Processing …

200 papers

This paper introduces a simple efficient learning algorithms for general sequential decision making. The algorithm combines Optimism for exploration with Maximum Likelihood Estimation for model estimation, which is thus named OMLE. We prove…

Machine Learning · Computer Science 2022-11-24 Qinghua Liu , Praneeth Netrapalli , Csaba Szepesvári , Chi Jin

Having a unified, coherent taxonomy is essential for effective knowledge representation in domain-specific applications as diverse terminologies need to be mapped to underlying concepts. Traditional manual approaches to taxonomy alignment…

Evaluating off-policy decisions using batch data poses significant challenges due to limited sample sizes leading to high variance. To improve Off-Policy Evaluation (OPE), we must identify and address the sources of this variance. Recent…

Machine Learning · Statistics 2024-12-02 Ritam Majumdar , Jack Teversham , Sonali Parbhoo

Ontology Matching (OM) plays an important role in many domains such as bioinformatics and the Semantic Web, and its research is becoming increasingly popular, especially with the application of machine learning (ML) techniques. Although the…

Artificial Intelligence · Computer Science 2023-07-25 Yuan He , Jiaoyan Chen , Hang Dong , Ernesto Jiménez-Ruiz , Ali Hadian , Ian Horrocks

Symbolic music generation has seen rapid progress with artificial neural networks, yet remains underexplored in the biologically plausible domain of spiking neural networks (SNNs), where both standardized benchmarks and comprehensive…

Sound · Computer Science 2025-08-28 Qian Liang , Menghaoran Tang , Yi Zeng

Although probing frozen models has become a standard evaluation paradigm, self-supervised learning in audio defaults to fine-tuning when pursuing state-of-the-art on AudioSet. A key reason is that global pooling creates an information…

Automatic mean opinion score (MOS) prediction provides a more perceptual alternative to objective metrics, offering deeper insights into the evaluated models. With the rapid progress of multimodal large language models (MLLMs), their…

Sound · Computer Science 2025-09-23 Yuhang Jia , Xu Zhang , Yang Chen , Hui Wang , Enzhi Wang , Yong Qin

Large Language Models (LLMs) have demonstrated exceptional logical reasoning capabilities but frequently struggle with the continuous spatiotemporal dynamics governed by Partial Differential Equations (PDEs), often resulting in non-physical…

Machine Learning · Computer Science 2026-03-19 Hao Wu , Yongheng Zhang , Yuan Gao , Fan Xu , Fan Zhang , Ruobing Xie , Ruijian Gou , Yuxuan Liang , Xiaomeng Huang , Xian Wu

Native Omni-modal Large Language Models (OLLMs) have shifted from pipeline architectures to unified representation spaces. However, this native integration gives rise to a critical yet underexplored phenomenon: modality preference. To…

Artificial Intelligence · Computer Science 2026-04-30 Xinru Yan , Boxi Cao , Yaojie Lu , Hongyu Lin , Weixiang Zhou , Le Sun , Xianpei Han

Multimodal Large Language Models (MLLMs) have increasingly supported omni-modal processing across text, vision, and speech. However, existing evaluation frameworks for such models suffer from critical limitations, including modality…

Computation and Language · Computer Science 2026-04-29 Seunghee Kim , Ingyu Bang , Seokgyu Jang , Changhyeon Kim , Sanghwan Bae , Jihun Choi , Richeng Xuan , Taeuk Kim

As human machine teaming becomes central to paradigms like Industry 5.0, a critical need arises for machines to safely and effectively interpret complex human behaviors. A research gap currently exists between techno centric robotic…

Artificial Intelligence · Computer Science 2025-10-28 Alexis Ellis , Stacie Severyn , Fjollë Novakazi , Hadi Banaee , Cogan Shimizu

Unified multimodal models aim to jointly enable visual understanding and generation, yet current benchmarks rarely examine their true integration. Existing evaluations either treat the two abilities in isolation or overlook tasks that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Kai Zou , Ziqi Huang , Yuhao Dong , Shulin Tian , Dian Zheng , Hongbo Liu , Jingwen He , Bin Liu , Yu Qiao , Ziwei Liu

Modern information systems are changing the idea of "data processing" to the idea of "concept processing", meaning that instead of processing words, such systems process semantic concepts which carry meaning and share contexts with other…

Computation and Language · Computer Science 2018-11-09 Roger Granada , Renata Vieira , Cassia Trojahn , Nathalie Aussenac-Gilles

Constructing comprehensive knowledge graphs requires the use of multiple ontologies in order to fully contextualize data into a domain. Ontology matching finds equivalences between concepts interconnecting ontologies and creating a cohesive…

Artificial Intelligence · Computer Science 2025-10-27 Marta Contreiras Silva , Daniel Faria , Catia Pesquita

The evaluation of ranking tasks remains a significant challenge in natural language processing (NLP), particularly due to the lack of direct labels for results in real-world scenarios. Benchmark datasets play a crucial role in providing…

Information Retrieval · Computer Science 2025-03-04 Yan Wang , Lingfei Qian , Xueqing Peng , Jimin Huang , Dongji Feng

Off-policy evaluation (OPE) is a critical challenge in robust decision-making that seeks to assess the performance of a new policy using data collected under a different policy. However, the existing OPE methodologies suffer from several…

Machine Learning · Statistics 2025-02-11 Muhammad Faaiz Taufiq

Understanding semantic relationships within complex networks derived from lexical resources is fundamental for network science and language modeling. While network embedding methods capture contextual similarity, quantifying semantic…

Disordered Systems and Neural Networks · Physics 2026-01-09 Pablo Garcia-Cuadrillero , Fabio Revuelta , Jose Angel Capitan

Large Language Models (LLMs) are increasingly used in empirical software engineering (ESE) to automate or assist annotation tasks such as labeling commits, issues, and qualitative artifacts. Yet the reliability and reproducibility of such…

Software Engineering · Computer Science 2026-01-27 Mia Mohammad Imran , Tarannum Shaila Zaman

This paper presents NOMAD (Non-Matching Audio Distance), a differentiable perceptual similarity metric that measures the distance of a degraded signal against non-matching references. The proposed method is based on learning deep feature…

Sound · Computer Science 2024-01-22 Alessandro Ragano , Jan Skoglund , Andrew Hines

Data integration is considered a classic research field and a pressing need within the information science community. Ontologies play a critical role in such a process by providing well-consolidated support to link and semantically…

Artificial Intelligence · Computer Science 2024-05-30 Inès Osman , Salvatore F. Pileggi , Sadok Ben Yahia