中文
相关论文

相关论文: MulCogBench: A Multi-modal Cognitive Benchmark Dat…

200 篇论文

How the brain supports language across different languages is a basic question in neuroscience and a useful test for multilingual artificial intelligence. Neuroimaging has identified language-responsive brain regions across languages, but…

Do machines and humans process language in similar ways? Recent research has hinted at the affirmative, showing that human neural activity can be effectively predicted using the internal representations of language models (LMs). Although…

计算与语言 · 计算机科学 2025-01-15 Yuchen Zhou , Emmy Liu , Graham Neubig , Michael J. Tarr , Leila Wehbe

Reasoning stands as a cornerstone of intelligence, enabling the synthesis of existing knowledge to solve complex problems. Despite remarkable progress, existing reasoning benchmarks often fail to rigorously evaluate the nuanced reasoning…

This paper proposes a modularized sense induction and representation learning model that jointly learns bilingual sense embeddings that align well in the vector space, where the cross-lingual signal in the English-Chinese parallel corpus is…

计算与语言 · 计算机科学 2018-10-23 Ta-Chung Chi , Yun-Nung Chen

Elucidating the language-brain relationship requires bridging the methodological gap between the abstract theoretical frameworks of linguistics and the empirical neural data of neuroscience. Serving as an interdisciplinary cornerstone,…

神经元与认知 · 定量生物学 2026-02-16 Fudong Zhang , Bo Chai , Yujie Wu , Wai Ting Siok , Nizhuan Wang

We introduce Multi-SimLex, a large-scale lexical resource and evaluation benchmark covering datasets for 12 typologically diverse languages, including major languages (e.g., Mandarin Chinese, Spanish, Russian) as well as less-resourced ones…

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

人工智能 · 计算机科学 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

Word embeddings such as ELMo have recently been shown to model word semantics with greater efficacy through contextualized learning on large-scale language corpora, resulting in significant improvement in state of the art across many…

计算与语言 · 计算机科学 2019-09-11 Shao-Yen Tseng , Panayiotis Georgiou , Shrikanth Narayanan

The rapid development of multimodal large language models (MLLMs) raises the question of how they compare to human performance. While existing datasets often feature synthetic or overly simplistic tasks, some models have already surpassed…

Spatial cognition is fundamental to real-world multimodal intelligence, allowing models to effectively interact with the physical environment. While multimodal large language models (MLLMs) have made significant strides, existing benchmarks…

人工智能 · 计算机科学 2026-05-08 Peiran Xu , Sudong Wang , Yao Zhu , Jianing Li , Gege Qi , Yunjian Zhang

Modeling discourse -- the linguistic phenomena that go beyond individual sentences, is a fundamental yet challenging aspect of natural language processing (NLP). However, existing evaluation benchmarks primarily focus on the evaluation of…

计算与语言 · 计算机科学 2023-07-25 Longyue Wang , Zefeng Du , Donghuai Liu , Deng Cai , Dian Yu , Haiyun Jiang , Yan Wang , Leyang Cui , Shuming Shi , Zhaopeng Tu

EEG-based neural decoding requires large-scale benchmark datasets. Paired brain-language data across speaking, listening, and reading modalities are essential for aligning neural activity with the semantic representation of large language…

信号处理 · 电气工程与系统科学 2025-08-07 Sitong Chen , Beiqianyi Li , Cuilin He , Dongyang Li , Mingyang Wu , Xinke Shen , Song Wang , Xuetao Wei , Xindi Wang , Haiyan Wu , Quanying Liu

Recent advancements in multimodal large language models (MLLMs) have demonstrated remarkable capabilities in processing diverse data types, yet significant disparities persist between human cognitive processes and computational approaches…

计算与语言 · 计算机科学 2025-05-09 Dongxing Yu

Metaphors are pervasive in communication, making them crucial for natural language processing (NLP). Previous research on automatic metaphor processing predominantly relies on training data consisting of English samples, which often reflect…

计算与语言 · 计算机科学 2025-06-10 Senqi Yang , Dongyu Zhang , Jing Ren , Ziqi Xu , Xiuzhen Zhang , Yiliao Song , Hongfei Lin , Feng Xia

Establishing stable mappings between natural language expressions and visual percepts is a foundational problem for both cognitive science and artificial intelligence. Humans routinely ground linguistic reference in noisy, ambiguous…

人工智能 · 计算机科学 2026-02-24 Joseph Bingham

As recent multi-modality large language models (MLLMs) have shown formidable proficiency on various complex tasks, there has been increasing attention on debating whether these models could eventually mirror human intelligence. However,…

人工智能 · 计算机科学 2024-06-17 Wei Song , Yadong Li , Jianhua Xu , Guowei Wu , Lingfeng Ming , Kexin Yi , Weihua Luo , Houyi Li , Yi Du , Fangda Guo , Kaicheng Yu

Despite their remarkable ability to capture linguistic nuances across diverse languages, questions persist regarding the degree of alignment between languages in multilingual embeddings. Drawing inspiration from research on high-dimensional…

计算与语言 · 计算机科学 2024-05-24 Basel Mousi , Nadir Durrani , Fahim Dalvi , Majd Hawasly , Ahmed Abdelali

This study investigates whether large language models (LLMs) exhibit cross-linguistic differences in mental health evaluations. Focusing on Chinese and English, we examine two widely used models, GPT-4o and Qwen3, to assess whether prompt…

计算与语言 · 计算机科学 2026-03-10 Jiayi Xu , Xiyang Hu

This study investigates whether large language models (LLMs) mirror human neurocognition during abstract reasoning. We compared the performance and neural representations of human participants with those of eight open-source LLMs on an…

We propose EEG2TEXT-CN, which, to the best of our knowledge, represents one of the earliest open-vocabulary EEG-to-text generation frameworks tailored for Chinese. Built on a biologically grounded EEG encoder (NICE-EEG) and a compact…

计算与语言 · 计算机科学 2025-07-09 Jacky Tai-Yu Lu , Jung Chiang , Chi-Sheng Chen , Anna Nai-Yun Tung , Hsiang Wei Hu , Yuan Chiao Cheng