English
Related papers

Related papers: Tidal MerzA: Combining affective modelling and aut…

200 papers

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

Live performances of music are always charming, with the unpredictability of improvisation due to the dynamic between musicians and interactions with the audience. Jazz improvisation is a particularly noteworthy example for further…

Physics and Society · Physics 2024-03-07 Vedant Tapiavala , Joshua Piesner , Sourjyamoy Barman , Feng Fu

While Large Language Models (LLMs) make symbolic music generation increasingly accessible, producing music with distinctive composition and rich expressiveness remains a significant challenge. Many studies have introduced emotion models to…

Sound · Computer Science 2025-11-19 Dengyun Huang , Yonghua Zhu

Multimodal emotion recognition (MER) aims to infer human affect by jointly modeling audio and visual cues; however, existing approaches often struggle with temporal misalignment, weakly discriminative feature representations, and suboptimal…

Multimedia · Computer Science 2026-01-21 Joe Dhanith P R , Shravan Venkatraman , Vigya Sharma , Santhosh Malarvannan

We present GLM-5, a next-generation foundation model designed to transition the paradigm of vibe coding to agentic engineering. Building upon the agentic, reasoning, and coding (ARC) capabilities of its predecessor, GLM-5 adopts DSA to…

Machine Learning · Computer Science 2026-02-25 GLM-5-Team , : , Aohan Zeng , Xin Lv , Zhenyu Hou , Zhengxiao Du , Qinkai Zheng , Bin Chen , Da Yin , Chendi Ge , Chenghua Huang , Chengxing Xie , Chenzheng Zhu , Congfeng Yin , Cunxiang Wang , Gengzheng Pan , Hao Zeng , Haoke Zhang , Haoran Wang , Huilong Chen , Jiajie Zhang , Jian Jiao , Jiaqi Guo , Jingsen Wang , Jingzhao Du , Jinzhu Wu , Kedong Wang , Lei Li , Lin Fan , Lucen Zhong , Mingdao Liu , Mingming Zhao , Pengfan Du , Qian Dong , Rui Lu , Shuang-Li , Shulin Cao , Song Liu , Ting Jiang , Xiaodong Chen , Xiaohan Zhang , Xuancheng Huang , Xuezhen Dong , Yabo Xu , Yao Wei , Yifan An , Yilin Niu , Yitong Zhu , Yuanhao Wen , Yukuo Cen , Yushi Bai , Zhongpei Qiao , Zihan Wang , Zikang Wang , Zilin Zhu , Ziqiang Liu , Zixuan Li , Bojie Wang , Bosi Wen , Can Huang , Changpeng Cai , Chao Yu , Chen Li , Chengwei Hu , Chenhui Zhang , Dan Zhang , Daoyan Lin , Dayong Yang , Di Wang , Ding Ai , Erle Zhu , Fangzhou Yi , Feiyu Chen , Guohong Wen , Hailong Sun , Haisha Zhao , Haiyi Hu , Hanchen Zhang , Hanrui Liu , Hanyu Zhang , Hao Peng , Hao Tai , Haobo Zhang , He Liu , Hongwei Wang , Hongxi Yan , Hongyu Ge , Huan Liu , Huanpeng Chu , Jia'ni Zhao , Jiachen Wang , Jiajing Zhao , Jiamin Ren , Jiapeng Wang , Jiaxin Zhang , Jiayi Gui , Jiayue Zhao , Jijie Li , Jing An , Jing Li , Jingwei Yuan , Jinhua Du , Jinxin Liu , Junkai Zhi , Junwen Duan , Kaiyue Zhou , Kangjian Wei , Ke Wang , Keyun Luo , Laiqiang Zhang , Leigang Sha , Liang Xu , Lindong Wu , Lintao Ding , Lu Chen , Minghao Li , Nianyi Lin , Pan Ta , Qiang Zou , Rongjun Song , Ruiqi Yang , Shangqing Tu , Shangtong Yang , Shaoxiang Wu , Shengyan Zhang , Shijie Li , Shuang Li , Shuyi Fan , Wei Qin , Wei Tian , Weining Zhang , Wenbo Yu , Wenjie Liang , Xiang Kuang , Xiangmeng Cheng , Xiangyang Li , Xiaoquan Yan , Xiaowei Hu , Xiaoying Ling , Xing Fan , Xingye Xia , Xinyuan Zhang , Xinze Zhang , Xirui Pan , Xu Zou , Xunkai Zhang , Yadi Liu , Yandong Wu , Yanfu Li , Yidong Wang , Yifan Zhu , Yijun Tan , Yilin Zhou , Yiming Pan , Ying Zhang , Yinpei Su , Yipeng Geng , Yong Yan , Yonglin Tan , Yuean Bi , Yuhan Shen , Yuhao Yang , Yujiang Li , Yunan Liu , Yunqing Wang , Yuntao Li , Yurong Wu , Yutao Zhang , Yuxi Duan , Yuxuan Zhang , Zezhen Liu , Zhengtao Jiang , Zhenhe Yan , Zheyu Zhang , Zhixiang Wei , Zhuo Chen , Zhuoer Feng , Zijun Yao , Ziwei Chai , Ziyuan Wang , Zuzhou Zhang , Bin Xu , Minlie Huang , Hongning Wang , Juanzi Li , Yuxiao Dong , Jie Tang

Multimodal Emotion Recognition (MER) aims to accurately identify human emotional states by integrating heterogeneous modalities such as visual, auditory, and textual data. Existing approaches predominantly rely on unified emotion labels to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Wen Yin , Siyu Zhan , Cencen Liu , Xin Hu , Guiduo Duan , Xiurui Xie , Yuan-Fang Li , Tao He

As large language model (LLM)-based multi-agent systems scale to handle increasingly complex tasks, balancing structural stability and dynamic adaptability becomes increasingly challenging. Existing systems typically adopt either…

Multiagent Systems · Computer Science 2026-05-26 Haoran Li , Shulun Chen , Shaoyuan Sun , Hanchen Wang

Machine-learning paradigms such as imitation learning and reinforcement learning can generate highly performant agents in a variety of complex environments. However, commonly used methods require large quantities of data and/or a known…

Machine Learning · Computer Science 2024-03-05 Noah Ford , Ryan W. Gardner , Austin Juhl , Nathan Larson

Recent advances in generative artificial intelligence (AI) have created models capable of high-quality musical content generation. However, little consideration is given to how to use these models for real-time or cooperative jamming…

Human-Computer Interaction · Computer Science 2025-03-03 Alexander Scarlatos , Yusong Wu , Ian Simon , Adam Roberts , Tim Cooijmans , Natasha Jaques , Cassie Tarakajian , Cheng-Zhi Anna Huang

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning credit to individual…

Machine Learning · Computer Science 2024-01-01 Ziyan Wang , Yali Du , Yudi Zhang , Meng Fang , Biwei Huang

Large language models (LLMs) enhanced with retrieval augmentation has shown great performance in many applications. However, the computational demands for these models pose a challenge when applying them to real-time tasks, such as…

Computation and Language · Computer Science 2024-10-15 Menglin Xia , Xuchao Zhang , Camille Couturier , Guoqing Zheng , Saravan Rajmohan , Victor Ruhle

Training agents that can coordinate zero-shot with humans is a key mission in multi-agent reinforcement learning (MARL). Current algorithms focus on training simulated human partner policies which are then used to train a Cooperator agent.…

Machine Learning · Computer Science 2024-11-22 Yancheng Liang , Daphne Chen , Abhishek Gupta , Simon S. Du , Natasha Jaques

In this paper, we present SOCIA-$\nabla$, an end-to-end, agentic framework that treats simulator construction asinstance optimization over code within a textual computation graph. Specialized LLM-driven agents are embedded as graph nodes,…

Artificial Intelligence · Computer Science 2025-11-12 Yuncheng Hua , Sion Weatherhead , Mehdi Jafari , Hao Xue , Flora D. Salim

Inferring reward functions from demonstrations and pairwise preferences are auspicious approaches for aligning Reinforcement Learning (RL) agents with human intentions. However, state-of-the art methods typically focus on learning a single…

Machine Learning · Computer Science 2022-01-04 Markus Peschl , Arkady Zgonnikov , Frans A. Oliehoek , Luciano C. Siebert

Artificial Intelligence and generative models have revolutionized music creation, with many models leveraging textual or visual prompts for guidance. However, existing image-to-music models are limited to simple images, lacking the…

Multimedia · Computer Science 2025-07-31 Ivan Rinaldi , Nicola Fanelli , Giovanna Castellano , Gennaro Vessio

3D human motion generation has seen substantial advancement in recent years. While state-of-the-art approaches have improved performance significantly, they still struggle with complex and detailed motions unseen in training data, largely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Shanlin Sun , Gabriel De Araujo , Jiaqi Xu , Shenghan Zhou , Hanwen Zhang , Ziheng Huang , Chenyu You , Xiaohui Xie

Generating music is an interesting and challenging problem in the field of machine learning. Mimicking human creativity has been popular in recent years, especially in the field of computer vision and image processing. With the advent of…

Sound · Computer Science 2020-11-03 Ashish Ranjan , Varun Nagesh Jolly Behera , Motahar Reza

This paper introduces a novel framework integrating nonlinear acoustic computing and reinforcement learning to enhance advanced human-robot interaction under complex noise and reverberation. Leveraging physically informed wave equations…

Robotics · Computer Science 2025-05-07 Xiaoliang Chen , Xin Yu , Le Chang , Yunhe Huang , Jiashuai He , Shibo Zhang , Jin Li , Likai Lin , Ziyu Zeng , Xianling Tu , Shuyu Zhang

Multimodal Sentiment Analysis (MSA) aims to mine sentiment information from text, visual, and acoustic modalities. Previous works have focused on representation learning and feature fusion strategies. However, most of these efforts ignored…

Multimedia · Computer Science 2023-07-26 Yuxuan Lei , Dingkang Yang , Mingcheng Li , Shunli Wang , Jiawei Chen , Lihua Zhang

Emotions are fundamental to the creation and perception of music performances. However, achieving human-like expression and emotion through machine learning models for performance rendering remains a challenging task. In this work, we…

Sound · Computer Science 2025-11-06 Ilya Borovik , Dmitrii Gavrilev , Vladimir Viro