English
Related papers

Related papers: Text-Routed Sparse Mixture-of-Experts Model with E…

200 papers

The fast-growing amount of information on the Internet makes the research in automatic document summarization very urgent. It is an effective solution for information overload. Many approaches have been proposed based on different…

Computation and Language · Computer Science 2018-08-01 Kamal Al-Sabahi , Zuping Zhang , Jun Long , Khaled Alwesabi

Recent advances in multi-modal large language models (MLLMs) have opened new possibilities for unified modeling of speech, text, images, and other modalities. Building on our prior work, this paper examines the conditions and model…

Sound · Computer Science 2025-07-28 Yiwen Guan , Viet Anh Trinh , Vivek Voleti , Jacob Whitehill

Multimodal Sentiment Analysis integrates Linguistic, Visual, and Acoustic. Mainstream approaches based on modality-invariant and modality-specific factorization or on complex fusion still rely on spatiotemporal mixed modeling. This ignores…

Computation and Language · Computer Science 2026-01-21 Chunlei Meng , Ziyang Zhou , Lucas He , Xiaojing Du , Chun Ouyang , Zhongxue Gan

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating methodological…

Computation and Language · Computer Science 2025-10-14 Wenqing Zhang , Trang Nguyen , Elizabeth A. Stuart , Yiqun T. Chen

Recent advancement of large language models (LLMs) has led to significant breakthroughs across various tasks, laying the foundation for the development of LLM-based speech translation systems. Existing methods primarily focus on aligning…

Computation and Language · Computer Science 2025-03-14 Henglyu Liu , Andong Chen , Kehai Chen , Xuefeng Bai , Meizhi Zhong , Yuan Qiu , Min Zhang

Recently, there has been growing interest in incorporating textual information into foundation models for time series forecasting. However, it remains unclear whether and under what conditions such multimodal integration consistently yields…

Multimodal sentiment analysis (MSA) aims to predict human sentiment from textual, acoustic, and visual information in videos. Recent studies improve multimodal fusion by modeling modality interaction and assigning different modality…

Multimedia · Computer Science 2026-04-08 Chen Su , Yuanhe Tian , Yan Song

Large language models are being rapidly deployed across many fields such as healthcare, finance, transportation, and energy, where time-series data are fundamental components. The current works are still limited in their ability to perform…

Artificial Intelligence · Computer Science 2026-01-23 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Aspect-based sentiment analysis (ABSA) aims at analyzing the sentiment of a given aspect in a sentence. Recently, neural network-based methods have achieved promising results in existing ABSA datasets. However, these datasets tend to…

Computation and Language · Computer Science 2020-11-03 Zhen Wu , Chengcan Ying , Xinyu Dai , Shujian Huang , Jiajun Chen

In this paper, a semantic communication framework is proposed for textual data transmission. In the studied model, a base station (BS) extracts the semantic information from textual data, and transmits it to each user. The semantic…

Information Theory · Computer Science 2022-08-18 Yining Wang , Mingzhe Chen , Tao Luo , Walid Saad , Dusit Niyato , H. Vincent Poor , Shuguang Cui

Although Speech Large Language Models have achieved notable progress, a substantial modality reasoning gap remains: their reasoning performance on speech inputs is markedly weaker than on text. This gap could be associated with…

Computation and Language · Computer Science 2026-04-21 Chaoren Wang , Heng Lu , Xueyao Zhang , Shujie Liu , Yan Lu , Jinyu Li , Zhizheng Wu

Cross-lingual aspect-based sentiment analysis (ABSA) involves detailed sentiment analysis in a target language by transferring knowledge from a source language with available annotated data. Most existing methods depend heavily on often…

Computation and Language · Computer Science 2025-08-14 Jakub Šmíd , Pavel Přibáň , Pavel Král

Longitudinal passive sensing enables continuous health prediction, yet models often fail under cross-dataset distribution shifts. Traditional ML overfits cohort-specific artifacts, while Large Language Models (LLMs) struggle to reason…

Machine Learning · Computer Science 2026-05-21 Yuang Fan , Lilin Xu , Millie Wu , Jingping Nie , Qingyu Chen , Yuzhe Yang , Zhuo Zhang , Xin Liu , Subigya Nepal , Xiaofan Jiang , Xuhai "Orson" Xu

Flow-Matching (FM)-based zero-shot text-to-speech (TTS) systems exhibit high-quality speech synthesis and robust generalization capabilities. However, the speaker representation ability of such systems remains underexplored, primarily due…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Haoyu Li , Mingyang Han , Yu Xi , Dongxiao Wang , Hankun Wang , Haoxiang Shi , Boyu Li , Jun Song , Bo Zheng , Shuai Wang , Kai Yu

The advancements in Multimodal Large Language Models (MLLMs) have enabled various multimodal tasks to be addressed under a zero-shot paradigm. This paradigm sidesteps the cost of model fine-tuning, emerging as a dominant trend in practical…

Computation and Language · Computer Science 2025-05-23 Daiqing Wu , Dongbao Yang , Sicheng Zhao , Can Ma , Yu Zhou

Recent work on speech representation models jointly pre-trained with text has demonstrated the potential of improving speech representations by encoding speech and text in a shared space. In this paper, we leverage such shared…

Computation and Language · Computer Science 2023-10-10 Chung-Ming Chien , Mingjiamei Zhang , Ju-Chieh Chou , Karen Livescu

Recent studies highlight the potential of textual modalities in conditioning the speech separation model's inference process. However, regularization-based methods remain underexplored despite their advantages of not requiring auxiliary…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-06 Tsun-An Hsieh , Heeyoul Choi , Minje Kim

Ensuring that Text-to-Speech (TTS) systems deliver human-perceived quality at scale is a central challenge for modern speech technologies. Human subjective evaluation protocols such as Mean Opinion Score (MOS) and Side-by-Side (SBS)…

Computation and Language · Computer Science 2026-04-13 Ilya Trofimenko , David Kocharyan , Aleksandr Zaitsev , Pavel Repnikov , Mark Levin , Nikita Shevtsov

Recent adaptations of Large Language Models (LLMs) for time series forecasting often fail to effectively enhance information for raw series, leaving LLM reasoning capabilities underutilized. Existing prompting strategies rely on static…

Artificial Intelligence · Computer Science 2025-12-05 Junjie Fan , Hongye Zhao , Linduo Wei , Jiayu Rao , Guijia Li , Jiaxin Yuan , Wenqi Xu , Yong Qi

Multi-task forecasting has become the standard approach for time-series forecasting (TSF). However, we show that it suffers from an Expressiveness Bottleneck, where predictions at different time steps share the same representation, leading…

Machine Learning · Computer Science 2025-05-28 Licheng Pan , Zhichao Chen , Haoxuan Li , Guangyi Liu , Zhijian Xu , Zhaoran Liu , Hao Wang , Ying Wei