English
Related papers

Related papers: dMLLM-TTS: Self-Verified and Efficient Test-Time S…

200 papers

Diffusion-based large language models (dLLMs) have recently gained significant attention for their exceptional performance and inherent potential for parallel decoding. Existing frameworks further enhance its inference efficiency by…

Computation and Language · Computer Science 2025-12-01 Linye Wei , Wenjue Chen , Pingzhi Tang , Xiaotian Guo , Le Ye , Runsheng Wang , Meng Li

While large language models (LLMs) have revolutionized text-to-speech (TTS) synthesis through discrete tokenization paradigms, current architectures exhibit fundamental tensions between three critical dimensions: 1) irreversible loss of…

Computation and Language · Computer Science 2025-05-29 Yaodong Song , Hongjie Chen , Jie Lian , Yuxin Zhang , Guangmin Xia , Zehan Li , Genliang Zhao , Jian Kang , Jie Li , Yongxiang Li , Xuelong Li

Recent byte-level language models (LMs) match the performance of token-level models without relying on subword vocabularies, yet their utility is limited by slow, byte-by-byte autoregressive generation. We address this bottleneck in the…

Owing to the unprecedented capability in semantic understanding and logical reasoning, the pre-trained large language models (LLMs) have shown fantastic potential in developing the next-generation recommender systems (RSs). However, the…

Multimodal Large Language Models (MLLMs) in real-world applications require access to external knowledge sources and must remain responsive to the dynamic and ever-changing real-world information in order to address information-seeking and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Kartik Narayan , Yang Xu , Tian Cao , Kavya Nerella , Vishal M. Patel , Navid Shiee , Peter Grasch , Chao Jia , Yinfei Yang , Zhe Gan

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

This work proposes GLM-TTS, a production-level TTS system designed for efficiency, controllability, and high-fidelity speech generation. GLM-TTS follows a two-stage architecture, consisting of a text-to-token autoregressive model and a…

Large-language-model (LLM)-based text-to-speech (TTS) systems can generate natural speech, but most are not designed for low-latency dual-streaming synthesis. High-quality dual-streaming TTS depends on accurate text--speech alignment and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-24 Hanwen Liu , Saierdaer Yusuyin , Hao Huang , Zhijian Ou

Adapting a pretrained diffusion model to new objectives at inference time remains an open problem in generative modeling. Existing steering methods suffer from inaccurate value estimation, especially at high noise levels, which biases…

Machine Learning · Computer Science 2025-06-27 Vineet Jain , Kusha Sareen , Mohammad Pedramfar , Siamak Ravanbakhsh

Diffusion large language models (dLLMs) have emerged as a new architecture following auto regressive models. Their denoising process offers a powerful generative advantage, but they present significant challenges in learning and…

Machine Learning · Computer Science 2025-09-24 Ranfei Chen , Ming Chen

In recent times, Vision-Language Models (VLMs) have been trained under two predominant paradigms. Generative training has enabled Multimodal Large Language Models (MLLMs) to tackle various complex tasks, yet issues such as hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Wei Chow , Juncheng Li , Qifan Yu , Kaihang Pan , Hao Fei , Zhiqi Ge , Shuai Yang , Siliang Tang , Hanwang Zhang , Qianru Sun

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

Computation and Language · Computer Science 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

We propose ControlMLLM++, a novel test-time adaptation framework that injects learnable visual prompts into frozen multimodal large language models (MLLMs) to enable fine-grained region-based visual reasoning without any model retraining or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hao Chen , Jiayi Ji , Xiaoshuai Sun , Zhiyuan Liu , Liujuan Cao , Ming-Ming Cheng , Rongrong Ji

Large Language Models (LLMs) have achieved state-of-the-art performance on a broad range of Natural Language Processing (NLP) tasks, including document processing and code generation. Autoregressive Language Models (ARMs), which generate…

Scaling text-to-speech (TTS) with autoregressive language model (LM) to large-scale datasets by quantizing waveform into discrete speech tokens is making great progress to capture the diversity and expressiveness in human speech, but the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Chong Zhang , Yanqing Liu , Yang Zheng , Sheng Zhao

Text-guided molecule generation is a task where molecules are generated to match specific textual descriptions. Recently, most existing SMILES-based molecule generation methods rely on an autoregressive architecture. In this work, we…

Machine Learning · Computer Science 2024-02-21 Haisong Gong , Qiang Liu , Shu Wu , Liang Wang

Test-time scaling (TTS) has proven effective in enhancing the reasoning capabilities of large language models (LLMs). Verification plays a key role in TTS, simultaneously influencing (1) reasoning performance and (2) compute efficiency, due…

Artificial Intelligence · Computer Science 2025-10-31 Hao Mark Chen , Guanxi Lu , Yasuyuki Okoshi , Zhiwen Mo , Masato Motomura , Hongxiang Fan

Large Multimodal Models (LMMs) have demonstrated impressive capabilities in multimodal understanding and generation, pushing forward advancements in text-to-image generation. However, achieving accurate text-image alignment for LMMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Leigang Qu , Haochuan Li , Wenjie Wang , Xiang Liu , Juncheng Li , Liqiang Nie , Tat-Seng Chua

Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively…

Machine Learning · Computer Science 2026-04-10 Sikai Bai , Haoxi Li , Jie Zhang , Yongjiang Liu , Song Guo

Large reasoning models (LRMs) have exhibited strong performance on complex reasoning tasks, with further gains achievable through increased computational budgets at inference. However, current test-time scaling methods predominantly rely on…

Artificial Intelligence · Computer Science 2025-09-09 Jie Chen , Jinhao Jiang , Yingqian Min , Zican Dong , Shijie Wang , Wayne Xin Zhao , Ji-Rong Wen