English
Related papers

Related papers: STASE: A spatialized text-to-audio synthesis engin…

200 papers

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Existing Multimodal Large Language Models (MLLMs) struggle with 3D spatial reasoning, as they fail to construct structured abstractions of the 3D environment depicted in video inputs. To bridge this gap, drawing inspiration from cognitive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiacheng Hua , Yishu Yin , Yuhang Wu , Tai Wang , Yifei Huang , Miao Liu

Recent advances in large language models (LLMs) have enabled deep research systems that synthesize comprehensive, report-style answers to open-ended queries by combining retrieval, reasoning, and generation. Yet most frameworks rely on…

Computation and Language · Computer Science 2026-05-26 Lin Ai , Victor S. Bursztyn , Xiang Chen , Julia Hirschberg , Saayan Mitra

Neural audio synthesis methods now allow specifying ideas in natural language. However, these methods produce results that cannot be easily tweaked, as they are based on large latent spaces and up to billions of uninterpretable parameters.…

Sound · Computer Science 2024-06-04 Manuel Cherep , Nikhil Singh , Jessica Shand

Antenna simulation typically involves modeling and optimization, which are time-consuming and labor-intensive, slowing down antenna analysis and design. This paper presents a prototype of a large language model (LLM)-based antenna design…

Artificial Intelligence · Computer Science 2025-12-18 Tao Wu , Kexue Fu , Qiang Hua , Xinxin Liu , Bo Liu

Large language models (LLMs) have advanced in text and vision, but their reasoning on audio remains limited. Most existing methods rely on dense audio embeddings, which are difficult to interpret and often fail on structured reasoning…

Sound · Computer Science 2025-11-11 Termeh Taheri , Yinghao Ma , Emmanouil Benetos

Scene Text Editing (STE) involves replacing text in a scene image with new target text while preserving both the original text style and background texture. Existing methods suffer from two major challenges: inconsistency and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Fuxiang Yang , Tonghua Su , Donglin Di , Yin Chen , Xiangqian Wu , Zhongjie Wang , Lei Fan

Most existing text-to-audio (TTA) generation methods produce mono outputs, neglecting essential spatial information for immersive auditory experiences. To address this issue, we propose a cascaded method for text-to-multisource binaural…

Sound · Computer Science 2025-11-06 Yuxuan He , Xiaoran Yang , Ningning Pan , Gongping Huang

Next-generation AI companions must go beyond general video understanding to resolve spatial and temporal references in dynamic, real-world environments. Existing Video Large Language Models (Video LLMs), while capable of coarse-level…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Honglu Zhou , Xiangyu Peng , Shrikant Kendre , Michael S. Ryoo , Silvio Savarese , Caiming Xiong , Juan Carlos Niebles

Large Language Models (LLMs) are increasingly used as autonomous agents for multi-step tasks. However, most existing frameworks fail to maintain a structured understanding of the task state, often relying on linear prompt concatenation or…

Artificial Intelligence · Computer Science 2025-08-26 Ye Ye

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding and task generalization. However, their application to structured data analysis remains fragile due to inconsistencies in schema…

Artificial Intelligence · Computer Science 2025-05-06 Amit Rath

Large Language Models (LLMs) have revolutionized natural language processing with their remarkable capabilities in text generation and reasoning. However, these models face critical challenges when deployed in real-world applications,…

Computation and Language · Computer Science 2025-09-16 Pengcheng Jiang , Siru Ouyang , Yizhu Jiao , Ming Zhong , Runchu Tian , Jiawei Han

Recent advancements in audio-aware large language models (ALLMs) enable them to process and understand audio inputs. However, these models often hallucinate non-existent sound events, reducing their reliability in real-world applications.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-02 Chun-Yi Kuan , Hung-yi Lee

Sound source localization task aims to identify the locations of sound-emitting objects by leveraging correlations between audio and visual modalities. Most existing SSL methods rely on contrastive learning-based feature matching, but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Subin Park , Jung Uk Kim

Traffic forecasting represents a crucial problem within intelligent transportation systems. In recent research, Large Language Models (LLMs) have emerged as a promising method, but their intrinsic design, tailored primarily for sequential…

Machine Learning · Computer Science 2025-09-18 Hyotaek Jeon , Hyunwook Lee , Juwon Kim , Sungahn Ko

Genuine spatial reasoning relies on the capacity to construct and manipulate coherent internal spatial representations, often conceptualized as mental models, rather than merely processing surface linguistic associations. While large…

Artificial Intelligence · Computer Science 2026-03-04 Peiyao Jiang , Zequn Qin , Xi Li

Large language models (LLMs) excel at handling human queries, but they can occasionally generate flawed or unexpected responses. Understanding their internal states is crucial for understanding their successes, diagnosing their failures,…

Computation and Language · Computer Science 2025-02-24 Xuansheng Wu , Jiayi Yuan , Wenlin Yao , Xiaoming Zhai , Ninghao Liu

Large language models (LLMs) have shown impressive abilities in leveraging pretrained knowledge through prompting, but they often struggle with unseen tasks, particularly in data-scarce scenarios. While cross-task in-context learning offers…

Computation and Language · Computer Science 2025-07-18 Xinyu Tang , Zhihao Lv , Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Large Language Models (LLMs) have recently garnered significant attention, primarily for their capabilities in text-based interactions. However, natural human interaction often relies on speech, necessitating a shift towards voice-based…

Computation and Language · Computer Science 2025-08-08 Wenqian Cui , Dianzhi Yu , Xiaoqi Jiao , Ziqiao Meng , Guangyan Zhang , Qichao Wang , Yiwen Guo , Irwin King

Text-to-motion generation has advanced rapidly, yet two challenges persist. First, existing motion autoencoders compress each frame into a single monolithic latent vector, entangling trajectory and per-joint rotations in an unstructured…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zeyu Ling , Qing Shuai , Teng Zhang , Shiyang Li , Bo Han , Changqing Zou