中文
相关论文

相关论文: WavCraft: Audio Editing and Generation with Large …

200 篇论文

In the trending research of fusing Large Language Models (LLMs) and robotics, we aim to pave the way for innovative development of AI systems that can enable Autonomous Underwater Vehicles (AUVs) to seamlessly interact with humans in an…

机器人学 · 计算机科学 2023-09-29 Ruochu Yang , Mengxue Hou , Junkai Wang , Fumin Zhang

Large language models (LLMs) enable the rapid generation of data wrangling scripts based on natural language instructions, but these scripts may not fully adhere to user-specified requirements, necessitating careful inspection and iterative…

人机交互 · 计算机科学 2025-08-05 Jiajun Zhu , Xinyu Cheng , Zhongsu Luo , Yunfan Zhou , Xinhuan Shu , Di Weng , Yingcai Wu

Conventional Voice Assistants (VAs) rely on traditional language models to discern user intent and respond to their queries, leading to interactions that often lack a broader contextual understanding, an area in which Large Language Models…

人机交互 · 计算机科学 2024-12-02 Amama Mahmood , Junxiang Wang , Bingsheng Yao , Dakuo Wang , Chien-Ming Huang

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the development of agents that support human-machine dialogue interaction…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Zhenfei Yin , Jiong Wang , Jianjian Cao , Zhelun Shi , Dingning Liu , Mukai Li , Lu Sheng , Lei Bai , Xiaoshui Huang , Zhiyong Wang , Jing Shao , Wanli Ouyang

Recently, researchers have gradually realized that in some cases, the self-supervised pre-training on large-scale Internet data is better than that of high-quality/manually labeled data sets, and multimodal/large models are better than…

声音 · 计算机科学 2023-08-08 Sen Fang , Yangjian Wu , Bowen Gao , Jingwen Cai , Teik Toe Teoh

LLM-powered code generation has the potential to revolutionize creative coding endeavors, such as live-coding, by enabling users to focus on structural motifs over syntactic details. In such domains, when prompting an LLM, users may benefit…

多媒体 · 计算机科学 2025-09-25 Sam Kouteili , Hiren Madhu , George Typaldos , Mark Santolucito

Integrating speech understanding and generation is a pivotal step toward building unified speech models. However, the different representations required for these two tasks currently pose significant compatibility challenges. Typically,…

音频与语音处理 · 电气工程与系统科学 2026-05-08 Guanrou Yang , Tian Tan , Qian Chen , Zhikang Niu , Yakun Song , Ziyang Ma , Yushen Chen , Zeyu Xie , Tianrui Wang , Yifan Yang , Wenxi Chen , Qi Chen , Wenrui Liu , Shan Yang , Xie Chen

Recent AIGC systems possess the capability to generate digital multimedia content based on human language instructions, such as text, image and video. However, when it comes to speech, existing methods related to human instruction-to-speech…

声音 · 计算机科学 2024-08-29 Yixuan Zhou , Xiaoyu Qin , Zeyu Jin , Shuoyi Zhou , Shun Lei , Songtao Zhou , Zhiyong Wu , Jia Jia

The use of natural language interfaces (NLIs) to create charts is becoming increasingly popular due to the intuitiveness of natural language interactions. One key challenge in this approach is to accurately capture user intents and…

人机交互 · 计算机科学 2025-01-22 Yuan Tian , Weiwei Cui , Dazhen Deng , Xinjing Yi , Yurun Yang , Haidong Zhang , Yingcai Wu

The rapid advancement of large language models (LLMs) and multimodal learning has transformed digital content creation and manipulation. Traditional visual editing tools require significant expertise, limiting accessibility. Recent strides…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Thanh Tam Nguyen , Zhao Ren , Trinh Pham , Thanh Trung Huynh , Phi Le Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen

Large Language Models (LLMs) have demonstrated their remarkable capabilities in numerous fields. This survey focuses on how LLMs empower users, regardless of their technical background, to use human languages to automatically generate…

软件工程 · 计算机科学 2025-04-03 Nam Huynh , Beiyu Lin

Text-guided audio editing aims to modify specific acoustic events while strictly preserving non-target content. Despite recent progress, existing approaches remain fundamentally limited. Training-free methods often suffer from signal…

声音 · 计算机科学 2026-01-21 Ye Tao , Wen Wu , Chao Zhang , Mengyue Wu , Shuai Wang , Xuenan Xu

High-quality speech dialogue datasets are crucial for Speech-LLM development, yet existing acquisition methods face significant limitations. Human recordings incur high costs and privacy concerns, while synthetic approaches often lack…

计算与语言 · 计算机科学 2025-04-01 Minghan Wang , Ye Bai , Yuxia Wang , Thuy-Trang Vu , Ehsan Shareghi , Gholamreza Haffari

Large language models (LLMs) have gained considerable attention for Artificial Intelligence Generated Content (AIGC), particularly with the emergence of ChatGPT. However, the direct adaptation of continuous speech to LLMs that process…

音频与语音处理 · 电气工程与系统科学 2023-08-28 Haibin Wu , Kai-Wei Chang , Yuan-Kuei Wu , Hung-yi Lee

Recent advancements in large language models (LLMs) have revolutionized various domains, bringing significant progress and new opportunities. Despite progress in speech-related tasks, LLMs have not been sufficiently explored in multi-talker…

计算与语言 · 计算机科学 2025-04-03 Lingwei Meng , Shujie Hu , Jiawen Kang , Zhaoqing Li , Yuejiao Wang , Wenxuan Wu , Xixin Wu , Xunying Liu , Helen Meng

Large language models (LLMs) can reproduce a wide variety of rhetorical styles and generate text that expresses a broad spectrum of sentiments. This capacity, now available at low cost, makes them powerful tools for manipulation and…

社会与信息网络 · 计算机科学 2024-05-08 Yaqub Chaudhary , Jonnie Penn

The evolution of Large Language Models (LLMs) has showcased remarkable capacities for logical reasoning and natural language comprehension. These capabilities can be leveraged in solutions that semantically and textually model complex…

人机交互 · 计算机科学 2024-04-17 Syed Mekael Wasti , Ken Q. Pu , Ali Neshati

Large Vision-Language Models (LVLMs) have shown impressive capabilities across a range of tasks that integrate visual and textual understanding, such as image captioning and visual question answering. These models are trained on large-scale…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Xiaomei Zhang , Hanyu Zheng , Xiangyu Zhu , Jinghuan Wei , Junhong Zou , Zhen Lei , Zhaoxiang Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities in important tasks such as natural language understanding and language generation, and thus have the potential to make a substantial impact on our society. Such…

计算与语言 · 计算机科学 2024-05-24 Zhongwei Wan , Xin Wang , Che Liu , Samiul Alam , Yu Zheng , Jiachen Liu , Zhongnan Qu , Shen Yan , Yi Zhu , Quanlu Zhang , Mosharaf Chowdhury , Mi Zhang

In this study, we investigate the use of Large Language Models (LLMs) for the interactive and automated production of customs circuit layouts described in natural language. Our proposed layout automation process leverages a…

硬件体系结构 · 计算机科学 2024-08-15 Geunyoung You , Youjin Byun , Sojin Lim , Jaeduk Han