English
Related papers

Related papers: Fg-T2M++: LLMs-Augmented Fine-Grained Text Driven …

200 papers

The emergence of text-driven motion synthesis technique provides animators with great potential to create efficiently. However, in most cases, textual expressions only contain general and qualitative motion descriptions, while lack fine…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Dong Wei , Xiaoning Sun , Huaijiang Sun , Bin Li , Shengxiang Hu , Weiqing Li , Jianfeng Lu

This work focuses on the novel problem setting of generating graphs conditioned on a description of the graph's functional requirements in a downstream task. We pose the problem as a text-to-text generation problem and focus on the approach…

Machine Learning · Computer Science 2023-11-02 Peter A. Zachares , Vahan Hovhannisyan , Alan Mosca , Yarin Gal

Recent breakthroughs in large language models (LLMs) have not only advanced natural language processing but also inspired their application in domains with structurally similar problems--most notably, autonomous driving motion generation.…

Artificial Intelligence · Computer Science 2025-09-04 Mingyi Wang , Jingke Wang , Tengju Ye , Junbo Chen , Kaicheng Yu

While large language models (LLMs) have revolutionized text-to-speech (TTS) synthesis through discrete tokenization paradigms, current architectures exhibit fundamental tensions between three critical dimensions: 1) irreversible loss of…

Computation and Language · Computer Science 2025-05-29 Yaodong Song , Hongjie Chen , Jie Lian , Yuxin Zhang , Guangmin Xia , Zehan Li , Genliang Zhao , Jian Kang , Jie Li , Yongxiang Li , Xuelong Li

Long-tail recognition is challenging because it requires the model to learn good representations from tail categories and address imbalances across all categories. In this paper, we propose a novel generative and fine-tuning framework,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Qihao Zhao , Yalun Dai , Hao Li , Wei Hu , Fan Zhang , Jun Liu

Despite significant advances in video generation, synthesizing physically plausible human actions remains a persistent challenge, particularly in modeling fine-grained semantics and complex temporal dynamics. For instance, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Dian Shao , Mingfei Shi , Shengda Xu , Haodong Chen , Yongle Huang , Binglu Wang

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Automaton-based representations of task knowledge play an important role in control and planning for sequential decision-making problems. However, obtaining the high-level task knowledge required to build such automata is often difficult.…

Formal Languages and Automata Theory · Computer Science 2023-08-11 Yunhao Yang , Jean-Raphaël Gaglione , Cyrus Neary , Ufuk Topcu

The world knowledge and reasoning capabilities of text-based large language models (LLMs) are advancing rapidly, yet current approaches to human motion understanding, including motion question answering and captioning, have not fully…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yao Zhang , Zhuchenyang Liu , Thomas Ploetz , Yu Xiao

Text-driven human motion synthesis has showcased its potential for revolutionizing motion design in the movie and game industry. Existing methods often rely on 3D motion capture data, which requires special setups, resulting in high costs…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ruoxi Guo , Huaijin Pi , Zehong Shen , Qing Shuai , Zechen Hu , Zhumei Wang , Yajiao Dong , Ruizhen Hu , Taku Komura , Sida Peng , Xiaowei Zhou

The unprecedented advancements in Large Language Models (LLMs) have profoundly impacted natural language processing but have yet to fully embrace the realm of scalable vector graphics (SVG) generation. While LLMs encode partial knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ximing Xing , Juncheng Hu , Guotao Liang , Jing Zhang , Dong Xu , Qian Yu

Large language models (LLMs) show remarkable capabilities across a variety of tasks. Despite the models only seeing text in training, several recent studies suggest that LLM representations implicitly capture aspects of the underlying…

Computation and Language · Computer Science 2024-04-16 Yutaro Yamada , Yihan Bao , Andrew K. Lampinen , Jungo Kasai , Ilker Yildirim

Text-driven human motion generation is an emerging task in animation and humanoid robot design. Existing algorithms directly generate the full sequence which is computationally expensive and prone to errors as it does not pay special…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zichen Geng , Caren Han , Zeeshan Hayder , Jian Liu , Mubarak Shah , Ajmal Mian

The burgeoning progress in the field of Large Language Models (LLMs) heralds significant benefits due to their unparalleled capacities. However, it is critical to acknowledge the potential misuse of these models, which could give rise to a…

Computation and Language · Computer Science 2023-08-07 Haolan Zhan , Xuanli He , Qiongkai Xu , Yuxiang Wu , Pontus Stenetorp

This paper introduces an advanced methodology for machine translation (MT) corpus generation, integrating semi-automated, human-in-the-loop post-editing with large language models (LLMs) to enhance efficiency and translation quality.…

Computation and Language · Computer Science 2025-02-19 Kamer Ali Yuksel , Ahmet Gunduz , Abdul Baseet Anees , Hassan Sawaf

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Motion synthesis for diverse object categories holds great potential for 3D content creation but remains underexplored due to two key challenges: (1) the lack of comprehensive motion datasets that include a wide range of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Wonkwang Lee , Jongwon Jeong , Taehong Moon , Hyeon-Jong Kim , Jaehyeon Kim , Gunhee Kim , Byeong-Uk Lee

The recently emerging text-to-motion advances have spired numerous attempts for convenient and interactive human motion generation. Yet, existing methods are largely limited to generating body motions only without considering the rich…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenqian Zhang , Molin Huang , Yuxuan Zhou , Juze Zhang , Jingyi Yu , Jingya Wang , Lan Xu

Micro-gesture recognition (MGR) is challenging due to subtle inter-class variations. Existing methods rely on category-level supervision, which is insufficient for capturing subtle and localized motion differences. Thus, this paper proposes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jinsheng Wei , Zhaodi Xu , Guanming Lu , Haoyu Chen , Jingjie Yan