English
Related papers

Related papers: Efficient Pre-training for Localized Instruction G…

200 papers

In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal information for…

Machine Learning · Computer Science 2018-07-12 Veronica Morfi , Dan Stowell

Artificial Intelligence Generated Content (AIGC) is currently a popular research area. Among its various branches, song generation has attracted growing interest. Despite the abundance of available songs, effective data preparation remains…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-23 Wei Tan , Shun Lei , Huaicheng Zhang , Guangzheng Li , Yixuan Zhang , Hangting Chen , Jianwei Yu , Rongzhi Gu , Dong Yu

Generating text-editable and pose-controllable character videos have an imperious demand in creating various digital human. Nevertheless, this task has been restricted by the absence of a comprehensive dataset featuring paired video-pose…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Yue Ma , Yingqing He , Xiaodong Cun , Xintao Wang , Siran Chen , Ying Shan , Xiu Li , Qifeng Chen

Neural text-to-speech (TTS) models can synthesize natural human speech when trained on large amounts of transcribed speech. However, collecting such large-scale transcribed data is expensive. This paper proposes an unsupervised pre-training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-29 Seongyeon Park , Myungseo Song , Bohyung Kim , Tae-Hyun Oh

This paper addresses the challenge of achieving high-quality and fast image generation that aligns with complex human preferences. While recent advancements in diffusion models and distillation have enabled rapid generation, the effective…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yihong Luo , Tianyang Hu , Weijian Luo , Kenji Kawaguchi , Jing Tang

The rapid evolution of Large Language Models (LLMs) has enabled the industry to develop various AI-based services. Instruction tuning is considered essential in adapting foundation models for target domains to provide high-quality services…

Computation and Language · Computer Science 2025-02-10 Jungwoo Kim , Minsang Kim , Sungjin Lee

Deep learning has brought great progress for the sequential recommendation (SR) tasks. With advanced network architectures, sequential recommender models can be stacked with many hidden layers, e.g., up to 100 layers on real-world…

Information Retrieval · Computer Science 2021-05-13 Jiachun Wang , Fajie Yuan , Jian Chen , Qingyao Wu , Min Yang , Yang Sun , Guoxiao Zhang

Syntactically controlled paraphrase generation requires language models to generate paraphrases for sentences according to specific syntactic structures. Existing fine-tuning methods for this task are costly as all the parameters of the…

Computation and Language · Computer Science 2023-05-29 Yixin Wan , Kuan-Hao Huang , Kai-Wei Chang

In recent years, interest in synthetic data has grown, particularly in the context of pre-training the image modality to support a range of computer vision tasks, including object classification, medical imaging etc. Previous work has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Davyd Svyezhentsev , George Retsinas , Petros Maragos

Procedural activities are sequences of key-steps aimed at achieving specific goals. They are crucial to build intelligent agents able to assist users effectively. In this context, task graphs have emerged as a human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Luigi Seminara , Giovanni Maria Farinella , Antonino Furnari

Deep video recognition is more computationally expensive than image recognition, especially on large-scale datasets like Kinetics [1]. Therefore, training scalability is essential to handle a large amount of videos. In this paper, we study…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Ji Lin , Chuang Gan , Song Han

Understanding and reasoning about cooking recipes is a fruitful research direction towards enabling machines to interpret procedural text. In this work, we introduce RecipeQA, a dataset for multimodal comprehension of cooking recipes. It…

Computation and Language · Computer Science 2018-09-05 Semih Yagcioglu , Aykut Erdem , Erkut Erdem , Nazli Ikizler-Cinbis

Despite the number of currently available datasets on video question answering, there still remains a need for a dataset involving multi-step and non-factoid answers. Moreover, relying on video transcripts remains an under-explored topic.…

Computation and Language · Computer Science 2020-06-02 Anthony Colas , Seokhwan Kim , Franck Dernoncourt , Siddhesh Gupte , Daisy Zhe Wang , Doo Soon Kim

Predictive process monitoring is a subfield of process mining that aims to estimate case or event features for running process instances. Such predictions are of significant interest to the process stakeholders. However, most of the…

Self-supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self-supervised video representation learning method based on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Duc Quang Vu , Ngan T. H. Le , Jia-Ching Wang

Videos serve as a powerful medium to convey ideas, tell stories, and provide detailed instructions, especially through long-format tutorials. Such tutorials are valuable for learning new skills at one's own pace, yet they can be…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Nafisa Hussain

We introduce DIP, a novel unsupervised post-training method designed to enhance dense image representations in large-scale pretrained vision encoders for in-context scene understanding. Unlike prior approaches that rely on complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sophia Sirko-Galouchenko , Spyros Gidaris , Antonin Vobecky , Andrei Bursuc , Nicolas Thome

It is challenging to generate high-quality instruction datasets for non-English languages due to tail phenomena, which limit performance on less frequently observed data. To mitigate this issue, we propose translating existing high-quality…

Computation and Language · Computer Science 2024-10-03 Yungi Kim , Chanjun Park

Video Diffusion Transformers (DiTs) generate high-quality videos but demand substantial compute due to wide blocks, deep architectures, and iterative sampling. Recent methods reduce cost by compressing width, depth, or sampling steps, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yutong Wang , Yunke Wang , Tianfan Xue , Yu Qiao , Yaohui Wang , Xinyuan Chen , Chang Xu

Diffusion models have achieved significant success in image and video generation. This motivates a growing interest in video editing tasks, where videos are edited according to provided text descriptions. However, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhen Xing , Qi Dai , Zihao Zhang , Hui Zhang , Han Hu , Zuxuan Wu , Yu-Gang Jiang