English
Related papers

Related papers: Dynamic Context Evolution for Scalable Synthetic D…

200 papers

Dataset distillation aims to synthesize a small dataset from a large dataset, enabling the model trained on it to perform well on the original dataset. With the blooming of large language models and multimodal large language models, the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zhenghao Zhao , Haoxuan Wang , Junyi Wu , Yuzhang Shang , Gaowen Liu , Yan Yan

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

Computation and Language · Computer Science 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

Diffusion large language models (dLLMs) generate text through iterative denoising, yet current decoding strategies discard rich intermediate predictions in favor of the final output. Our work here reveals a critical phenomenon, temporal…

Computation and Language · Computer Science 2025-10-07 Wen Wang , Bozhen Fang , Chenchen Jing , Yongliang Shen , Yangyi Shen , Qiuyu Wang , Hao Ouyang , Hao Chen , Chunhua Shen

Deductive coding is a common discourse analysis method widely used by learning science and learning analytics researchers for understanding teaching and learning interactions. It often requires researchers to manually label all discourses…

Computation and Language · Computer Science 2024-10-03 Lishan Zhang , Han Wu , Xiaoshan Huang , Tengfei Duan , Hanxiang Du

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

Machine Learning · Computer Science 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

The subpopulationtion shift, characterized by a disparity in subpopulation distributibetween theween the training and target datasets, can significantly degrade the performance of machine learning models. Current solutions to subpopulation…

Scaling the amount of compute used to train language models has dramatically improved their capabilities. However, when it comes to inference, we often limit models to making only one attempt at a problem. Here, we explore inference compute…

Machine Learning · Computer Science 2025-01-03 Bradley Brown , Jordan Juravsky , Ryan Ehrlich , Ronald Clark , Quoc V. Le , Christopher Ré , Azalia Mirhoseini

This paper introduces DLM-One, a score-distillation-based framework for one-step sequence generation with continuous diffusion language models (DLMs). DLM-One eliminates the need for iterative refinement by aligning the scores of a student…

Computation and Language · Computer Science 2025-06-03 Tianqi Chen , Shujian Zhang , Mingyuan Zhou

Engineering design optimization requires an efficient combination of a 3D shape representation, an optimization algorithm, and a design performance evaluation method, which is often computationally expensive. We present a prompt evolution…

Artificial Intelligence · Computer Science 2024-08-13 Melvin Wong , Thiago Rios , Stefan Menzel , Yew Soon Ong

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiyuan Wang , Muhan Zhang

Diffusion probabilistic models (DPMs) have become a popular approach to conditional generation, due to their promising results and support for cross-modal synthesis. A key desideratum in conditional synthesis is to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Ye Zhu , Yu Wu , Kyle Olszewski , Jian Ren , Sergey Tulyakov , Yan Yan

We consider event extraction in a generative manner with template-based conditional generation. Although there is a rising trend of casting the task of event extraction as a sequence generation problem with prompts, these generation-based…

Computation and Language · Computer Science 2022-12-19 Xiao Liu , Heyan Huang , Ge Shi , Bo Wang

Acronym Disambiguation (AD) is a fundamental challenge in technical text processing, particularly in specialized sectors where high ambiguity complicates automated analysis. This paper addresses AD within the context of the TextMine'26…

Computation and Language · Computer Science 2025-12-23 El Mokhtar Hribach , Oussama Mechhour , Mohammed Elmonstaser , Yassine El Boudouri , Othmane Kabal

Identifying wireless modulation schemes is essential for cognitive radio, but standard supervised models often degrade under distribution shift, and training domain-specific wireless foundation models from scratch is computationally…

Machine Learning · Computer Science 2026-03-30 Mohammad Rostami , Atik Faysal , Reihaneh Gh. Roshan , Huaxia Wang , Nikhil Muralidhar , Yu-Dong Yao

Designing biological sequences is an important challenge that requires satisfying complex constraints and thus is a natural problem to address with deep generative modeling. Diffusion generative models have achieved considerable success in…

Machine Learning · Computer Science 2023-06-19 Pavel Avdeyev , Chenlai Shi , Yuhao Tan , Kseniia Dudnyk , Jian Zhou

The limits of open-ended generative models are unclear, yet increasingly important. What causes them to succeed and what causes them to fail? In this paper, we take a prompt-centric approach to analyzing and bounding the abilities of…

Computation and Language · Computer Science 2023-02-21 Albert Lu , Hongxin Zhang , Yanzhe Zhang , Xuezhi Wang , Diyi Yang

Slot filling, a fundamental module of spoken language understanding, often suffers from insufficient quantity and diversity of training data. To remedy this, we propose a novel Cluster-to-Cluster generation framework for Data Augmentation…

Computation and Language · Computer Science 2020-12-15 Yutai Hou , Sanyuan Chen , Wanxiang Che , Cheng Chen , Ting Liu

Data-driven deep learning models have enabled tremendous progress in change detection (CD) with the support of pixel-level annotations. However, collecting diverse data and manually annotating them is costly, laborious, and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Qi Zang , Jiayi Yang , Shuang Wang , Dong Zhao , Wenjun Yi , Zhun Zhong

Real-world speech recordings suffer from degradations such as background noise and reverberation. Speech enhancement aims to mitigate these issues by generating clean high-fidelity signals. While recent generative approaches for speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-22 Heitor R. Guimarães , Jiaqi Su , Rithesh Kumar , Tiago H. Falk , Zeyu Jin

Large-scale models trained on broad data have recently become the mainstream architecture in computer vision due to their strong generalization performance. In this paper, the main focus is on an emergent ability in large vision models,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Yuanhan Zhang , Kaiyang Zhou , Ziwei Liu