English
Related papers

Related papers: Learning Iterative Reasoning through Energy Diffus…

200 papers

Many tasks in natural language processing involve predicting structured outputs, e.g., sequence labeling, semantic role labeling, parsing, and machine translation. Researchers are increasingly applying deep representation learning to these…

Computation and Language · Computer Science 2020-10-07 Lifu Tu , Tianyu Liu , Kevin Gimpel

Inference-time scaling has emerged as a major approach for improving reasoning capabilities, and has been increasingly applied to diffusion models. However, existing inference-time scaling methods for diffusion models typically rely on…

Machine Learning · Computer Science 2026-05-20 Taegu Kang , Jaesik Yoon , Sungjin Ahn

Modern machine learning tools such as deep neural networks (DNNs) are playing a revolutionary role in many fields such as natural language processing, computer vision, and the internet of things. Once they are trained, deep learning models…

Machine Learning · Computer Science 2022-01-19 Arjun Parthasarathy , Bhaskar Krishnamachari

Nonprehensile manipulation, such as pushing objects across cluttered environments, presents a challenging control problem due to complex contact dynamics and long-horizon planning requirements. In this work, we propose HeRD, a hierarchical…

Robotics · Computer Science 2025-12-12 Steven Caro , Stephen L. Smith

Most recent works focus on answering first order logical queries to explore the knowledge graph reasoning via multi-hop logic predictions. However, existing reasoning models are limited by the circumscribed logical paradigms of training…

Machine Learning · Computer Science 2023-06-07 Xiaoying Xie , Biao Gong , Yiliang Lv , Zhen Han , Guoshuai Zhao , Xueming Qian

The recent success of denoising diffusion models has significantly advanced text-to-image generation. While these large-scale pretrained models show excellent performance in general image synthesis, downstream objectives often require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Maorong Wang , Jiafeng Mao , Xueting Wang , Toshihiko Yamasaki

To model the indeterminacy of human behaviors, stochastic trajectory prediction requires a sophisticated multi-modal distribution of future trajectories. Emerging diffusion models have revealed their tremendous representation capacities in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Weibo Mao , Chenxin Xu , Qi Zhu , Siheng Chen , Yanfeng Wang

The iterated learning model simulates the transmission of language from generation to generation in order to explore how the constraints imposed by language transmission facilitate the emergence of language structure. Despite each modelled…

Computation and Language · Computer Science 2026-01-07 Hyoyeon Lee , Seth Bullock , Conor Houghton

The budgeted information gathering problem - where a robot with a fixed fuel budget is required to maximize the amount of information gathered from the world - appears in practice across a wide range of applications in autonomous…

Robotics · Computer Science 2016-11-15 Sanjiban Choudhury , Ashish Kapoor , Gireeja Ranade , Debadeepta Dey

Reasoning-oriented language models achieve strong performance by generating long chain-of-thought traces at inference time. However, this capability comes with substantial and often excessive computational cost, which can materialize in…

Machine Learning · Computer Science 2026-03-17 Gianluigi Silvestri , Edoardo Cetin

In this paper, we focus on the often-overlooked issue of embedding collapse in existing diffusion-based sequential recommendation models and propose ADRec, an innovative framework designed to mitigate this problem. Diverging from previous…

Information Retrieval · Computer Science 2025-05-27 Jialei Chen , Yuanbo Xu , Yiheng Jiang

Energy harvesting (EH) IoT devices that operate intermittently without batteries, coupled with advances in deep neural networks (DNNs), have opened up new opportunities for enabling sustainable smart applications. Nevertheless, implementing…

Machine Learning · Computer Science 2022-07-07 Sahidul Islam , Jieren Deng , Shanglin Zhou , Chen Pan , Caiwen Ding , Mimi Xie

Bridge models in image restoration construct a diffusion process from degraded to clear images. However, existing methods typically require training a bridge model from scratch for each specific type of degradation, resulting in high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hanting Wang , Tao Jin , Wang Lin , Shulei Wang , Hai Huang , Shengpeng Ji , Zhou Zhao

Discrete Diffusion Language Models (DLMs) offer a promising non-autoregressive alternative for text generation, yet effective mechanisms for inference-time control remain relatively underexplored. Existing approaches include sampling-level…

Computation and Language · Computer Science 2026-01-30 Eden Avrahami , Eliya Nachmani

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated Chain-of-Thought (CoT) trajectories often exceed what the underlying problems require,…

Machine Learning · Computer Science 2026-05-12 Songtao Wei , Yi Li , Zhikai Li , Xu Hu , Yuede Ji , Guanpeng Li , Feng Chen , Carl Yang , Zhichun Guo , Bingzhe Li

Diffusion models have demonstrated strong generative capabilities across domains ranging from image synthesis to complex reasoning tasks. However, most inference-time scaling methods rely on fixed denoising schedules, limiting their ability…

Machine Learning · Computer Science 2025-10-28 Gyubin Lee , Truong Nhat Nguyen Bao , Jaesik Yoon , Dongwoo Lee , Minsu Kim , Yoshua Bengio , Sungjin Ahn

Experience replay is widely used to improve learning efficiency in reinforcement learning by leveraging past experiences. However, existing experience replay methods, whether based on uniform or prioritized sampling, often suffer from low…

Machine Learning · Computer Science 2025-05-20 Kaiyan Zhao , Yiming Wang , Yuyang Chen , Yan Li , Leong Hou U , Xiaoguang Niu

Large Language Models (LLMs) demonstrate their reasoning ability through chain-of-thought (CoT) generation. However, LLM's autoregressive decoding may limit the ability to revisit and refine earlier tokens in a holistic manner, which can…

Machine Learning · Computer Science 2026-04-24 Haoqiang Kang , Yizhe Zhang , Nikki Lijing Kuang , Nicklas Majamaki , Navdeep Jaitly , Yi-An Ma , Lianhui Qin

The growth in computational power and data hungriness of Machine Learning has led to an important shift of research efforts towards the distribution of ML models on multiple machines, leading in even more powerful models. However, there…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Andrew Mary Huet de Barochez , Stéphan Plassart , Sébastien Monnet