English
Related papers

Related papers: Hierarchically Structured Reinforcement Learning f…

200 papers

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story, where the images should be realistic and keep global consistency across dynamic scenes and characters. Current works face the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Bowen Li , Thomas Lukasiewicz

Hierarchical Reinforcement Learning algorithms have successfully been applied to temporal credit assignment problems with sparse reward signals. However, state-of-the-art algorithms require manual specification of sub-task structures, a…

Machine Learning · Computer Science 2019-09-24 Robert Tjarko Lange , Aldo Faisal

Existing 1D visual tokenizers for autoregressive (AR) generation largely follow the design principles of language modeling, as they are built directly upon transformers whose priors originate in language, yielding single-hierarchy latent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Xu Zhang , Cheng Da , Huan Yang , Kun Gai , Ming Lu , Zhan Ma

Recent advances in deep learning research, such as transformers, have bolstered the ability for automated agents to generate creative texts similar to those that a human would write. By default, transformer decoders can only generate new…

Computation and Language · Computer Science 2022-12-21 Brian D. Zimmerman , Gaurav Sahu , Olga Vechtomova

We present an approach that exploits hierarchical Recurrent Neural Networks (RNNs) to tackle the video captioning problem, i.e., generating one or multiple sentences to describe a realistic video. Our hierarchical framework contains a…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Haonan Yu , Jiang Wang , Zhiheng Huang , Yi Yang , Wei Xu

Learning interpretable and transferable subpolicies and performing task decomposition from a single, complex task is difficult. Some traditional hierarchical reinforcement learning techniques enforce this decomposition in a top-down manner,…

Machine Learning · Computer Science 2019-03-06 Bohan Wu , Jayesh K. Gupta , Mykel J. Kochenderfer

Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or text descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Renato Sortino , Simone Palazzo , Concetto Spampinato

A picture is worth a thousand words. Not until recently, however, we noticed some success stories in understanding of visual scenes: a model that is able to detect/name objects, describe their attributes, and recognize their…

Computation and Language · Computer Science 2017-10-27 Ying Hua Tan , Chee Seng Chan

Current multimodal LLMs encode images as static visual prefixes and rely on text-based reasoning, lacking goal-driven and adaptive visual access. Inspired by human visual perception-where attention is selectively and sequentially shifted…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Guangfu Guo , Xiaoqian Lu , Yue Feng , Mingming Sun

Recent works show that learning contextualized embeddings for words is beneficial for downstream tasks. BERT is one successful example of this approach. It learns embeddings by solving two tasks, which are masked language model (masked LM)…

Computation and Language · Computer Science 2020-11-10 Çağla Aksoy , Alper Ahmetoğlu , Tunga Güngör

Achieving machine intelligence requires a smooth integration of perception and reasoning, yet models developed to date tend to specialize in one or the other; sophisticated manipulation of symbols acquired from rich perceptual spaces has so…

Machine Learning · Computer Science 2018-09-14 Eric Crawford , Guillaume Rabusseau , Joelle Pineau

In this paper, we propose a hierarchical contrastive learning framework, HiCL, which considers local segment-level and global sequence-level relationships to improve training efficiency and effectiveness. Traditional methods typically…

Computation and Language · Computer Science 2023-10-17 Zhuofeng Wu , Chaowei Xiao , VG Vinod Vydiswaran

We present a framework for robots to learn novel visual concepts and tasks via in-situ linguistic interactions with human users. Previous approaches have either used large pre-trained visual models to infer novel objects zero-shot, or added…

Robotics · Computer Science 2023-12-21 Weiwei Gu , Anant Sah , Nakul Gopalan

Generating textual descriptions for images has been an attractive problem for the computer vision and natural language processing researchers in recent years. Dozens of models based on deep learning have been proposed to solve this problem.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Ahmad Asadi , Reza Safabakhsh

This paper presents a novel method to deal with the challenging task of generating photographic images conditioned on semantic image descriptions. Our method introduces accompanying hierarchical-nested adversarial objectives inside the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Zizhao Zhang , Yuanpu Xie , Lin Yang

Embedding visual representations within original hierarchical tables can mitigate additional cognitive load stemming from the division of users' attention. The created hierarchical table visualizations can help users understand and explore…

Human-Computer Interaction · Computer Science 2024-05-28 Guozheng Li , Peng He , Xinyu Wang , Runfei Li , Chi Harold Liu , Chuangxin Ou , Dong He , Guoren Wang

Existing neural methods for data-to-text generation are still struggling to produce long and diverse texts: they are insufficient to model input data dynamically during generation, to capture inter-sentence coherence, or to generate…

Computation and Language · Computer Science 2019-08-27 Zhihong Shao , Minlie Huang , Jiangtao Wen , Wenfei Xu , Xiaoyan Zhu

We propose a generative model of paraphrase generation, that encourages syntactic diversity by conditioning on an explicit syntactic sketch. We introduce Hierarchical Refinement Quantized Variational Autoencoders (HRQ-VAE), a method for…

Computation and Language · Computer Science 2022-03-22 Tom Hosking , Hao Tang , Mirella Lapata

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

Artificial Intelligence · Computer Science 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

The existing image captioning approaches typically train a one-stage sentence decoder, which is difficult to generate rich fine-grained descriptions. On the other hand, multi-stage image caption model is hard to train due to the vanishing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Jiuxiang Gu , Jianfei Cai , Gang Wang , Tsuhan Chen