English
Related papers

Related papers: HyperTransport: Amortized Conditioning of T2I Gene…

200 papers

Multimodal perception enables robust autonomous driving but incurs unnecessary computational cost when all sensors remain active. This paper presents PRAM-R, a unified Perception-Reasoning-Action-Memory framework with LLM-Guided Modality…

Robotics · Computer Science 2026-03-05 Yi Zhang , Xian Zhang , Saisi Zhao , Yinglei Song , Chengdong Wu , Nenad Petrovic , Alois Knoll

Pretrained video generation models provide strong priors for robot control, but existing unified world action models still struggle to decode reliable actions without substantial robot-specific training. We attribute this limitation to a…

Robotics · Computer Science 2026-04-14 Liaoyuan Fan , Zetian Xu , Chen Cao , Wenyao Zhang , Mingqi Yuan , Jiayu Chen

While autonomous driving (AD) stacks struggle with decision making under partial observability and real-world complexity, human drivers are capable of applying commonsense reasoning to make near-optimal decisions with limited information.…

Activation steering promises to be an extremely parameter-efficient form of adaptation, but its effectiveness depends on critical design choices -- such as intervention location and parameterization -- that currently rely on empirical…

Machine Learning · Computer Science 2026-03-09 Dyah Adila , John Cooper , Alexander Yun , Avi Trost , Frederic Sala

Humanoid locomotion is a challenging task due to its inherent complexity and high-dimensional dynamics, as well as the need to adapt to diverse and unpredictable environments. In this work, we introduce a novel learning framework for…

Robotics · Computer Science 2025-10-16 Hyunyoung Jung , Zhaoyuan Gu , Ye Zhao , Hae-Won Park , Sehoon Ha

We introduce HyperMorph, a framework that facilitates efficient hyperparameter tuning in learning-based deformable image registration. Classical registration algorithms perform an iterative pair-wise optimization to compute a deformation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Andrew Hoopes , Malte Hoffmann , Douglas N. Greve , Bruce Fischl , John Guttag , Adrian V. Dalca

While modern text-to-image (T2I) models excel at generating images from intricate prompts, they struggle to capture the key details when the inputs are descriptive paragraphs. This limitation stems from the prevalence of concise captions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jen-Yuan Huang , Tong Lin , Yilun Du

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

In an age dominated by resource-intensive foundation models, the ability to efficiently adapt to downstream tasks is crucial. Visual Prompting (VP), drawing inspiration from the prompting techniques employed in Large Language Models (LLMs),…

Machine Learning · Computer Science 2024-03-19 Diganta Misra , Muawiz Chaudhary , Agam Goyal , Bharat Runwal , Pin Yu Chen

Despite the recent advances in personalized text-to-image (P-T2I) generative models, it remains challenging to perform finetuning-free multi-subject-driven T2I in a resource-efficient manner. Predominantly, contemporary approaches,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Maitreya Patel , Sangmin Jung , Chitta Baral , Yezhou Yang

Future spacecraft and surface robotic missions require increasingly capable autonomy stacks for exploring challenging and unstructured domains, and trajectory optimization will be a cornerstone of such autonomy stacks. However, the…

Robotics · Computer Science 2024-09-18 Julia Briden , Changrak Choi , Kyongsik Yun , Richard Linares , Abhishek Cauligi

This study introduces the Perception Latency Mitigation Network (PLM-Net), a modular deep learning framework designed to mitigate perception latency in vision-based imitation-learning lane-keeping systems. Perception latency, defined as the…

Robotics · Computer Science 2026-03-20 Aws Khalil , Jaerock Kwon

In recent years, there has been a growing emphasis on compressing large pre-trained transformer models for resource-constrained devices. However, traditional pruning methods often leave the embedding layer untouched, leading to model…

Machine Learning · Computer Science 2024-06-13 Oshin Dutta , Ritvik Gupta , Sumeet Agarwal

We propose an end-to-end trainable image compression framework with a multi-scale and context-adaptive entropy model, especially for low bitrate compression. Due to the success of autoregressive priors in probabilistic generative model, the…

Image and Video Processing · Electrical Eng. & Systems 2019-10-18 Jing Zhou , Sihan Wen , Akira Nakagawa , Kimihiko Kazui , Zhiming Tan

This work introduces SteerVLM, a lightweight steering module designed to guide Vision-Language Models (VLMs) towards outputs that better adhere to desired instructions. Our approach learns from the latent embeddings of paired prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Anushka Sivakumar , Andrew Zhang , Zaber Hakim , Chris Thomas

Prompt tuning has emerged as a lightweight strategy for adapting foundation models to downstream tasks, particularly for resource-constrained systems. As pre-trained prompts become valuable assets, combining multiple source prompts offers a…

Computation and Language · Computer Science 2025-10-16 Enming Zhang , Liwen Cao , Yanru Wu , Zijie Zhao , Yang Li

Training robust deep video representations has proven to be computationally challenging due to substantial decoding overheads, the enormous size of raw video streams, and their inherent high temporal redundancy. Different from existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Shristi Das Biswas , Efstathia Soufleri , Arani Roy , Kaushik Roy

Adapting to concept drift is a challenging task in machine learning, which is usually tackled using incremental learning techniques that periodically re-fit a learning model leveraging newly available data. A primary limitation of these…

Recognizing the tremendous improvements that the integration of generative AI can bring to intelligent transportation systems, this article explores the integration of generative AI technologies in vehicular networks, focusing on their…

Networking and Internet Architecture · Computer Science 2023-04-24 Ruichen Zhang , Ke Xiong , Hongyang Du , Dusit Niyato , Jiawen Kang , Xuemin Shen , H. Vincent Poor

Traditional approaches to quadruped control frequently employ simplified, hand-derived models. This significantly reduces the capability of the robot since its effective kinematic range is curtailed. In addition, kinodynamic constraints are…