English
Related papers

Related papers: Conditional COT-GAN for Video Prediction with Kern…

200 papers

Effective understanding of the environment and accurate trajectory prediction of surrounding dynamic obstacles are critical for intelligent systems such as autonomous vehicles and wheeled mobile robotics navigating in complex scenarios to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

Unsupervised object-centric learning from videos is a promising approach towards learning compositional representations that can be applied to various downstream tasks, such as prediction and reasoning. Recently, it was shown that…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Cristian Meo , Akihiro Nakano , Mircea Lică , Aniket Didolkar , Masahiro Suzuki , Anirudh Goyal , Mengmi Zhang , Justin Dauwels , Yutaka Matsuo , Yoshua Bengio

Predicting traffic conditions has been recently explored as a way to relieve traffic congestion. Several pioneering approaches have been proposed based on traffic observations of the target location as well as its adjacent regions, but they…

Artificial Intelligence · Computer Science 2023-08-22 Xingyi Cheng , Ruiqing Zhang , Jie Zhou , Wei Xu

A novel algorithm is proposed to solve the sample-based optimal transport problem. An adversarial formulation of the push-forward condition uses a test function built as a convolution between an adaptive kernel and an evolving probability…

Machine Learning · Statistics 2020-06-11 Daeyoung Kim , Esteban G. Tabak

In this paper, we study the problem of learning compact (low-dimensional) representations for sequential data that captures its implicit spatio-temporal cues. To maximize extraction of such informative cues from the data, we set the problem…

Machine Learning · Computer Science 2020-07-14 Anoop Cherian , Shuchin Aeron

The large-scale visual-language pre-trained model, Contrastive Language-Image Pre-training (CLIP), has significantly improved image captioning for scenarios without human-annotated image-caption pairs. Recent advanced CLIP-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jiarui Yu , Haoran Li , Yanbin Hao , Bin Zhu , Tong Xu , Xiangnan He

Conformal prediction (CP) constructs uncertainty sets for model outputs with finite-sample coverage guarantees. A candidate output is included in the prediction set if its non-conformity score is not considered extreme relative to the…

Machine Learning · Statistics 2025-11-20 Eugene Ndiaye

We propose a novel method that trains a conditional Generative Adversarial Network (GAN) to generate visual interpretations of a Convolutional Neural Network (CNN). To comprehend a CNN, the GAN is trained with information on how the CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 R T Akash Guna , Raul Benitez , O K Sikha

Chain-of-thought (CoT) reasoning with self-consistency improves performance by aggregating multiple sampled reasoning paths. In this setting, correctness is no longer tied to a single reasoning trace but to the aggregation rule over a pool…

Machine Learning · Statistics 2026-05-15 Yu Gu , Zijun Yu , Vahid Partovi Nia , Masoud Asgharian

A mainstream type of the state of the arts (SOTAs) based on convolutional neural network (CNN) for real image denoising contains two sub-problems, i.e., noise estimation and non-blind denoising. This paper considers real noise approximated…

Image and Video Processing · Electrical Eng. & Systems 2022-11-29 Yifan Zuo , Jiacheng Xie , Yuming Fang , Yan Huang , Wenhui Jiang

The field of Contextual Optimization (CO) integrates machine learning and optimization to solve decision making problems under uncertainty. Recently, a risk sensitive variant of CO, known as Conditional Robust Optimization (CRO), combines…

Machine Learning · Computer Science 2024-03-08 Abhilash Chenreddy , Erick Delage

Purpose: Vision-based robot tool segmentation plays a fundamental role in surgical robots and downstream tasks. CaRTS, based on a complementary causal model, has shown promising performance in unseen counterfactual surgical environments in…

Robotics · Computer Science 2022-12-02 Hao Ding , Jie Ying Wu , Zhaoshuo Li , Mathias Unberath

This paper studies the Partial Optimal Transport (POT) problem between two unbalanced measures with at most $n$ supports and its applications in various AI tasks such as color transfer or domain adaptation. There is hence the need for fast…

Machine Learning · Computer Science 2023-12-25 Anh Duc Nguyen , Tuan Dung Nguyen , Quang Minh Nguyen , Hoang H. Nguyen , Lam M. Nguyen , Kim-Chuan Toh

As Video Large Language Models (Video-LLMs) scale to longer and more complex videos, their inference cost grows rapidly due to the large volume of visual tokens accumulated across frames. Training-free token compression has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Minseok Kang , Minhyeok Lee , Jungho Lee , Minjung Kim , Donghyeong Kim , Dayeon Lee , Heeseung Choi , Ig-jae Kim , Sangyoun Lee

Optimal Transport (OT) is a mathematical framework that first emerged in the eighteenth century and has led to a plethora of methods for answering many theoretical and applied questions. The last decade has been a witness to the remarkable…

Machine Learning · Computer Science 2024-03-25 Abdelwahed Khamis , Russell Tsuchida , Mohamed Tarek , Vivien Rolland , Lars Petersson

In the realm of time series analysis, tackling the phenomenon of concept drift poses a significant challenge. Concept drift -- characterized by the evolving statistical properties of time series data, affects the reliability and accuracy of…

Machine Learning · Computer Science 2025-02-03 Kunpeng Xu , Lifei Chen , Shengrui Wang

The ability to accurately predict the trajectory of surrounding vehicles is a critical hurdle to overcome on the journey to fully autonomous vehicles. To address this challenge, we pioneer a novel behavior-aware trajectory prediction model…

Purpose. Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. Optical coherence tomography (OCT) is an imaging modality with a high spatial and…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Marcel Bengs , Nils Gessert , Matthias Schlüter , Alexander Schlaefer

Video reasoning, the task of enabling machines to infer from dynamic visual content through multi-step logic, is crucial for advanced AI. While the Chain-of-Thought (CoT) mechanism has enhanced reasoning in text-based tasks, its application…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Mi Luo , Zihui Xue , Alex Dimakis , Kristen Grauman

Optimal transport distances have become a classic tool to compare probability distributions and have found many applications in machine learning. Yet, despite recent algorithmic developments, their complexity prevents their direct use on…

Machine Learning · Statistics 2021-01-07 Kilian Fatras , Younes Zine , Szymon Majewski , Rémi Flamary , Rémi Gribonval , Nicolas Courty