English
Related papers

Related papers: A Cognitive Process-Inspired Architecture for Subj…

200 papers

Video contrastive learning (V-CL) has emerged as a popular framework for unsupervised video representation learning, demonstrating strong results in tasks such as action classification and detection. Yet, to harness these benefits, it is…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zeen Song , Wenwen Qiang , Changwen Zheng , Hui Xiong , Gang Hua

Decoding functional magnetic resonance imaging (fMRI) signals into text has been a key challenge in the neuroscience community, with the potential to advance brain-computer interfaces and uncover deeper insights into brain mechanisms.…

Neurons and Cognition · Quantitative Biology 2025-06-10 Weikang Qiu , Zheng Huang , Haoyu Hu , Aosong Feng , Yujun Yan , Rex Ying

Due to the low signal-to-noise ratio and limited resolution of functional MRI data, and the high complexity of natural images, reconstructing a visual stimulus from human brain fMRI measurements is a challenging task. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zijin Gu , Keith Jamison , Amy Kuceyeski , Mert Sabuncu

Medical image denoising (MID) lacks absolutely clean images for supervision, leading to a noisy reference problem that fundamentally limits denoising performance. Existing simulated-supervised discriminative learning (SimSDL) and…

Image and Video Processing · Electrical Eng. & Systems 2026-04-20 Yuxin Liu , Yiqing Dong , Wenxue Yu , Zhan Wu , Rongjun Ge , Yang Chen , Yuting He

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte

In many applications, it is important to reconstruct a fluid flow field, or some other high-dimensional state, from limited measurements and limited data. In this work, we propose a shallow neural network-based learning methodology for such…

Implicit degradation modeling-based blind super-resolution (SR) has attracted more increasing attention in the community due to its excellent generalization to complex degradation scenarios and wide application range. How to extract more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiang Yuan , Ji Ma , Bo Wang , Weiming Hu

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

We present CV4Code, a compact and effective computer vision method for sourcecode understanding. Our method leverages the contextual and the structural information available from the code snippet by treating each snippet as a…

Software Engineering · Computer Science 2022-05-19 Ruibo Shi , Lili Tao , Rohan Saphal , Fran Silavong , Sean J. Moran

In recent years, notable advancements have been made in the domain of visual document understanding, with the prevailing architecture comprising a cascade of vision and language models. The text component can either be extracted explicitly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Ofir Abramovich , Niv Nayman , Sharon Fogel , Inbal Lavi , Ron Litman , Shahar Tsiper , Royee Tichauer , Srikar Appalaraju , Shai Mazor , R. Manmatha

Long-sequence streaming 3D reconstruction remains a significant open challenge. Existing autoregressive models often fail when processing long sequences because they anchor poses to the first frame, leading to attention decay, scale drift,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Chong Cheng , Xianda Chen , Tao Xie , Wei Yin , Weiqiang Ren , Qian Zhang , Xiaoyang Guo , Hao Wang

Zero-shot MRI reconstruction relies on generative priors, but single-modality unconditional priors produce hallucinations under severe ill-posedness. In many clinical workflows, complementary MRI acquisitions (e.g. high-quality structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Seunghoi Kim , Chen Jin , Henry F. J. Tregidgo , Matteo Figini , Daniel C. Alexander

Flow matching models have emerged as a powerful method for generative modeling on domains like images or videos, and even on irregular or unstructured data like 3D point clouds or even protein structures. These models are commonly trained…

Machine Learning · Computer Science 2025-05-30 Yuyang Wang , Anurag Ranjan , Josh Susskind , Miguel Angel Bautista

Despite the success of Large Vision--Language Models (LVLMs), most existing architectures suffer from a representation bottleneck: they rely on static, instruction-agnostic vision encoders whose visual representations are utilized in an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hanpeng Liu , Yaqian Li , Zidan Wang , Shuoxi Zhang , Zihao Bo , Rinyoichi Takezoe , Kaiwen Long , Kun He

Large Vision-Language Models (LVLMs) are pivotal for real-world AI tasks like embodied intelligence due to their strong vision-language reasoning abilities. However, current LVLMs process entire images at the token level, which is…

Computation and Language · Computer Science 2025-05-20 Run Luo , Renke Shan , Longze Chen , Ziqiang Liu , Lu Wang , Min Yang , Xiaobo Xia

This work introduces a novel approach to fMRI-based visual image reconstruction using a subject-agnostic common representation space. We show that the brain signals of the subjects can be aligned in this common space during training to form…

Image and Video Processing · Electrical Eng. & Systems 2025-10-10 Christos Zangos , Danish Ebadulla , Thomas Christopher Sprague , Ambuj Singh

Obtaining the human-like perception ability of abstracting visual concepts from concrete pixels has always been a fundamental and important target in machine learning research fields such as disentangled representation learning and scene…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Tao Yang , Yuwang Wang , Yan Lu , Nanning Zheng

Modern text-to-image diffusion models encode rich visual priors, but expose them only through one-way text-conditioned generation. Existing unified vision--language models derived from them recover bidirectional capability through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Eric Tillmann Bill , Enis Simsar , Alessio Tonioni , Thomas Hofmann

In natural language processing, most models try to learn semantic representations merely from texts. The learned representations encode the distributional semantics but fail to connect to any knowledge about the physical world. In contrast,…

Computation and Language · Computer Science 2021-11-16 Yizhen Zhang , Minkyu Choi , Kuan Han , Zhongming Liu

Concept-based interpretability for Convolutional Neural Networks (CNNs) aims to align internal model representations with high-level semantic concepts, but existing approaches largely overlook the semantic roles of individual filters and…

Machine Learning · Computer Science 2025-09-24 Xinyu Mu , Hui Dou , Furao Shen , Jian Zhao