English
Related papers

Related papers: UMind: A Unified Multitask Network for Zero-Shot M…

200 papers

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Chain-of-Thought (CoT) reasoning has been widely adopted to enhance Large Language Models (LLMs) by decomposing complex tasks into simpler, sequential subtasks. However, extending CoT to vision-language reasoning tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Luozheng Qin , Jia Gong , Yuqing Sun , Tianjiao Li , Mengping Yang , Xiaomeng Yang , Chao Qu , Zhiyu Tan , Hao Li

Humans recognize the visual world at multiple levels: we effortlessly categorize scenes and detect objects inside, while also identifying the textures and surfaces of the objects along with their different compositional parts. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Tete Xiao , Yingcheng Liu , Bolei Zhou , Yuning Jiang , Jian Sun

Unsupervised neural machine translation (UNMT) has recently achieved remarkable results with only large monolingual corpora in each language. However, the uncertainty of associating target with source sentences makes UNMT theoretically an…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Yuanhang Su , Kai Fan , Nguyen Bach , C. -C. Jay Kuo , Fei Huang

Brain decoding involves the determination of a subject's cognitive state or an associated stimulus from functional neuroimaging data measuring brain activity. In this setting the cognitive state is typically characterized by an element of a…

Machine Learning · Statistics 2015-04-14 Nicole Croteau , Farouk S. Nathoo , Jiguo Cao , Ryan Budney

People ``understand'' the world via vision, hearing, tactile, and also the past experience. Human experience can be learned through normal learning (we call it explicit knowledge), or subconsciously (we call it implicit knowledge). These…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Chien-Yao Wang , I-Hau Yeh , Hong-Yuan Mark Liao

Task-oriented semantic communications have achieved significant performance gains. However, the employed deep neural networks in semantic communications have to be updated when the task is changed or multiple models need to be stored for…

Signal Processing · Electrical Eng. & Systems 2024-06-11 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu , Xiaoming Tao

The human brain is constantly processing and integrating information in order to make decisions and interact with the world, for tasks from recognizing a familiar face to playing a game of tennis. These complex cognitive processes require…

Neurons and Cognition · Quantitative Biology 2019-05-14 Thomas A. Carlson , Tijl Grootswagers , Amanda K. Robinson

Neuroimaging is essential in brain studies for the diagnosis and identification of disease, structure, and function of the brain in its healthy and disease states. Literature shows that there are advantages of multitasking with some deep…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Mohammad Eslami , Solale Tabarestani , Malek Adjouadi

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Semantic segmentation is essentially important to biomedical image analysis. Many recent works mainly focus on integrating the Fully Convolutional Network (FCN) architecture with sophisticated convolution implementation and deep…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Xuhua Ren , Lichi Zhang , Sahar Ahmad , Dong Nie , Fan Yang , Lei Xiang , Qian Wang , Dinggang Shen

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik

Despite advancements in artificial intelligence, object recognition models still lag behind in emulating visual information processing in human brains. Recent studies have highlighted the potential of using neural data to mimic brain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zitong Lu , Yile Wang , Julie D. Golomb

Electroencephalography (EEG) signals, known for convenient non-invasive acquisition but low signal-to-noise ratio, have recently gained substantial attention due to the potential to decode natural images. This paper presents a…

Human-Computer Interaction · Computer Science 2024-04-05 Yonghao Song , Bingchuan Liu , Xiang Li , Nanlin Shi , Yijun Wang , Xiaorong Gao

Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Phuoc-Nguyen Bui , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Though U-Net has achieved tremendous success in medical image segmentation tasks, it lacks the ability to explicitly model long-range dependencies. Therefore, Vision Transformers have emerged as alternative segmentation structures recently,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-12 Hongyi Wang , Shiao Xie , Lanfen Lin , Yutaro Iwamoto , Xian-Hua Han , Yen-Wei Chen , Ruofeng Tong

Medical image analysis typically includes several tasks such as enhancement, segmentation, and classification. Traditionally, these tasks are implemented using separate deep learning models for separate tasks, which is not efficient because…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ghada Zamzmi , Sivaramakrishnan Rajaraman , Sameer Antani

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

There are many sources of interference encountered in the electroencephalogram (EEG) recordings, specifically ocular, muscular, and cardiac artifacts. Rejection of EEG artifacts is an essential process in EEG analysis since such artifacts…

Image and Video Processing · Electrical Eng. & Systems 2020-09-21 Najmeh Mashhadi , Abolfazl Zargari Khuzani , Morteza Heidari , Donya Khaledyan