English
Related papers

Related papers: From Embeddings to Accuracy: Comparing Foundation …

200 papers

In recent years, the embedding approach for solving switched optimal control problems has been developed in a series of papers. However, the embedding approach, which advantageously converts the hybrid optimal control problem to a classical…

Optimization and Control · Mathematics 2018-04-04 Richard Meyer , Miloš Žefran , Raymond A. DeCarlo

This study presents a validation and extension of a recent methodological framework for medical image classification. While an improved ConvNeXt Tiny architecture, integrating Global Average and Max Pooling fusion (GAGM), lightweight…

Image and Video Processing · Electrical Eng. & Systems 2025-12-09 Fariza Dahes

Cloud segmentation is a critical challenge in remote sensing image interpretation, as its accuracy directly impacts the effectiveness of subsequent data processing and analysis. Recently, vision foundation models (VFM) have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xuechao Zou , Shun Zhang , Kai Li , Shiying Wang , Junliang Xing , Lei Jin , Congyan Lang , Pin Tao

Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Jing Hu , Kaiwei Yu , Hongjiang Xian , Shu Hu , Xin Wang

Deep learning has been a successful model which can effectively represent several features of input space and remarkably improve image recognition performance on the deep architectures. In our research, an adaptive structural learning…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Shin Kamada , Takumi Ichimura

Autoencoders have been recently used for encoding medical images. In this study, we design and validate a new framework for retrieving medical images by classifying Radon projections, compressed in the deepest layer of an autoencoder. As…

Computer Vision and Pattern Recognition · Computer Science 2017-10-04 Aditya Sriram , Shivam Kalra , H. R. Tizhoosh , Shahryar Rahnamayan

Radiological images such as computed tomography (CT) and X-rays render anatomy with intrinsic structures. Being able to reliably locate the same anatomical structure across varying images is a fundamental task in medical image analysis. In…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ke Yan , Jinzheng Cai , Dakai Jin , Shun Miao , Dazhou Guo , Adam P. Harrison , Youbao Tang , Jing Xiao , Jingjing Lu , Le Lu

Vision Foundation Models (VFMs) pretrained on large-scale RGB data have demonstrated remarkable representation quality, yet their applicability to multispectral imaging spanning Near-Infrared (NIR), Short-Wave Infrared (SWIR), and Long-Wave…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yagiz Nalcakan , Hyeongjin Ju , Incheol Park , Sanghyeop Yeo , Youngwan Jin , Shiho Kim

Implanted devices providing real-time neural activity classification and control are increasingly used to treat neurological disorders, such as epilepsy and Parkinson's disease. Classification performance is critical to identifying brain…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Xilin Liu , Andrew G. Richardson

Video-based assessments offer a scalable pathway for remote Parkinson's disease (PD) screening. While traditional approaches rely on handcrafted features mimicking clinical scales, recent advances in video foundation models (VFMs) enable…

Learning embedding functions, which map semantically related inputs to nearby locations in a feature space supports a variety of classification and information retrieval tasks. In this work, we propose a novel, generalizable and fast method…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Hong Xuan , Richard Souvenir , Robert Pless

The quality of diabetic retinopathy (DR) screening relies on the ability to correctly grade severity; however, many deep-learning (DL) classifiers cannot be easily interpreted in the clinical context. This study presents a methodology that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Pir Bakhsh Khokhar , Carmine Gravino , Fabio Palomba , Sule Yildirim Yayilgan , Sarang Shaikh

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

In recent years, deep learning has rapidly become a method of choice for the segmentation of medical images. Deep Neural Network (DNN) architectures such as UNet have achieved state-of-the-art results on many medical datasets. To further…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Truong Dang , Tien Thanh Nguyen , John McCall , Eyad Elyan , Carlos Francisco Moreno-García

Deep learning based recommendation models (DLRM) are widely used in several business critical applications. Training such recommendation models efficiently is challenging because they contain billions of embedding-based parameters, leading…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-02 Saurabh Agarwal , Chengpo Yan , Ziyi Zhang , Shivaram Venkataraman

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various architectures, from vision transformers (ViTs) to convolutional networks (ResNets) have been trained with CLIP to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Cristian Rodriguez-Opazo , Ehsan Abbasnejad , Damien Teney , Hamed Damirchi , Edison Marrese-Taylor , Anton van den Hengel

Single-molecule localization microscopy (SMLM) surpasses the diffraction limit, achieving subcellular resolution. Traditional SMLM analysis methods often rely on point spread function (PSF) model fitting, limiting the application of complex…

Quantitative Methods · Quantitative Biology 2024-10-04 Tingdan Luo

Conventional and deep learning-based methods have shown great potential in the medical imaging domain, as means for deriving diagnostic, prognostic, and predictive biomarkers, and by contributing to precision medicine. However, these…

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu