English
Related papers

Related papers: Rethinking Cooking State Recognition with Vision T…

200 papers

We study a crucial yet often overlooked issue inherent to Vision Transformers (ViTs): feature maps of these models exhibit grid-like artifacts, which hurt the performance of ViTs in downstream dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiawei Yang , Katie Z Luo , Jiefeng Li , Congyue Deng , Leonidas Guibas , Dilip Krishnan , Kilian Q Weinberger , Yonglong Tian , Yue Wang

Food image classification systems play a crucial role in health monitoring and diet tracking through image-based dietary assessment techniques. However, existing food recognition systems rely on static datasets characterized by a…

Image and Video Processing · Electrical Eng. & Systems 2024-04-12 Justin Yang , Zhihao Duan , Jiangpeng He , Fengqing Zhu

Recent advancements in medical image analysis have predominantly relied on Convolutional Neural Networks (CNNs), achieving impressive performance in chest X-ray classification tasks, such as the 92% AUC reported by AutoThorax-Net and the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Baljinnyam Dayan

In this paper, we study the novel problem of not only predicting ingredients from a food image, but also predicting the relative amounts of the detected ingredients. We propose two prediction-based models using deep learning that output…

Machine Learning · Computer Science 2019-10-02 Jiatong Li , Ricardo Guerrero , Vladimir Pavlovic

Recent self-supervised learning (SSL) methods have shown impressive results in learning visual representations from unlabeled images. This paper aims to improve their performance further by utilizing the architectural advantages of the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Hankook Lee , Jaehyung Kim , Jinwoo Shin

Remote sensing imagery plays a crucial role in many applications and requires accurate computerized classification techniques. Reliable classification is essential for transforming raw imagery into structured and usable information. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Niful Islam , Md. Rayhan Ahmed , Nur Mohammad Fahad , Salekul Islam , A. K. M. Muzahidul Islam , Saddam Mukta , Swakkhar Shatabda

Recent advances in artificial intelligence promote a wide range of computer vision applications in many different domains. Digital cameras, acting as human eyes, can perceive fundamental object properties, such as shapes and colors, and can…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Swarna Sethu , Dongyi Wang

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

Currently, domestic service robots have an insufficient ability to interact naturally through language. This is because understanding human instructions is complicated by various ambiguities and missing information. In existing methods, the…

Robotics · Computer Science 2021-07-05 Shintaro Ishikawa , Komei Sugiura

With the ongoing increase in the worldwide population and escalating consumption habits,there's a surge in the amount of waste produced.The situation poses considerable challenges for waste management and the optimization of recycling…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zhanshan Qiao

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

This paper investigates two techniques for developing efficient self-supervised vision transformers (EsViT) for visual representation learning. First, we show through a comprehensive empirical study that multi-stage architectures with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Chunyuan Li , Jianwei Yang , Pengchuan Zhang , Mei Gao , Bin Xiao , Xiyang Dai , Lu Yuan , Jianfeng Gao

This paper presents a study on improving human action recognition through the utilization of knowledge distillation, and the combination of CNN and ViT models. The research aims to enhance the performance and efficiency of smaller student…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hamid Ahmadabadi , Omid Nejati Manzari , Ahmad Ayatollahi

Vision Transformers have attracted a lot of attention recently since the successful implementation of Vision Transformer (ViT) on vision tasks. With vision Transformers, specifically the multi-head self-attention modules, networks can…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Xiangyu Chen , Ying Qin , Wenju Xu , Andrés M. Bur , Cuncong Zhong , Guanghui Wang

We present a simple approach to make pre-trained Vision Transformers (ViTs) interpretable for fine-grained analysis, aiming to identify and localize the traits that distinguish visually similar categories, such as bird species. Pre-trained…

In response to the increasing demand for efficient and non-invasive methods to estimate food weight, this paper presents a vision-based approach utilizing 2D images. The study employs a dataset of 2380 images comprising fourteen different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Chathura Wimalasiri , Prasan Kumar Sahoo

Breast cancer is a major global health issue that affects millions of women worldwide. Classification of breast cancer as early and accurately as possible is crucial for effective treatment and enhanced patient outcomes. Deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Prudence Djagba , J. K. Buwa Mbouobda

Direct computer vision based-nutrient content estimation is a demanding task, due to deformation and occlusions of ingredients, as well as high intra-class and low inter-class variability between meal classes. In order to tackle these…

Information Retrieval · Computer Science 2019-11-06 Matthias Fontanellaz , Stergios Christodoulidis , Stavroula Mougiakakou

Pretrained models are ubiquitous in the current deep learning landscape, offering strong results on a broad range of tasks. Recent works have shown that models differing in various design choices exhibit categorically diverse generalization…

Machine Learning · Computer Science 2025-10-28 Siddharth Jain , Shyamgopal Karthik , Vineet Gandhi