English
Related papers

Related papers: Deep Learning-Driven Multimodal Detection and Move…

200 papers

Since 2006, deep learning (DL) has become a rapidly growing research direction, redefining state-of-the-art performances in a wide range of areas such as object recognition, image segmentation, speech recognition and machine translation. In…

Machine Learning · Computer Science 2016-12-23 Rui Zhao , Ruqiang Yan , Zhenghua Chen , Kezhi Mao , Peng Wang , Robert X. Gao

Most design methods contain a forward framework, asking for primary specifications of a building to generate an output or assess its performance. However, architects urge for specific objectives though uncertain of the proper design…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Zohreh Shaghaghian , Wei Yan

Large Language Models (LLMs) have been shown to act like planners that can decompose high-level instructions into a sequence of executable instructions. However, current LLM-based planners are only able to operate with a fixed set of…

Robotics · Computer Science 2023-10-25 Meenal Parakh , Alisha Fong , Anthony Simeonov , Tao Chen , Abhishek Gupta , Pulkit Agrawal

An important task that domestic robots need to achieve is the recognition of states of food ingredients so they can continue their cooking actions. This project focuses on a fine-tuning algorithm for the VGG (Visual Geometry Group)…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Juan Wilches

The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models.Nevertheless, the sheer model size…

Computation and Language · Computer Science 2024-07-30 Shilin Xu , Xiangtai Li , Haobo Yuan , Lu Qi , Yunhai Tong , Ming-Hsuan Yang

Human activity recognition using smart home sensors is one of the bases of ubiquitous computing in smart environments and a topic undergoing intense research in the field of ambient assisted living. The increasingly large amount of data…

Neural and Evolutionary Computing · Computer Science 2018-04-20 Deepika Singh , Erinc Merdivan , Ismini Psychoula , Johannes Kropf , Sten Hanke , Matthieu Geist , Andreas Holzinger

MATLAB(R) releases over the last 3 years have witnessed a continuing growth in the dynamic modeling capabilities offered by the System Identification Toolbox(TM). The emphasis has been on integrating deep learning architectures and training…

Machine Learning · Computer Science 2024-09-13 Tianyu Dai , Khaled Aljanaideh , Rong Chen , Rajiv Singh , Alec Stothert , Lennart Ljung

Dynamic Movement Primitives (DMPs) provide a flexible framework wherein smooth robotic motions are encoded into modular parameters. However, they face challenges in integrating multimodal inputs commonly used in robotics like vision and…

Understanding food recipe requires anticipating the implicit causal effects of cooking actions, such that the recipe can be converted into a graph describing the temporal workflow of the recipe. This is a non-trivial task that involves…

Computation and Language · Computer Science 2020-08-24 Liangming Pan , Jingjing Chen , Jianlong Wu , Shaoteng Liu , Chong-Wah Ngo , Min-Yen Kan , Yu-Gang Jiang , Tat-Seng Chua

Autonomous aerial monitoring is an important task aimed at gathering information from areas that may not be easily accessible by humans. At the same time, this task often requires recognizing anomalies from a significant distance or not…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tzoulio Chamiti , Nikolaos Passalis , Anastasios Tefas

In this paper, a level-wise mixture model (LMM) is developed by embedding visual hierarchy with deep networks to support large-scale visual recognition (i.e., recognizing thousands or even tens of thousands of object classes), and a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Tianyi Zhao , Baopeng Zhang , Wei Zhang , Ning Zhou , Jun Yu , Jianping Fan

Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection methods are built on handcrafted features and shallow trainable…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhong-Qiu Zhao , Peng Zheng , Shou-tao Xu , Xindong Wu

The continually increasing number of complex datasets each year necessitates ever improving machine learning methods for robust and accurate categorization of these data. This paper introduces Random Multimodel Deep Learning (RMDL): a new…

Machine Learning · Computer Science 2018-06-01 Kamran Kowsari , Mojtaba Heidarysafa , Donald E. Brown , Kiana Jafari Meimandi , Laura E. Barnes

Object detection is one of the most important and challenging branches of computer vision, which has been widely applied in peoples life, such as monitoring security, autonomous driving and so on, with the purpose of locating instances of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Licheng Jiao , Fan Zhang , Fang Liu , Shuyuan Yang , Lingling Li , Zhixi Feng , Rong Qu

Object detection is a crucial component in autonomous vehicle systems. It enables the vehicle to perceive and understand its environment by identifying and locating various objects around it. By utilizing advanced imaging and deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Bsher Karbouj , Adam Michael Altenbuchner , Joerg Krueger

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Increased biosecurity and food safety requirements may increase demand for efficient traceability and identification systems of livestock in the supply chain. The advanced technologies of machine learning and computer vision have been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Md Ekramul Hossain , Muhammad Ashad Kabir , Lihong Zheng , Dave L. Swain , Shawn McGrath , Jonathan Medway

This study explores the utility of various internet data sources to select among a set of template robot behaviors to perform skills. Learning contact-rich skills involving tool use from internet data sources has typically been challenging…

Robotics · Computer Science 2024-09-24 Mrinal Verghese , Christopher Atkeson

Vision-Language Pretraining (VLP) and Foundation models have been the go-to recipe for achieving SoTA performance on general benchmarks. However, leveraging these powerful techniques for more complex vision-language tasks, such as cooking…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Mustafa Shukor , Nicolas Thome , Matthieu Cord

The ability to recognize various food-items in a generic food plate is a key determinant for an automated diet assessment system. This study motivates the need for automated diet assessment and proposes a framework to achieve this. Within…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Rameez Ismail , Zhaorui Yuan