English
Related papers

Related papers: MFAS: Multimodal Fusion Architecture Search

200 papers

Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Current fusion methods are typically evaluated on a small selection of public datasets, a limited…

Machine Learning · Computer Science 2026-05-07 Leyan Xue , Changqing Zhang , Kecheng Xue , Xiaohong Liu , Guangyu Wang , Zongbo Han

Centralized training methods have shown promising results in MR image reconstruction, but privacy concerns arise when gathering data from multiple institutions. Federated learning, a distributed collaborative training scheme, can utilize…

Image and Video Processing · Electrical Eng. & Systems 2023-07-24 Ruoyou Wu , Cheng Li , Juan Zou , Shanshan Wang

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

Computation and Language · Computer Science 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the…

Machine Learning · Computer Science 2021-01-19 Yigit Alparslan , Ethan Jacob Moyer , Isamu Mclean Isozaki , Daniel Schwartz , Adam Dunlop , Shesh Dave , Edward Kim

Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Tue M. Cao , Nhat H. Tran , Hieu H. Pham , Hung T. Nguyen , Le P. Nguyen

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

Machine Learning · Computer Science 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Multi-modal feature fusion as a core investigative component of RGBT tracking emerges numerous fusion studies in recent years. However, existing RGBT tracking methods widely adopt fixed fusion structures to integrate multi-modal feature,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Andong Lu , Wanyu Wang , Chenglong Li , Jin Tang , Bin Luo

Almost all neural architecture search methods are evaluated in terms of performance (i.e. test accuracy) of the model structures that it finds. Should it be the only metric for a good autoML approach? To examine aspects beyond performance,…

Machine Learning · Computer Science 2020-03-04 Stefano Alletto , Shenyang Huang , Vincent Francois-Lavet , Yohei Nakata , Guillaume Rabusseau

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Cristian Cioflan , Radu Timofte

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

Machine Learning · Computer Science 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

Machine Learning · Computer Science 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

Multimodal human action understanding is a significant problem in computer vision, with the central challenge being the effective utilization of the complementarity among diverse modalities while maintaining model efficiency. However, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Heng Fei , Bingxuan Dai , Jie Gui

Image-text matching is a key multimodal task that aims to model the semantic association between images and text as a matching relationship. With the advent of the multimedia information age, image, and text data show explosive growth, and…

Machine Learning · Computer Science 2024-06-24 Jinyin Wang , Haijing Zhang , Yihao Zhong , Yingbin Liang , Rongwei Ji , Yiru Cang

The recent breakthroughs of Neural Architecture Search (NAS) have motivated various applications in medical image segmentation. However, most existing work either simply rely on hyper-parameter tuning or stick to a fixed network backbone,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-14 Xingang Yan , Weiwen Jiang , Yiyu Shi , Cheng Zhuo

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

Neural and Evolutionary Computing · Computer Science 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

This study presents a multisensory machine learning architecture for object recognition by employing a novel dataset that was constructed with the iCub robot, which is equipped with three cameras and a depth sensor. The proposed…

Robotics · Computer Science 2020-09-15 Murat Kirtay , Guido Schillaci , Verena V. Hafner

3D face alignment is a very challenging and fundamental problem in computer vision. Existing deep learning-based methods manually design different networks to regress either parameters of a 3D face model or 3D positions of face vertices.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Zhichao Jiang , Hongsong Wang , Xi Teng , Baopu Li

Developing neural models that accurately understand objects in 3D point clouds is essential for the success of robotics and autonomous driving. However, arguably due to the higher-dimensional nature of the data (as compared to images),…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Chenxi Liu , Zhaoqi Leng , Pei Sun , Shuyang Cheng , Charles R. Qi , Yin Zhou , Mingxing Tan , Dragomir Anguelov