中文
相关论文

相关论文: MFAS: Multimodal Fusion Architecture Search

200 篇论文

Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Current fusion methods are typically evaluated on a small selection of public datasets, a limited…

机器学习 · 计算机科学 2026-05-07 Leyan Xue , Changqing Zhang , Kecheng Xue , Xiaohong Liu , Guangyu Wang , Zongbo Han

Centralized training methods have shown promising results in MR image reconstruction, but privacy concerns arise when gathering data from multiple institutions. Federated learning, a distributed collaborative training scheme, can utilize…

图像与视频处理 · 电气工程与系统科学 2023-07-24 Ruoyou Wu , Cheng Li , Juan Zou , Shanshan Wang

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

计算与语言 · 计算机科学 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the…

Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Tue M. Cao , Nhat H. Tran , Hieu H. Pham , Hung T. Nguyen , Le P. Nguyen

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

机器学习 · 计算机科学 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Multi-modal feature fusion as a core investigative component of RGBT tracking emerges numerous fusion studies in recent years. However, existing RGBT tracking methods widely adopt fixed fusion structures to integrate multi-modal feature,…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Andong Lu , Wanyu Wang , Chenglong Li , Jin Tang , Bin Luo

Almost all neural architecture search methods are evaluated in terms of performance (i.e. test accuracy) of the model structures that it finds. Should it be the only metric for a good autoML approach? To examine aspects beyond performance,…

机器学习 · 计算机科学 2020-03-04 Stefano Alletto , Shenyang Huang , Vincent Francois-Lavet , Yohei Nakata , Guillaume Rabusseau

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

机器学习 · 计算机科学 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

机器学习 · 计算机科学 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

Multimodal human action understanding is a significant problem in computer vision, with the central challenge being the effective utilization of the complementarity among diverse modalities while maintaining model efficiency. However, most…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Hongsong Wang , Heng Fei , Bingxuan Dai , Jie Gui

Image-text matching is a key multimodal task that aims to model the semantic association between images and text as a matching relationship. With the advent of the multimedia information age, image, and text data show explosive growth, and…

机器学习 · 计算机科学 2024-06-24 Jinyin Wang , Haijing Zhang , Yihao Zhong , Yingbin Liang , Rongwei Ji , Yiru Cang

The recent breakthroughs of Neural Architecture Search (NAS) have motivated various applications in medical image segmentation. However, most existing work either simply rely on hyper-parameter tuning or stick to a fixed network backbone,…

图像与视频处理 · 电气工程与系统科学 2020-07-14 Xingang Yan , Weiwen Jiang , Yiyu Shi , Cheng Zhuo

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

计算机视觉与模式识别 · 计算机科学 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

神经与进化计算 · 计算机科学 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

This study presents a multisensory machine learning architecture for object recognition by employing a novel dataset that was constructed with the iCub robot, which is equipped with three cameras and a depth sensor. The proposed…

机器人学 · 计算机科学 2020-09-15 Murat Kirtay , Guido Schillaci , Verena V. Hafner

3D face alignment is a very challenging and fundamental problem in computer vision. Existing deep learning-based methods manually design different networks to regress either parameters of a 3D face model or 3D positions of face vertices.…

计算机视觉与模式识别 · 计算机科学 2024-06-13 Zhichao Jiang , Hongsong Wang , Xi Teng , Baopu Li

Developing neural models that accurately understand objects in 3D point clouds is essential for the success of robotics and autonomous driving. However, arguably due to the higher-dimensional nature of the data (as compared to images),…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Chenxi Liu , Zhaoqi Leng , Pei Sun , Shuyang Cheng , Charles R. Qi , Yin Zhou , Mingxing Tan , Dragomir Anguelov