English
Related papers

Related papers: COM3D: Leveraging Cross-View Correspondence and Cr…

200 papers

Recent LiDAR-based 3D Object Detection (3DOD) methods show promising results, but they often do not generalize well to target domains outside the source (or training) data distribution. To reduce such domain gaps and thus to make 3DOD…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Gyusam Chang , Wonseok Roh , Sujin Jang , Dongwook Lee , Daehyun Ji , Gyeongrok Oh , Jinsun Park , Jinkyu Kim , Sangpil Kim

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

Multimedia · Computer Science 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

Cross-modality retrieval encompasses retrieval tasks where the fetched items are of a different type than the search query, e.g., retrieving pictures relevant to a given text query. The state-of-the-art approach to cross-modality retrieval…

Information Retrieval · Computer Science 2018-04-17 Matthias Dorfer , Jan Schlüter , Andreu Vall , Filip Korzeniowski , Gerhard Widmer

Given the benefits of its low storage requirements and high retrieval efficiency, hashing has recently received increasing attention. In particular,cross-modal hashing has been widely and successfully used in multimedia similarity search…

Information Retrieval · Computer Science 2019-04-05 Cheng Deng , Zhaojia Chen , Xianglong Liu , Xinbo Gao , Dacheng Tao

Convolutional Neural Networks (CNNs) have emerged as a powerful strategy for most object detection tasks on 2D images. However, their power has not been fully realised for detecting 3D objects in point clouds directly without converting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Mingtao Feng , Syed Zulqarnain Gilani , Yaonan Wang , Liang Zhang , Ajmal Mian

In this work, we present a conceptually simple yet effective framework for cross-modality 3D object detection, named voxel field fusion. The proposed approach aims to maintain cross-modality consistency by representing and fusing augmented…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yanwei Li , Xiaojuan Qi , Yukang Chen , Liwei Wang , Zeming Li , Jian Sun , Jiaya Jia

The size of 3D models used on the web or stored in databases is becoming increasingly high. Then, an efficient method that allows users to find similar 3D objects for a given 3D model query has become necessary. Keywords and the geometry of…

Information Retrieval · Computer Science 2011-11-29 My Abdellah Kassimi , Omar El beqqali

Vision foundation models, particularly the ViT family, have revolutionized image understanding by providing rich semantic features. However, despite their success in 2D comprehension, their abilities on grasping 3D spatial relationships are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yang You , Yixin Li , Congyue Deng , Yue Wang , Leonidas Guibas

Multi-modal 3D scene understanding has gained considerable attention due to its wide applications in many areas, such as autonomous driving and human-computer interaction. Compared to conventional single-modal 3D understanding, introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Yinjie Lei , Zixuan Wang , Feng Chen , Guoqing Wang , Peng Wang , Yang Yang

Image-text matching (ITM) is a fundamental problem in computer vision. The key issue lies in jointly learning the visual and textual representation to estimate their similarity accurately. Most existing methods focus on feature enhancement…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xuri Ge , Fuhai Chen , Songpei Xu , Fuxiang Tao , Jie Wang , Joemon M. Jose

Estimating correspondences between deformed shape instances is a long-standing problem in computer graphics; numerous applications, from texture transfer to statistical modelling, rely on recovering an accurate correspondence map. Many…

We present a method for generating colored 3D shapes from natural language. To this end, we first learn joint embeddings of freeform text descriptions and colored 3D shapes. Our model combines and extends learning by association and metric…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Kevin Chen , Christopher B. Choy , Manolis Savva , Angel X. Chang , Thomas Funkhouser , Silvio Savarese

Image-based object pose estimation sounds amazing because in real applications the shape of object is oftentimes not available or not easy to take like photos. Although it is an advantage to some extent, un-explored shape information in 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Zhidan Liu , Zhen Xing , Xiangdong Zhou , Yijiang Chen , Guichun Zhou

3D visual grounding involves finding a target object in a 3D scene that corresponds to a given sentence query. Although many approaches have been proposed and achieved impressive performance, they all require dense object-sentence pair…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Zehan Wang , Haifeng Huang , Yang Zhao , Linjun Li , Xize Cheng , Yichen Zhu , Aoxiong Yin , Zhou Zhao

Visual semantic correspondence is an important topic in computer vision and could help machine understand objects in our daily life. However, most previous methods directly train on correspondences in 2D images, which is end-to-end but…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Yang You , Chengkun Li , Yujing Lou , Zhoujun Cheng , Lizhuang Ma , Cewu Lu , Weiming Wang

Cross-modal retrieval aims to retrieve data in one modality by a query in another modality, which has been a very interesting research issue in the field of multimedia, information retrieval, and computer vision, and database. Most existing…

Multimedia · Computer Science 2021-05-06 Donghuo Zeng , Yi Yu , Keizo Oyama

Cross-modal retrieval aims to retrieve relevant data across different modalities (e.g., texts vs. images). The common strategy is to apply element-wise constraints between manually labeled pair-wise items to guide the generators to learn…

Multimedia · Computer Science 2019-04-18 Xin Wen , Zhizhong Han , Xinyu Yin , Yu-Shen Liu

Domain adaptation is critical for success when confronting with the lack of annotations in a new domain. As the huge time consumption of labeling process on 3D point cloud, domain adaptation for 3D semantic segmentation is of great…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Duo Peng , Yinjie Lei , Wen Li , Pingping Zhang , Yulan Guo

With the rise of large-scale models trained on broad data, in-context learning has become a new learning paradigm that has demonstrated significant potential in natural language processing and computer vision tasks. Meanwhile, in-context…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Zhongbin Fang , Xiangtai Li , Xia Li , Joachim M. Buhmann , Chen Change Loy , Mengyuan Liu

Training models to apply common-sense linguistic knowledge and visual concepts from 2D images to 3D scene understanding is a promising direction that researchers have only recently started to explore. However, it still remains understudied…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Alexandros Delitzas , Maria Parelli , Nikolas Hars , Georgios Vlassis , Sotirios Anagnostidis , Gregor Bachmann , Thomas Hofmann