English
Related papers

Related papers: Intrinsic Explainability of Multimodal Learning fo…

200 papers

Precise yield prediction is essential for agricultural sustainability and food security. However, climate change complicates accurate yield prediction by affecting major factors such as weather conditions, soil fertility, and farm…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Shalini Dangi , Surya Karthikeya Mullapudi , Chandravardhan Singh Raghaw , Shahid Shafi Dar , Mohammad Zia Ur Rehman , Nagendra Kumar

This study introduces RicEns-Net, a novel Deep Ensemble model designed to predict crop yields by integrating diverse data sources through multimodal data fusion techniques. The research focuses specifically on the use of synthetic aperture…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Akshay Dagadu Yewle , Laman Mirzayeva , Oktay Karakuş

Despite the remarkable empirical performance of Transformers, their theoretical understanding remains elusive. Here, we consider a deep multi-head self-attention network, that is closely related to Transformers yet analytically tractable.…

Machine Learning · Computer Science 2024-12-10 Lorenzo Tiberi , Francesca Mignacco , Kazuki Irie , Haim Sompolinsky

Most invariance-based self-supervised methods rely on single object-centric images (e.g., ImageNet images) for pretraining, learning features that invariant to geometric transformation. However, when images are not object-centric, the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Taeho Kim , Jong-Min Lee

In modern business processes, the amount of data collected has increased substantially in recent years. Because this data can potentially yield valuable insights, automated knowledge extraction based on process mining has been proposed,…

Machine Learning · Computer Science 2022-12-02 Riza Velioglu , Jan Philip Göpfert , André Artelt , Barbara Hammer

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Multimodal learning has witnessed remarkable advancements in recent years, particularly with the integration of attention-based models, leading to significant performance gains across a variety of tasks. Parallel to this progress, the…

Machine Learning · Computer Science 2026-04-28 Md Raisul Kibria , Sébastien Lafond , Janan Arslan

Deep learning techniques have been successfully deployed for automating plant stress identification and quantification. In recent years, there is a growing push towards training models that are interpretable -i.e. that justify their…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Koushik Nagasubramanian , Asheesh K. Singh , Arti Singh , Soumik Sarkar , Baskar Ganapathysubramanian

Wireless communications at high-frequency bands with large antenna arrays face challenges in beam management, which can potentially be improved by multimodality sensing information from cameras, LiDAR, radar, and GPS. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Yu Tian , Qiyang Zhao , Zine el abidine Kherroubi , Fouzi Boukhalfa , Kebin Wu , Faouzi Bader

Time series forecasting presents a significant challenge, particularly when its accuracy relies on external data sources rather than solely on historical values. This issue is prevalent in the financial sector, where the future behavior of…

Machine Learning · Computer Science 2024-03-22 Hajar Emami , Xuan-Hong Dang , Yousaf Shah , Petros Zerfos

Understanding and accurately predicting within-field spatial variability of crop yield play a key role in site-specific management of crop inputs such as irrigation water and fertilizer for optimized crop production. However, such a task is…

Machine Learning · Computer Science 2018-11-19 Long Nguyen , Jia Zhen , Zhe Lin , Hanxiang Du , Zhou Yang , Wenxuan Guo , Fang Jin

Explainability in yield prediction helps us fully explore the potential of machine learning models that are already able to achieve high accuracy for a variety of yield prediction scenarios. The data included for the prediction of yields…

Machine Learning · Computer Science 2023-04-17 Florian Huber , Hannes Engler , Anna Kicherer , Katja Herzog , Reinhard Töpfer , Volker Steinhage

Artificial intelligence for graphs has achieved remarkable success in modeling complex systems, ranging from dynamic networks in biology to interacting particle systems in physics. However, the increasingly heterogeneous graph datasets call…

Machine Learning · Computer Science 2023-01-25 Yasha Ektefaie , George Dasoulas , Ayush Noori , Maha Farhat , Marinka Zitnik

This study examines the generalization performance and interpretability of machine learning (ML) models used for predicting crop yield and yield anomalies in Germany's NUTS-3 regions. Using a high-quality, long-term dataset, the study…

Machine Learning · Computer Science 2025-12-18 Roland Baatz

We present an interpretability framework for unsupervised reinforcement learning (URL) agents, aimed at understanding how intrinsic motivation shapes attention, behavior, and representation learning. We analyze five agents DQN, RND, ICM,…

Machine Learning · Computer Science 2025-05-13 Shashwat Pandey

Multimodal learning seeks to utilize data from multiple sources to improve the overall performance of downstream tasks. It is desirable for redundancies in the data to make multimodal systems robust to missing or corrupted observations in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Large-scale crop yield estimation is, in part, made possible due to the availability of remote sensing data allowing for the continuous monitoring of crops throughout their growth cycle. Having this information allows stakeholders the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Saeed Khaki , Hieu Pham , Lizhi Wang

We propose a deep learning methodology for multivariate regression that is based on pattern recognition that triggers fast learning over sensor data. We used a conversion of sensors-to-image which enables us to take advantage of Computer…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jiztom Kavalakkatt Francis , Chandan Kumar , Jansel Herrera-Gerena , Kundan Kumar , Matthew J Darr

Recent advances in plant phenotyping have driven widespread adoption of multi sensor platforms for collecting crop canopy reflectance data. This includes the collection of heterogeneous data across multiple platforms, with Unmanned Aerial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Timilehin T. Ayanlade , Anirudha Powadi , Talukder Z. Jubery , Baskar Ganapathysubramanian , Soumik Sarkar

The study of the attribution of input features to the output of neural network models is an active area of research. While numerous Explainable AI (XAI) techniques have been proposed to interpret these models, the systematic and automated…

Computation and Language · Computer Science 2026-03-13 Aria Nourbakhsh , Salima Lamsiyah , Adelaide Danilov , Christoph Schommer