English
Related papers

Related papers: Transformer-based Parameter Fitting of Models deri…

200 papers

Objective: Transformers, born to remedy the inadequate receptive fields of CNNs, have drawn explosive attention recently. However, the daunting computational complexity of global representation learning, together with rigid window…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Xian Lin , Li Yu , Kwang-Ting Cheng , Zengqiang Yan

Multimodal fusion and multitask learning are two vital topics in machine learning. Despite the fruitful progress, existing methods for both problems are still brittle to the same challenge -- it remains dilemmatic to integrate the common…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yikai Wang , Fuchun Sun , Wenbing Huang , Fengxiang He , Dacheng Tao

Exoplanet observations are currently analysed with Bayesian retrieval techniques. Due to the computational load of the models used, a compromise is needed between model complexity and computing time. Analysis of data from future facilities,…

Earth and Planetary Astrophysics · Physics 2022-06-29 Francisco Ardevol Martinez , Michiel Min , Inga Kamp , Paul I. Palmer

Treatment effect estimation, which refers to the estimation of causal effects and aims to measure the strength of the causal relationship, is of great importance in many fields but is a challenging problem in practice. As present,…

Machine Learning · Computer Science 2021-07-20 Zhenyu Guo , Shuai Zheng , Zhizhe Liu , Kun Yan , Zhenfeng Zhu

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Purpose: To understand the influence of various acquisition parameters on the ability of CEST MR-Fingerprinting (MRF) to discriminate different chemical exchange parameters and to provide tools for optimal acquisition schedule design and…

Medical Physics · Physics 2019-11-04 Or Perlman , Kai Herz , Moritz Zaiss , Ouri Cohen , Matthew S. Rosen , Christian T. Farrar

Transformers have become methods of choice in many applications thanks to their ability to represent complex interactions between elements. However, extending the Transformer architecture to non-sequential data such as molecules and…

Machine Learning · Computer Science 2022-04-27 Yoni Choukroun , Lior Wolf

Chemical Species Tomography (CST) has been widely used for in situ imaging of critical parameters, e.g. species concentration and temperature, in reactive flows. However, even with state-of-the-art computational algorithms the method is…

Image and Video Processing · Electrical Eng. & Systems 2021-04-06 Yunfan Jiang , Jingjing Si , Rui Zhang , Godwin Enemali , Bin Zhou , Hugh McCann , Chang Liu

Transformers, adapted from natural language processing, are emerging as a leading approach for graph representation learning. Contemporary graph transformers often treat nodes or edges as separate tokens. This approach leads to…

Machine Learning · Computer Science 2023-10-04 Zihan Pengmei , Zimu Li , Chih-chan Tien , Risi Kondor , Aaron R. Dinner

Detecting and quantifying products of cellular metabolism using Mass Spectrometry (MS) has already shown great promise in many biological and biomedical applications. The biggest challenge in metabolomics is annotation, where measured…

Machine Learning · Computer Science 2020-10-12 Hao Zhu , Liping Liu , Soha Hassoun

We introduce the Convolutional Set Transformer (CST), a novel neural architecture designed to process image sets of arbitrary cardinality that are visually heterogeneous yet share high-level semantics - such as a common category, scene, or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Federico Chinello , Giacomo Boracchi

The emergence of deep learning has significantly enhanced the analysis of electrocardiograms (ECGs), a non-invasive method that is essential for assessing heart health. Despite the complexity of ECG interpretation, advanced deep learning…

Machine Learning · Computer Science 2023-06-05 Zibin Zhao

Chemical representation learning has gained increasing interest due to the limited availability of supervised data in fields such as drug and materials design. This interest particularly extends to chemical language representation learning,…

Chemical Physics · Physics 2024-08-06 Jun-Hyung Park , Yeachan Kim , Mingyu Lee , Hyuntae Park , SangKeun Lee

We present SMILES-embeddings derived from the internal encoder state of a Transformer [1] model trained to canonize SMILES as a Seq2Seq problem. Using a CharNN [2] architecture upon the embeddings results in higher quality interpretable…

Quantitative Methods · Quantitative Biology 2020-09-23 Pavel Karpov , Guillaume Godin , Igor V. Tetko

In chemometrics, data from infrared or near-infrared (NIR) spectroscopy are often used to identify a compound or to analyze the composition of amaterial. This involves the calibration of models that predict the concentration ofmaterial…

Neural and Evolutionary Computing · Computer Science 2015-03-20 A. Ukil , J. Bernasconi

Diffusion magnetic resonance imaging (dMRI) is an important tool in characterizing tissue microstructure based on biophysical models, which are complex and highly non-linear. Resolving microstructures with optimization techniques is prone…

Signal Processing · Electrical Eng. & Systems 2022-05-16 Tianshu Zheng , Cong Sun , Weihao Zheng , Wen Shi , Haotian Li , Yi Sun , Yi Zhang , Guangbin Wang , Chuyang Ye , Dan Wu

The shape of a molecule determines its physicochemical and biological properties. However, it is often underrepresented in standard molecular representation learning approaches. Here, we propose using the Euler Characteristic Transform…

Machine Learning · Computer Science 2025-07-08 Victor Toscano-Duran , Florian Rottach , Bastian Rieck

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

In this paper, we propose a Computer Assisted Diagnosis (CAD) system based on a deep Convolutional Neural Network (CNN) model, to build an end-to-end learning process that classifies breast mass lesions. We investigate the impact that has…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Hiba Chougrad , Hamid Zouaki , Omar Alheyane

Deep transfer learning using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown strong predictive power in characterization of breast lesions. However, pretrained convolutional neural networks (CNNs) require 2D inputs,…

Medical Physics · Physics 2019-11-11 Qiyuan Hu , Heather M. Whitney , Maryellen L. Giger