English
Related papers

Related papers: Multi-StyleGAN: Towards Image-Based Simulation of …

200 papers

Lightweight deep learning models offer substantial reductions in computational cost and environmental impact, making them crucial for scientific applications. We present a lightweight CycleGAN for modality transfer in fluorescence…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Mohammad Soltaninezhad , Yashar Rouzbahani , Jhonatan Contreras , Rohan Chippalkatti , Daniel Kwaku Abankwa , Christian Eggeling , Thomas Bocklitz

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches rely on spatial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kaihang Pan , Wang Lin , Zhongqi Yue , Tenglong Ao , Liyu Jia , Wei Zhao , Juncheng Li , Siliang Tang , Hanwang Zhang

The use of accurate scanning transmission electron microscopy (STEM) image simulation methods require large computation times that can make their use infeasible for the simulation of many images. Other simulation methods based on linear…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Nick Lawrence , Mingren Shen , Ruiqi Yin , Cloris Feng , Dane Morgan

Compressive Macroscopic Fluorescence Lifetime Imaging (MFLI) is a novel technical implementation that enables monitoring multiple molecular interactions in macroscopic scale. Especially, we reported recently on the development of a…

Medical Physics · Physics 2018-02-23 Ruoyang Yao , Marien Ochoa , Xavier Intes , Pingkun Yan

Despite recent success in conditional image synthesis, prevalent input conditions such as semantics and edges are not clear enough to express `Linear (Ridges)' and `Planar (Scale)' representations. To address this problem, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Gunhee Lee , Jonghwa Yim , Chanran Kim , Minjae Kim

In recent years, the use of Generative Adversarial Networks (GANs) has become very popular in generative image modeling. While style-based GAN architectures yield state-of-the-art results in high-fidelity image synthesis, computationally,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Sergei Belousov

We present a new technique for obtaining simultaneous multimodal quantitative phase and fluorescence microscopy of biological cells, providing both quantitative phase imaging and molecular specificity using a single camera. Our system is…

Optics · Physics 2019-04-03 Yoav N. Nygate , Gyanendra Singh , Itay Barnea , Natan T. Shaked

In many applications of finance, biology and sociology, complex systems involve entities interacting with each other. These processes have the peculiarity of evolving over time and of comprising latent factors, which influence the system…

Machine Learning · Statistics 2018-08-03 Federico Tomasi , Veronica Tozzo , Saverio Salzo , Alessandro Verri

In silico, cell based approaches for modeling biological morphogenesis are used to test and validate our understanding of the biological and mechanical process that are at work during the growth and the organization of multi-cell tissues.…

Biological Physics · Physics 2026-01-06 Raphaël Conradin , Christophe Coreixas , Jonas Latt , Bastien Chopard

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Umut Kocasari , Alara Dirik , Mert Tiftikci , Pinar Yanardag

We propose a general framework for a collaborative machine learning system to assist bioscience researchers with the task of labeling specific cell identities from microscopic still or video imaging. The distinguishing features of this…

Quantitative Methods · Quantitative Biology 2019-03-25 Greg Bubnis , Steven Ban , Matthew D. DiFranco , Saul Kato

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

Multiplex brightfield imaging offers the advantage of simultaneously analyzing multiple biomarkers on a single slide, as opposed to single biomarker labeling on multiple consecutive slides. To accurately analyze multiple biomarkers…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Satarupa Mukherjee , Jim Martin , Yao Nie

In this paper, we propose $\tau$GAN a tensor-based method for modeling the latent space of generative models. The objective is to identify semantic directions in latent space. To this end, we propose to fit a multilinear tensor model on a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 René Haas , Stella Graßhof , Sami Sebastian Brandt

Visualizing the details of different cellular structures is of great importance to elucidate cellular functions. However, it is challenging to obtain high quality images of different structures directly due to complex cellular environments.…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Yi Liu , Hao Yuan , Zhengyang Wang , Shuiwang Ji

In spite of being a valuable tool to simultaneously visualize multiple types of subcellular structures using spectrally distinct fluorescent labels, a standard fluoresce microscope is only able to identify a few microscopic objects; such a…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Yang Jiao , Mei Yang , Mo Weng

Time-resolved scanning probe microscopy methods, like time-resolved electrostatic force microscopy (trEFM), enable imaging of dynamic processes ranging from ion motion in batteries to electronic dynamics in microstructured thin film…

Materials Science · Physics 2025-02-07 Madeleine D. Breshears , Rajiv Giridharagopal , David S. Ginger

For the past few years, deep generative models have increasingly been used in biological research for a variety of tasks. Recently, they have proven to be valuable for uncovering subtle cell phenotypic differences that are not directly…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Anis Bourou , Thomas Boyer , Kévin Daupin , Véronique Dubreuil , Aurélie De Thonel , Valérie Mezger , Auguste Genovesio

Unconstrained Image generation with high realism is now possible using recent Generative Adversarial Networks (GANs). However, it is quite challenging to generate images with a given set of attributes. Recent methods use style-based GAN…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Rishubh Parihar , Ankit Dhiman , Tejan Karmali , R. Venkatesh Babu

This thesis centres on the development of multidimensional fluorescence imaging tools, with a particular emphasis on fluorescence lifetime imaging (FLIM) microscopy for application to biological research. The key aspects of this thesis are…

Instrumentation and Detectors · Physics 2017-08-14 Egidijus Auksorius