Medizinische Universität Graz Austria/Österreich - Forschungsportal - Medical University of Graz
Gewählte Publikation:
SHR Neuro Krebs Kardio Lipid Stoffw Microb
Payer, C; Štern, D; Feiner, M; Bischof, H; Urschler, M.
Segmenting and tracking cell instances with cosine embeddings and recurrent hourglass networks.
Med Image Anal. 2019; 57:106-119
Doi: 10.1016/j.media.2019.06.015
[OPEN ACCESS]
Web of Science
PubMed
FullText
FullText_MUG
- Führende Autor*innen der Med Uni Graz
- Urschler Martin
- Co-Autor*innen der Med Uni Graz
- Feiner Marlies
- Stern Darko
- Altmetrics:
- Dimensions Citations:
- Plum Analytics:
- Scite (citation analytics):
- Abstract:
- Differently to semantic segmentation, instance segmentation assigns unique labels to each individual instance of the same object class. In this work, we propose a novel recurrent fully convolutional network architecture for tracking such instance segmentations over time, which is highly relevant, e.g., in biomedical applications involving cell growth and migration. Our network architecture incorporates convolutional gated recurrent units (ConvGRU) into a stacked hourglass network to utilize temporal information, e.g., from microscopy videos. Moreover, we train our network with a novel embedding loss based on cosine similarities, such that the network predicts unique embeddings for every instance throughout videos, even in the presence of dynamic structural changes due to mitosis of cells. To create the final tracked instance segmentations, the pixel-wise embeddings are clustered among subsequent video frames by using the mean shift algorithm. After showing the performance of the instance segmentation on a static in-house dataset of muscle fibers from H&E-stained microscopy images, we also evaluate our proposed recurrent stacked hourglass network regarding instance segmentation and tracking performance on six datasets from the ISBI celltracking challenge, where it delivers state-of-the-art results. Copyright © 2019 The Author(s). Published by Elsevier B.V. All rights reserved.
- Find related publications in this database (Keywords)
- Cell
- Tracking
- Segmentation
- Instances
- Recurrent
- Video
- Embeddings