Medical Image Computing Research

End-to-end Deep Learning Architecture


Current Medical Image Analysis approaches often comprise a set of separate processing steps such as Registration, Normalization, Segmentation, Feature Extraction and Classification. This project develops techniques for the integration of these components into one end-to-end deep learning architecture. This enables simultaneous optimization of all component w.r.t the ultimate clinical task (e.g. disease classification).  

 -> Paul Jäger 

Machine Learning-based dMRI Processing


This project deals with processing, analysis and visualization of neurological datasets with focus on diffusion-weighted magnetic resonance imaging (dMRI). Major fields of research are the development and implementation of new methods for segmentation or tractography of white matter tracts, as well as tissue segmentation and modelling. Besides the classical methods that are used in this field, we explore the application of machine learning in the context of diffusion-weighted image processing.

-> Peter Neher

-> Jakob Wasserthal

Validation of Fiber Tractography


The quantitative evaluation of fiber tractography is a long-standing challenge for the field that represents an essential prerequisite for widespread application and meaningful interpretation of the approach. In this project we develop phantom-based as well as in-vivo methods to approach this challenge and validate tractography results in large-scale evaluation studies and international challenges.

-> Peter Neher

Learning from Noisy Annotations


The annotation of medical images suffers from high inter- and intra-rater variability, caused by a number of factors such as strong ambiguities in the images and the subjectivity of annotators. This projects seeks to develop methods that can handle such ambiguous ground truth labels, e.g. by modelling the distribution over annotations via generative adversarial models.

-> Simon Kohl

Learning from Weak Annotations


The full annotation of training data with individual labels on each observation can be cumbersome or even impossible in many clinically relevant scenarios. This project aims at developing machine learning methods that can handle weakly annotated data. This can drastically reduce the annotation effort in applications like semantic image segmentation and also enable the application of machine learning in settings where sufficient training data were missing so far.

-> Michael Götz

The Black Swan Project


This project is part of the “Black Swan Research Initiative”, launched by the International Myeloma Foundation. The goal is to establish an imaging based prognostic staging system for patients with multiple myeloma. In symptomatic patients focal lesions can be present in extensive numbers. The project aims to develop a set of automated detection, segmentation and characterization techniques for whole body image analysis. The system will quantify and assess the tumor mass trend over time.

-> Andre Klein

-> Amir Kalali

Knowledge-based Large-scale Image Segmentation


This project aims at the development of flexible and accurate methods for an automatic semantic image segmentation on large clinical datasets. We focus on a combination of model-based methods with techniques from Active Learning, Online Learning, Transfer Learning and Deep Learning. They allow an optimized training on sparse data, a continuous learning at runtime and an assessment of segmentation quality, as a prerequisite for the successful annotation of large and heterogeneous datasets.

-> Tobias Norajitra

Image-based Stratification of Glioblastoma Patients


This project focuses on uncertainty in radiomics. Traditionally, a multitude of parameters is computed from images with which decision support systems are learned. These parameters may however be very sensitive to segmentation errors, resulting in overfitting and degrading performance. We make use of deep learning segmentation algorithms that allow uncertainty estimation, based upon which we can learn more robust decision support algorithms.

-> Fabian Isensee



In Radiomics, high-throughput computing techniques are systematically employed for the conversion of images to higher-dimensional data, i.e. predictive features. The aim is to improve decision support by the subsequent analysis of these features. We study comprehensive MRI imaging phenotypes for linkage of imaging with clinical, biological and genomic parameters in several entities including prostate cancer, breast cancer and brain tumors.

-> Michael Goetz

-> Paul Jäger

-> Tobias Norajitra

Longitudinal Modeling for Glioblastoma Assessment


In this project, we develop algorithms to predict future clinical assessments of glioblastoma patients from existing longitudinal data. We specifically try to estimate spatial invasion probabilities, incorporating novel uncertainty measures that allow us to quantify the confidence of our models’ outputs. This project is carried out in close cooperation with the Department of Neuroradiology at Heidelberg University Hospital, where we have established infrastructure that allows us to test cutting edge algorithms in clinical routine.

-> Jens Petersen

"Deep Probabilistic Modeling of Glioma Growth​", Petersen et al., MICCAI 2019 (

Joint Imaging Platform

Within the German Cancer Consortium (DKTK) the Joint Funding Project “Joint Imaging Platform” will establish a distributed IT infrastructure for image analysis and machine learning in the member institutions. It will facilitate pooling of analysis methods that can be applied in an automated and standardized manner to patient data in the different centers, allowing for unprecedented cohort sizes. The biggest research challenge is the combination, aggregation and distribution of training data, processes and models for non-shareable sensitive data as well as the validation of quantitative imaging biomarkers across a multi-institutional consortium. On the implementation side we investigate distributed learning methods as well as latest private cloud technologies for a robust deployment of data management and processing. More information

 -> Jonas Scherer

 -> Klaus Kades

 -> Jasmin Metzger

Unsupervised Deep Learning


Key challenge in deep learning is to optimally leverage not only of labeled but also unlabeled data. Our aim in this project is to learn beneficial feature representations using unsupervised methods like generative modelling, density estimation and self-supervised learning. This will allow the application of deep learning in scenarios where data availability was insufficient so far.​

-> David Zimmerer

Medical Imaging Interaction Toolkit (MITK)

MITK is a very modular and versatile open-source software development platform for applications in medical image processing. It's being developed at the German
Cancer Research Center since 2002 with contributions and users from an
international community in research and industry.

-> MITK Team

-> MITK Homepage

MITK Workbench

The MITK Workbench is a free medical image viewer, which supports all kinds of DICOM modalities like CT, MRT, US and RT as well as a number of research file formats. In addition to 2D, 3D and 3D+t visualization capabilities, there are numerous plugins for segmentation, registration and other processing steps available.

-> MITK Team

-> MITK Homepage

Research data management and automated processing

While the focus of the MITK Workbench is interactive processing, today's research questions often require the standardized and automated processing of large datasets. We integrate MITK with the Extensible Neuroimaging Archive Toolkit (XNAT), NoSQL databases and private cloud solutions like OpenStack to provide and evaluate new exploration and processing capabilities to medical imaging researchers.

 -> Caspar Goch

Internal support and infrastructure

Within the research program "Imaging and Radiooncology", the MICO team develops and provides solutions for scientific software development and testing infrastructure in various departments. Building on the experience of MITK development, we provide source code control and issue trackers as well as custom support for e.g. the integration of applications and data types in MITK-based workflows.

 -> Caspar Goch

 -> Stefan Dinkelacker

Intraoperative assistance system for mobile C-Arm devices

Intraoperative imaging can help to improve the quality of reduction results in trauma surgery. However, the mobility of the device comes with lack of information about its orientation to the patient. Screws, plates and pathologies further increase the challenge of image understanding. We aim to assist the surgeon in upper ankle surgery by incorporating prior knowledge and information of the contralateral site using 2D/3D registration.

 -> Sarina Thomas

Intraoperative assistance for mobile C-arm positioning


Intraoperative imaging guides the surgeon through interventions and leads to higher precision and reduced surgical revisions. For evaluation purposes the surgeon needs to acquire anatomy-specific standardized projections. We aim to replace the current manual positioning procedure of the C-arm involving continuous fluoroscopy by an automatic procedure, thereby reducing the dose and time requirement. We tackle this problem employing data simulation techniques and deep learning based methods.

-> Lisa Kausch



"RTToolbox" is a robust and flexible C++ software library developed to support quantitative analysis of treatment outcome for radiotherapy. It provides the import of radiotherapy data (e.g. plans, dose distributions and structure sets) in DICOM-RT standard format as well as in ITK supported data formats. Core features of the RTToolbox include: calculation of DVHs and dose comparison indices, and computation of radiobiological models (TCP/NTCP). Using the RTToolbox radiotherapy evaluation applications can be built easily and quickly.

 -> Clemens Hentschke


The aim of AVID is to provide an open solution to orchestrate software components via workflow scripts. The main areas of application are scalable and flexible cohort analysis as well as variation effect and uncertainty quantification.

AVID is especially used in the context of radiotherapy. Therefore, many of the integrated components are provided by RT-Toolbox. However, it was also used successfully in other areas like radiological image analysis and image registration error effect studies

-> Ralf Floca

-> Clemens Hentschke


To make forensic radiology feasible, we develop workflows and processes that combine local and remote radiological infrastructure as well as latest technologies of medical image processing. To minimize required resources at image acquisition sites, we design automated image processing pipelines and secure data transfers to minimally occupy human resources and minimally interfere with previously existing on-site routine workflows.

This project is a cooperation between DKFZ, Institute for Legal and Traffic Medicine (University Clinic HD) and Institute for Anatomy (University HD)

 -> Ignaz Reicht

MITK-ModelFit and Perfusion

Model fitting plays a central role in the quantitative analysis of medical images. One prominent example is dynamic contrast-enhanced (DCE) MRI, where perfusion-related parameters are estimated using pharmacokinetic modelling. Other applications include mapping the apparent diffusion coefficient (ADC) in diffusion weighted MRI, and the analysis of Z-spectra in chemical exchange saturation transfer (CEST) imaging.

The ready-to-use model fitting toolbox is embedded into MITK and provides tools for model-fitting (ROI-based or voxel-by-voxel), fit evaluation and visualization. Any fitting task can be performed given a user-defined model. Being part of MITK, MITK-ModelFit applications can be easily and flexibly incorporated into pre-and post-processing workflows and offer a large set of interoperability options and supported data formats.

A special emphasis is put on pharmacokinetic analysis of DCE MRI data. Here, a variety of pharmacokinetic models is available. In addition tools are offered for arterial input function selection and conversion from signal to concentration.

-> Ralf Floca
-> Ina Kompan


Magnetic Resonance imaging is moving towards ultra-high field strengths (7T and higher) to achieve higher resolutions, more enhanced image contrasts and an increased signal-to-noise-ratio. This provides the means for improved diagnostic methods and facilitates non-proton MRI such as sodium imaging. However, at ultra-high-field, physical and hardware limitations, such as RF field inhomogeneity, show as image distortions and artifacts. To overcome these limitations, novel pulse sequences, post-processing procedures and hardware extensions such parallel transmit coils are required.

The “MRUtilities”-toolbox is an extension of MITK which aims to support physicists and physicians conducting research at ultra-high field MRI. Provided applications include B1-mapping and optimized RF-shimming for parallel transmit coils.

-> Ina Kompan



Hyppopy is a python toolbox for blackbox-function optimization providing an easy to use interface for a variety of solver frameworks. Hyppopy gives access to gridsearch, random and quasirandom, particle and bayes solvers. The aim of Hyppopy is making hyperparameter optimization as simple as possible (in our cases e.g. for the optimization of image processing pipelines or machine learning tasks). It can be easily integrated in existing code bases and provides real-time visualization of the parameter space and the optimization process via a visdom server. The internal design is focused on extensibility, ensuring that custom solver and future approaches can be integrated.

-> Ralf Floca

to top