Computational Biophotonics
Multispectral Imaging
Cancer diagnosis and tumor therapy are frequently performed using interventional procedures. In this context, replacement of traditional open surgery procedures with minimally-invasive interventions for tumor diagnosis, staging and therapy represents one of the most important challenges in modern healthcare. Minimally-invasive procedures provide numerous advantages in contrast to open surgery, including reduced surgical trauma, less pain medication, earlier convalescence, better cosmetic results, shorter hospitalization terms and lower costs. Given the recent advances in the field of miniaturization of optical and photoacoustic imaging devices, we aim to further advance the field of endoscopic interventional imaging computationally. Our primary goal is to investigate whether holistic processing of multi-modal structural and functional information can facilitate both local tissue classification and global instrument guidance within the scope of endoscopic soft tissue interventions. The research is based on the systematic integration and mutual enhancement of biophotonics and CAI techniques. (more)
- Sebastian Wirkert
- Anant Vemuri
Quantitative Photoacoustic Imaging
Real-time monitoring of functional tissue parameters, such as local blood oxygenation, based on optical imaging could provide groundbreaking advances in the diagnosis and interventional therapy of various diseases. While photoacoustic (PA) imaging is a novel imaging concept with great potential to measure optical absorption deep inside tissue, quantification of the measurements remains a major challenge to be addressed. This work introduce the first machine learning-based approach to quantitative PA tomography (qPAT), which relies on learning the fluence in a voxel to deduce the corresponding optical absorption. The bottleneck of training data generation is overcome by encoding relevant information of the measured signal and the characteristics of the imaging system in voxel-based context images, which allow the generation of thousands of training samples from a single simulated PAT image. Comprehensive in silico experiments demonstrate that the concept of local context encoding (LCE) enables highly accurate and robust quantification (1) of the local fluence and the optical absorption from single wavelength PAT images as well as (2) of local oxygenation from multi wavelength PAT images. (more)
- Thomas Kirchner
- Janek Gröhl
Fluorescence-Guided Surgery
The identification of relevant structures during minimally-invasive, laparoscopic interventions is a challenging task. Intraoperative registrations of preoperative data (e.g. CT data) with the laparoscopic video stream can help to localize hidden or invisible structures like tumorous tissue, vessels or nerves. However, intraoperative registrations are hardly used during clinical routine as currently published methods have disadvantages such as the lack of robustness, no real-time capability, or long preparation times just to name a few. Fluorescent markers have the potential to improve such registrations. The detection of traditional needle-shaped fiducial markers remains difficult under clinically challenging conditions such as smoke, blood or tissue in the field of view of the laparoscope. Our new fluorescent markers consist of a near-infrared (NIR) fluorescent dye (ICG), a contrast agent for CT-imaging and a binding agent (cyanoacrylate). The emitted NIR light better penetrates through blood, smoke or tissue compared to visible light. Therefore, the fluorescent markers can be more easily detected. Recent ex and in vivo studies showed the ability of fluorescent markers to be used for fast intraoperative registrations and the superior robustness of these markers compared to needle fiducials.
Selected publications
Wirkert SJ, Kenngott H, Mayer B, Mietkowski P, Wagner M, Sauer P, Clancy NT, Elson DS, Maier-Hein L. Robust near real-time estimation of physiological parameters from megapixel multispectral images with inverse Monte Carlo and random forest regression. International Journal of Computer Assisted Radiology and Surgery, 1-9, 2016.
März K, Hafezi M, Weller T, Saffari A, Nolden M, Fard N, Majlesara A, Zelzer S, Maleshkova M, Volovyk M, Gharabaghi N, Wagner M, Emami G, Engelhardt S, Fetzer A, Kenngott H, Rezai N, Rettinger A, Studer R, Mehrabi A, Maier-Hein L. Toward Knowledge-Based Liver Surgery: Holistic Information Processing for Surgical Decision Support. International Journal of Computer Assisted Radiology and Surgery (Special Issue: IPCAI), 1–11. doi:10.1007/s11548-015-1187-0, 7. April 2015.
Dos Santos TR, Seitel A, Kilgus T, Suwelack S, Wekerle AL, Kenngott H, Speidel S, Schlemmer HP, Meinzer HP, Heimann T, Maier-Hein L. Pose-independent surface matching for intra-operative soft-tissue marker-less registration. Med Imag Anal(accepted), 2014.
Maier-Hein L, Franz AM, dos Santos TR, Schmidt M, Fangerau M, Meinzer HP, Fitzpatric JM. Convergent Iterative closest-point algorithm to accomodate anisotropic and inhomogenous localization error. IEEE T Pattern Anal 34(8):1520-1532, 2012.
Maier-Hein L, Tekbas A, Seitel A, Pianka F, Müller SA, Satzl S, Schawo S, Radeleff B, Tetzlaff R, Franz AM, Müller-Stich BP, Wolf I, Kauczor HU, Schmied BM, Meinzer HP. In-vivo accuracy assessment of a needle-based navigation system for CT-guided radiofrequency ablation of the liver. Med Phys, 35(12):5385-5396, 2008.