Paper
Multimodal classification of Radiation-Induced Contrast Enhancements and tumor recurrence using deep learning
Authors
Robin Peretzke, Marlin Hanstein, Maximilian Fischer, Lars Badhi Wessel, Obada Alhalabi, Sebastian Regnery, Andreas Kudak, Maximilian Deng, Tanja Eichkorn, Philipp Hoegen Saßmannshausen, Fabian Allmendinger, Jan-Hendrik Bolten, Philipp Schröter, Christine Jungk, Jürgen Peter Debus, Peter Neher, Laila König, Klaus Maier-Hein
Abstract
The differentiation between tumor recurrence and radiation-induced contrast enhancements in post-treatment glioblastoma patients remains a major clinical challenge. Existing approaches rely on clinically sparsely available diffusion MRI or do not consider radiation maps, which are gaining increasing interest in the tumor board for this differentiation. We introduce RICE-NET, a multimodal 3D deep learning model that integrates longitudinal MRI data with radiotherapy dose distributions for automated lesion classification using conventional T1-weighted MRI data. Using a cohort of 92 patients, the model achieved an F1 score of 0.92 on an independent test set. During extensive ablation experiments, we quantified the contribution of each timepoint and modality and showed that reliable classification largely depends on the radiation map. Occlusion-based interpretability analyses further confirmed the model's focus on clinically relevant regions. These findings highlight the potential of multimodal deep learning to enhance diagnostic accuracy and support clinical decision-making in neuro-oncology.
Metadata
Related papers
Fractal universe and quantum gravity made simple
Fabio Briscese, Gianluca Calcagni • 2026-03-25
POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan
Marta Moscati, Muhammad Saad Saeed, Marina Zanoni, Mubashir Noman, Rohan Kuma... • 2026-03-25
LensWalk: Agentic Video Understanding by Planning How You See in Videos
Keliang Li, Yansong Li, Hongze Shen, Mengdi Liu, Hong Chang, Shiguang Shan • 2026-03-25
Orientation Reconstruction of Proteins using Coulomb Explosions
Tomas André, Alfredo Bellisario, Nicusor Timneanu, Carl Caleman • 2026-03-25
The role of spatial context and multitask learning in the detection of organic and conventional farming systems based on Sentinel-2 time series
Jan Hemmerling, Marcel Schwieder, Philippe Rufin, Leon-Friedrich Thomas, Mire... • 2026-03-25
Raw Data (Debug)
{
"raw_xml": "<entry>\n <id>http://arxiv.org/abs/2603.11827v1</id>\n <title>Multimodal classification of Radiation-Induced Contrast Enhancements and tumor recurrence using deep learning</title>\n <updated>2026-03-12T11:48:22Z</updated>\n <link href='https://arxiv.org/abs/2603.11827v1' rel='alternate' type='text/html'/>\n <link href='https://arxiv.org/pdf/2603.11827v1' rel='related' title='pdf' type='application/pdf'/>\n <summary>The differentiation between tumor recurrence and radiation-induced contrast enhancements in post-treatment glioblastoma patients remains a major clinical challenge. Existing approaches rely on clinically sparsely available diffusion MRI or do not consider radiation maps, which are gaining increasing interest in the tumor board for this differentiation. We introduce RICE-NET, a multimodal 3D deep learning model that integrates longitudinal MRI data with radiotherapy dose distributions for automated lesion classification using conventional T1-weighted MRI data. Using a cohort of 92 patients, the model achieved an F1 score of 0.92 on an independent test set. During extensive ablation experiments, we quantified the contribution of each timepoint and modality and showed that reliable classification largely depends on the radiation map. Occlusion-based interpretability analyses further confirmed the model's focus on clinically relevant regions. These findings highlight the potential of multimodal deep learning to enhance diagnostic accuracy and support clinical decision-making in neuro-oncology.</summary>\n <category scheme='http://arxiv.org/schemas/atom' term='cs.CV'/>\n <published>2026-03-12T11:48:22Z</published>\n <arxiv:primary_category term='cs.CV'/>\n <author>\n <name>Robin Peretzke</name>\n </author>\n <author>\n <name>Marlin Hanstein</name>\n </author>\n <author>\n <name>Maximilian Fischer</name>\n </author>\n <author>\n <name>Lars Badhi Wessel</name>\n </author>\n <author>\n <name>Obada Alhalabi</name>\n </author>\n <author>\n <name>Sebastian Regnery</name>\n </author>\n <author>\n <name>Andreas Kudak</name>\n </author>\n <author>\n <name>Maximilian Deng</name>\n </author>\n <author>\n <name>Tanja Eichkorn</name>\n </author>\n <author>\n <name>Philipp Hoegen Saßmannshausen</name>\n </author>\n <author>\n <name>Fabian Allmendinger</name>\n </author>\n <author>\n <name>Jan-Hendrik Bolten</name>\n </author>\n <author>\n <name>Philipp Schröter</name>\n </author>\n <author>\n <name>Christine Jungk</name>\n </author>\n <author>\n <name>Jürgen Peter Debus</name>\n </author>\n <author>\n <name>Peter Neher</name>\n </author>\n <author>\n <name>Laila König</name>\n </author>\n <author>\n <name>Klaus Maier-Hein</name>\n </author>\n </entry>"
}