Accurately predicting medication response and disease severity is essential for advancing personalized treatment strategies, especially in complex neuropsychiatric conditions. In this study, we propose a novel multi-task deep learning framework capable of simultaneously predicting both medication response classes and disease severity scores from neuroimaging data. To support this, we generated a high-contrast synthetic 3D neuroimaging dataset comprising 1500 samples, simulating distinct anatomical changes in critical brain regions such as the prefrontal cortex and hippocampus, which were systematically linked to varying severity levels and treatment response categories. The proposed model employs a 3D dual-path convolutional neural network with a shared encoder and two separate branches for regression and classification tasks. The architecture is optimized with batch normalization, dropout, focal loss for class imbalance, and gradient clipping for training stability. Training was performed using the Adam optimizer with adaptive learning rate reduction and early stopping to ensure optimal performance and prevent overfitting. The model achieved exceptional results, with 100% classification accuracy for medication response prediction and a Mean Absolute Error (MAE) of 8.03 in severity estimation on the test set. Performance evaluation using confusion matrices, regression scatter plots, and error distribution analyses confirmed the robustness and reliability of the model. The multi-task setup effectively leveraged shared representations, improving learning efficiency and predictive power. This research demonstrates the feasibility and potential of multi-task learning in neuroimaging applications, providing a promising step toward integrating both categorical and continuous clinical outcomes in a unified predictive framework. Future work will focus on validation using real-world clinical datasets and expanding the architecture to accommodate multimodal patient data.
Cite this paper
Filippis, R. D. and Foysal, A. A. (2025). Multi-Task 3D Neuroimaging Model for Simultaneous Prediction of Medication Response and Disease Severity: A Synthetic Data Study . Open Access Library Journal, 12, e13956. doi: http://dx.doi.org/10.4236/oalib.1113956.
Landi, G., Brosig, B. and Tossani, E. (2024) New Ideas in: Psychology for Clinical Settings 2022. Frontiers in Psychology, 15, Article 1356293. https://doi.org/10.3389/fpsyg.2024.1356293
Capatina, T., Oatu, A., Babasan, C. and Trifu, S. (2025) Translating Molecular Psychiatry: From Bi-omarkers to Personalized Therapies—A Narrative Review. International Journal of Molecular Sciences, 26, Article 4285. https://doi.org/10.3390/ijms26094285
češková, E. and šilhán, P. (2021) From Personalized Medicine to Precision Psychiatry? Neuropsychiatric Disease and Treatment, 17, 3663-3668. https://doi.org/10.2147/ndt.s337814
Strianese, O., Rizzo, F., Ciccarelli, M., Galasso, G., D’Agostino, Y., Salvati, A., et al. (2020) Precision and Personal-ized Medicine: How Genomic Approach Improves the Management of Cardio-vascular and Neurodegenerative Disease. Genes, 11, Article 747. https://doi.org/10.3390/genes11070747
Khalifa, M. and Albadawy, M. (2024) Artificial Intelligence for Clinical Prediction: Exploring Key Domains and Essential Functions. Computer Methods and Programs in Biomedicine Update, 5, Article ID: 100148. https://doi.org/10.1016/j.cmpbup.2024.100148
Du, Y., Fu, Z. and Calhoun, V.D. (2018) Classification and Prediction of Brain Disorders Using Functional Connectivity: Promising but Challenging. Frontiers in Neuroscience, 12, Article 525. https://doi.org/10.3389/fnins.2018.00525
Dhamala, E., Yeo, B.T.T. and Holmes, A.J. (2023) One Size Does Not Fit All: Methodological Considera-tions for Brain-Based Predictive Modeling in Psychiatry. Biological Psychiatry, 93, 717-728. https://doi.org/10.1016/j.biopsych.2022.09.024
Yen, C., Lin, C. and Chiang, M. (2023) Exploring the Frontiers of Neuroimaging: A Review of Recent Advances in Understanding Brain Functioning and Disorders. Life, 13, Article 1472. https://doi.org/10.3390/life13071472
Kim, M.M., Parolia, A., Dunphy, M.P. and Venneti, S. (2016) Non-Invasive Metabolic Imaging of Brain Tumours in the Era of Precision Medicine. Nature Reviews Clinical Oncology, 13, 725-739. https://doi.org/10.1038/nrclinonc.2016.108
Ferreira, L.K. and Busatto, G.F. (2011) Neuroimaging in Alzheimer’s Disease: Current Role in Clinical Practice and Potential Future Applications. Clinics, 66, 19-24. https://doi.org/10.1590/s1807-59322011001300003
Kim, J., Jeong, M., Stiles, W.R. and Choi, H.S. (2022) Neuroimaging Modalities in Alzheimer’s Dis-ease: Diagnosis and Clinical Features. International Journal of Molecular Scienc-es, 23, Article 6079. https://doi.org/10.3390/ijms23116079
Sui, J., Jiang, R., Bustillo, J. and Calhoun, V. (2020) Neuroimaging-based Individualized Prediction of Cognition and Behavior for Mental Disorders and Health: Methods and Promises. Biological Psychiatry, 88, 818-828. https://doi.org/10.1016/j.biopsych.2020.02.016
Zhang, D. and Shen, D. (2012) Multi-modal Multi-Task Learning for Joint Prediction of Multiple Regres-sion and Classification Variables in Alzheimer’s Disease. NeuroImage, 59, 895-907. https://doi.org/10.1016/j.neuroimage.2011.09.069
Liu, M., Zhang, J., Adeli, E. and Shen, D. (2017) Deep Multi-Task Multi-Channel Learn-ing for Joint Classification and Regression of Brain Status. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D. and Duchesne, S., Eds., Medical Image Computing and Computer Assisted Intervention—MICCAI 2017, Spring-er, 3-11. https://doi.org/10.1007/978-3-319-66179-7_1
K., P. and Per-iyathambi, E. (2024) Joint Classification and Regression with Deep Multi Task Learning Model Using Conventional Based Patch Extraction for Brain Disease Diagnosis. PeerJ Computer Science, 10, e2538. https://doi.org/10.7717/peerj-cs.2538
Holzinger, A., Haibe-Kains, B. and Jurisica, I. (2019) Why Imaging Data Alone Is Not Enough: AI-Based Integration of Imaging, Omics, and Clinical Data. European Journal of Nuclear Medicine and Molecular Imaging, 46, 2722-2730. https://doi.org/10.1007/s00259-019-04382-9
Najjar, R. (2023) Rede-fining Radiology: A Review of Artificial Intelligence Integration in Medical Imag-ing. Diagnostics, 13, Article 2760. https://doi.org/10.3390/diagnostics13172760
Nilima James Rodrigues, (2025) The Power of Data in Medtech: Enabling Innovation, Efficiency, and Smarter Healthcare. Journal of Computer Science and Technology Studies, 7, 893-905. https://doi.org/10.32996/jcsts.2025.7.5.103
Amiri, Z., Heidari, A., Navimipour, N.J., Esmaeilpour, M. and Yazdani, Y. (2024) The Deep Learn-ing Applications in IoT-Based Bio- and Medical Informatics: A Systematic Liter-ature Review. Neural Computing and Applications, 36, 5757-5797. https://doi.org/10.1007/s00521-023-09366-3
Thung, K. and Wee, C. (2018) A Brief Review on Multi-Task Learning. Multimedia Tools and Applica-tions, 77, 29705-29725. https://doi.org/10.1007/s11042-018-6463-x
Gong, P., Ye, J. and Zhang, C. (2012) Robust Multi-Task Feature Learning. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Beijing, 12-16 August 2012, 895-903. https://doi.org/10.1145/2339530.2339672
Vandenhende, S., Georgou-lis, S., Van Gansbeke, W., Proesmans, M., Dai, D. and Van Gool, L. (2021) Mul-ti-Task Learning for Dense Prediction Tasks: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 3614-3633. https://doi.org/10.1109/tpami.2021.3054719
Gupta, S., Rana, S., Saha, B., Phung, D. and Venkatesh, S. (2016) A New Transfer Learning Framework with Application to Model-Agnostic Multi-Task Learning. Knowledge and Infor-mation Systems, 49, 933-973. https://doi.org/10.1007/s10115-016-0926-z
Upadhyay, A.K. and Bhandari, A.K. (2023) Advances in Deep Learning Models for Resolving Medical Image Segmentation Data Scarcity Problem: A Topical Review. Archives of Computational Methods in Engineering, 31, 1701-1719. https://doi.org/10.1007/s11831-023-10028-9
Bansal, M.A., Sharma, D.R. and Kathuria, D.M. (2022) A Systematic Review on Data Scarcity Problem in Deep Learning: Solution and Applications. ACM Computing Surveys, 54, 1-29. https://doi.org/10.1145/3502287
Fayaz, S., Ahmad Shah, S.Z., ud din, N.M., Gul, N. and Assad, A. (2024) Advancements in Data Augmentation and Transfer Learning: A Comprehensive Survey to Address Da-ta Scarcity Challenges. Recent Advances in Computer Science and Communica-tions, 17, e100124225452. https://doi.org/10.2174/0126662558286875231215054324
Harvey, A., Moreau, C.A., Kumar, K., Huguet, G., Urchs, S.G.W., Sharmarke, H., et al. (2024) Challenges in Multi-Task Learning for fMRI-Based Diagnosis: Benefits for Psychiatric Conditions and CNVs Would Likely Require Thousands of Pa-tients. Imaging Neuroscience, 2, 1-20. https://doi.org/10.1162/imag_a_00222.
Allenspach, S., Hiss, J.A. and Schneider, G. (2024) Neural Multi-Task Learning in Drug Design. Nature Ma-chine Intelligence, 6, 124-137. https://doi.org/10.1038/s42256-023-00785-4
Shrestha, A. (2024) Mul-ti-Task Learning to Screen for Major Depressive Disorder and Post-Traumatic Stress Disorder. Master’s These, Worcester Polytechnic Insti-tute.
Mahmoud, A.Y., Neagu, D., Scrimieri, D. and Abdullatif, A.R.A. (2023) Early Diagnosis and Personalised Treatment Focusing on Synthetic Data Modelling: Novel Visual Learning Approach in Healthcare. Computers in Biology and Medicine, 164, Article ID: 107295. https://doi.org/10.1016/j.compbiomed.2023.107295
Tucker, A., Wang, Z., Rotalinti, Y. and Myles, P. (2020) Generating High-Fidelity Synthetic Patient Data for Assessing Machine Learning Healthcare Software. npj Digital Medicine, 3, Article No. 147. https://doi.org/10.1038/s41746-020-00353-9
Reiner Benaim, A., Almog, R., Gorelik, Y., Hochberg, I., Nassar, L., Mashiach, T., et al. (2020) Analyzing Medical Research Results Based on Synthetic Data and Their Relation to Real Data Results: Systematic Comparison from Five Observational Studies. JMIR Medical Informatics, 8, e16492. https://doi.org/10.2196/16492
Osler, T., Rutledge, R., Deis, J. and Bed-rick, E. (1996) ICISS: An International Classification of Disease-9 Based Injury Severity Score. The Journal of Trauma: Injury, Infection, and Critical Care, 41, 380-388. https://doi.org/10.1097/00005373-199609000-00002
Wagner, D.P., Knaus, W.A. and Draper, E.A. (1983) Statistical Validation of a Severity of Ill-ness Measure. American Journal of Public Health, 73, 878-884. https://doi.org/10.2105/ajph.73.8.878
Lavoie, A., Moore, L., LeSage, N., Liberman, M. and Sampalis, J.S. (2004) The New Injury Severity Score: A More Accurate Predictor of In-Hospital Mortality than the Injury Severity Score. The Journal of Trauma: Injury, Infection, and Critical Care, 56, 1312-1320. https://doi.org/10.1097/01.ta.0000075342.36072.ef
Ozcelik, F. (2024) Deciphering the Brain’s Visual Language: Natural Image Recon-struction using Deep Generative Models from fMRI Signals. Ph.D. Thesis, Université de Tou-louse.
Kebiri, H. (2023) Deep Learning Methods for Diffusion MRI in Early Development of the Human Brain: Resolution Enhancement and Model Estima-tion. Ph.D. Thesis, Université de Lausanne, Faculté de biologie et médecine.
Ji, J.L., Repovs, G., Yang, G.J., Savic, A., Murray, J.D. and Anticevic, A. (2020) Computational Neuroimaging of Cognition-Emotion Interactions: Affective and Task-similar Interference Differ-entially Impact Working Memory. bioRxiv.
Swiss Federation of Clinical Neuro-Societies (2022) Abstracts of the 5th SFCNS Congress—Swiss Federation of Clinical Neuro-Societies Basel, Switzerland, September 28–30, 2022. Clinical and Translational Neuroscience, 6, Article 22. https://doi.org/10.3390/ctn6030022
Filipowicz, A., Carter, S., Bravo, N., Iliev, R., Hakimi, S., Shamma, D.A., Lyons, K., Hogan, C. and Wu, C. (2023) Visual Elements and Cognitive Biases Influence Interpretations of Trends in Scatter Plots. arXiv: 2310.15406.
Vithayathil Varghese, N. and Mahmoud, Q.H. (2020) A Sur-vey of Multi-Task Deep Reinforcement Learning. Electronics, 9, Article 1363. https://doi.org/10.3390/electronics9091363
Paschali, M., Conjeti, S., Navarro, F. and Navab, N. (2018) Gener-Alizability vs. Robustness: Adversarial Examples for Medical Imaging. arXiv: 1804.00504.
Jenkins, H.J., Downie, A.S., Maher, C.G., Moloney, N.A., Magnussen, J.S. and Hancock, M.J. (2018) Im-aging for Low Back Pain: Is Clinical Use Consistent with Guidelines? A Systematic Review and Meta-analysis. The Spine Journal, 18, 2266-2277. https://doi.org/10.1016/j.spinee.2018.05.004
Harry, V.N., Semple, S.I., Parkin, D.E. and Gilbert, F.J. (2010) Use of New Imaging Techniques to Predict Tumour Response to Therapy. The Lancet Oncology, 11, 92-102. https://doi.org/10.1016/s1470-2045(09)70190-1
Wilke, R.A., Lin, D.W., Roden, D.M., Watkins, P.B., Flockhart, D., Zineh, I., et al. (2007) Identifying Ge-netic Risk Factors for Serious Adverse Drug Reactions: Current Progress and Challenges. Nature Reviews Drug Discovery, 6, 904-916. https://doi.org/10.1038/nrd2423
Frank, R. and Hargreaves, R. (2003) Clinical Biomarkers in Drug Discovery and Development. Nature Reviews Drug Discovery, 2, 566-580. https://doi.org/10.1038/nrd1130
Alomar, M.J. (2014) Factors Affecting the Development of Adverse Drug Reactions (Review Article). Saudi Pharmaceutical Journal, 22, 83-94. https://doi.org/10.1016/j.jsps.2013.02.003
Zhou, S.K., Greenspan, H., Davatzikos, C., Duncan, J.S., Van Ginneken, B., Madabhushi, A., et al. (2021) A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies with Progress Highlights, and Future Promises. Proceed-ings of the IEEE, 109, 820-838. https://doi.org/10.1109/jproc.2021.3054390
Koetzier, L.R., Wu, J., Mastrodicasa, D., Lutz, A., Chung, M., Koszek, W.A., et al. (2024) Generating Synthetic Data for Medical Imaging. Radiology, 312, e232471. https://doi.org/10.1148/radiol.232471
Mehrvar, S., Himmel, L.E., Babburi, P., Goldberg, A.L., Guffroy, M., Janardhan, K., et al. (2021) Deep Learning Approaches and Applications in Toxicologic Histopathology: Current Status and Future Perspectives. Journal of Pathology Informatics, 12, 42. https://doi.org/10.4103/jpi.jpi_36_21
Ashtari-Majlan, M. and Masip, D. (2025) Spatial-aware Transformer-Gru Framework for Enhanced Glaucoma Di-agnosis from 3D OCT Imaging. IEEE Journal of Biomedical and Health Informat-ics. https://doi.org/10.1109/jbhi.2025.3550394
Carvalho, T. and San-tana, M. (2024) Analysis of Machine Learning Algorithms to Aid in the Diagno-sis of Early‐stage Dementia. Alzheimer’s & Dementia, 20, e095187. https://doi.org/10.1002/alz.095187
Gudigar, A., Kadri, N.A., Raghavendra, U., Samanth, J., Maithri, M., Inamdar, M.A., et al. (2024) Auto-matic Identification of Hypertension and Assessment of Its Secondary Effects Using Artificial Intelligence: A Systematic Review (2013-2023). Computers in Biology and Medicine, 172, Article ID: 108207. https://doi.org/10.1016/j.compbiomed.2024.108207