This study presents a comprehensive clinical decision support system aimed at personalizing antidepressant treatment selection using synthetic patient data, predictive modelling, and reinforcement learning. Traditional antidepressant prescribing often relies on trial-and-error methods, which can result in prolonged patient suffering and delayed treatment success, particularly in treatment-resistant depression. To address the limitations posed by data scarcity and privacy constraints in psychiatric research, we developed a robust synthetic patient data generator that simulates realistic clinical, genetic, and treatment response profiles. These synthetic datasets capture essential features such as age, gender, baseline depression severity, genetic markers (5HTTLPR, BDNF, COMT, FKBP5), treatment history, and comorbidities including anxiety and chronic pain. We employed Gradient Boosting and Neural Network classifiers to predict treatment response probabilities based on individual patient profiles. These models achieved moderate classification accuracy, with a tendency to predict responders more reliably than non-responders. To further optimize treatment strategies, we integrated a Dueling DQN Reinforcement Learning agent trained within a custom-designed environment that simulates multi-step treatment processes, side effect profiles, and severity progression. While the reinforcement learning agent successfully optimized sequential treatment selections and reduced symptom severity, it did not achieve remission under the current reward configuration, suggesting the need for further reward function tuning. An enhanced clinical decision support system was developed to generate top treatment recommendations with natural language explanations, facilitating transparent and interpretable clinical guidance. This research demonstrates the potential of using synthetic patient simulations and reinforcement learning to advance precision psychiatry, enabling data-driven, patient-specific treatment strategies while addressing ethical and logistical barriers associated with real-world psychiatric data.
Cite this paper
Filippis, R. D. and Foysal, A. A. (2025). Personalized Antidepressant Treatment Recommendation Using Reinforcement Learning and Predictive Modelling on Synthetic Patient Data . Open Access Library Journal, 12, e13957. doi: http://dx.doi.org/10.4236/oalib.1113957.
Proudman, D., Greenberg, P. and Nellesen, D. (2021) The Growing Burden of Major Depressive Disorders (MDD): Implications for Researchers and Policy Makers. PharmacoEconomics, 39, 619-625. https://doi.org/10.1007/s40273-021-01040-7
Greenberg, P., Chitnis, A., Louie, D., Suthoff, E., Chen, S., Maitland, J., et al. (2023) The Economic Bur-den of Adults with Major Depressive Disorder in the United States (2019). Ad-vances in Therapy, 40, 4460-4479. https://doi.org/10.1007/s12325-023-02622-x
Papakostas, G.I., Pe-tersen, T., Mahal, Y., Mischoulon, D., Nierenberg, A.A. and Fava, M. (2004) Quality of Life Assessments in Major Depressive Disorder: A Review of the Lit-erature. General Hospital Psychiatry, 26, 13-17. https://doi.org/10.1016/j.genhosppsych.2003.07.004
Mrazek, D.A., Hornberger, J.C., Altar, C.A. and Degtiar, I. (2014) A Review of the Clinical, Economic, and Societal Burden of Treatment-Resistant Depression: 1996-2013. Psychiatric Services, 65, 977-987. https://doi.org/10.1176/appi.ps.201300059
Gureje, O., Kola, L. and Afolabi, E. (2007) Epidemiology of Major Depressive Disorder in Elderly Nige-rians in the Ibadan Study of Ageing: A Community-Based Survey. The Lancet, 370, 957-964. https://doi.org/10.1016/s0140-6736(07)61446-9
Voineskos, D., Daskalakis, Z.J. and Blumberger, D.M. (2020) Management of Treat-ment-Resistant Depression: Challenges and Strategies. Neuropsychiatric Disease and Treatment, 16, 221-234. https://doi.org/10.2147/ndt.s198774
de Sousa, R.T., V. Zanetti, M., R. Brunoni, A. and Machado-Vieira, R. (2015) Chal-lenging Treatment-Resistant Major Depressive Disorder: A Roadmap for Im-proved Therapeutics. Current Neuropharmacology, 13, 616-635. https://doi.org/10.2174/1570159x13666150630173522
Eap, C.B., Gründer, G., Baumann, P., Ansermot, N., Conca, A., Corruble, E., et al. (2021) Tools for Op-timising Pharmacotherapy in Psychiatry (Therapeutic Drug Monitoring, Molec-ular Brain Imaging and Pharmacogenetic Tests): Focus on Antidepressants. The World Journal of Biological Psychiatry, 22, 561-628.
Zeier, Z., Carpenter, L.L., Kalin, N.H., Rodriguez, C.I., McDonald, W.M., Widge, A.S., et al. (2018) Clinical Implementation of Pharmacogenetic Decision Support Tools for Antidepressant Drug Prescribing. American Journal of Psychiatry, 175, 873-886. https://doi.org/10.1176/appi.ajp.2018.17111282
Ionescu, D.F., Rosen-baum, J.F. and Alpert, J.E. (2015) Pharmacological Approaches to the Challenge of Treatment-Resistant Depression. Dialogues in Clinical Neuroscience, 17, 111-126. https://doi.org/10.31887/dcns.2015.17.2/dionescu
Costello, K., Kennedy, P. and Scanzillo, J.O. (2008) Recognizing Nonadherence in Patients with Multiple Sclerosis and Maintaining Treatment Adherence in the Long Term. The Med-scape Journal of Medicine, 10, Article 225.
Holsboer, F. (2008) How Can We Realize the Promise of Personalized Antidepressant Medicines? Nature Re-views Neuroscience, 9, 638-646. https://doi.org/10.1038/nrn2453
Si-mon, G.E. and Perlis, R.H. (2010) Personalized Medicine for Depression: Can We Match Patients with Treatments? American Journal of Psychiatry, 167, 1445-1455. https://doi.org/10.1176/appi.ajp.2010.09111680
Perna, G., Alciati, A., Daccò, S., Grassi, M. and Caldirola, D. (2020) Personalized Psychi-atry and Depression: The Role of Sociodemographic and Clinical Variables. Psy-chiatry Investigation, 17, 193-206. https://doi.org/10.30773/pi.2019.0289
Perlis, R.H. (2016) Abandoning Personalization to Get to Precision in the Pharmacotherapy of Depression. World Psychiatry, 15, 228-235. https://doi.org/10.1002/wps.20345
Ritchie, M.D. (2018) Large-Scale Analysis of Genetic and Clinical Patient Data. Annual Review of Biomedical Data Science, 1, 263-274. https://doi.org/10.1146/annurev-biodatasci-080917-013508
Molla, G. and Bitew, M. (2024) Revolutionizing Personalized Medicine: Synergy with Mul-ti-Omics Data Generation, Main Hurdles, and Future Perspectives. Biomedicines, 12, Article 2750. https://doi.org/10.3390/biomedicines12122750
Lightbody, G., Haberland, V., Browne, F., Taggart, L., Zheng, H., Parkes, E., et al. (2019) Re-view of Applications of High-Throughput Sequencing in Personalized Medicine: Barriers and Facilitators of Future Progress in Research and Clinical Application. Briefings in Bioinformatics, 20, 1795-1811. https://doi.org/10.1093/bib/bby051
Xu, Y.X., Zheng, X.K., Li, Y.J., Ye, X.M., Cheng, H.T., Wang, H. and Lyu, J. (2023) Exploring Patient Medication Adherence and Data Mining Methods in Clinical Big Data: A Contemporary Re-view. Journal of Evidence-Based Medicine, 16, 342-375. https://doi.org/10.1111/jebm.12548
Hulsen, T., Jamuar, S.S., Moody, A.R., Karnes, J.H., Varga, O., Hedensted, S., et al. (2019) From Big Data to Preci-sion Medicine. Frontiers in Medicine, 6, Article 34. https://doi.org/10.3389/fmed.2019.00034
Hsin, H., Fromer, M., Peter-son, B., Walter, C., Fleck, M., Campbell, A., et al. (2018) Transforming Psychia-try into Data-Driven Medicine with Digital Measurement Tools. npj Digital Medi-cine, 1, Article No. 37. https://doi.org/10.1038/s41746-018-0046-0
Gillan, C.M. and Whelan, R. (2017) What Big Data Can Do for Treatment in Psychiatry. Current Opinion in Behavioral Sciences, 18, 34-42. https://doi.org/10.1016/j.cobeha.2017.07.003
Omiyefa, S. (2025) Arti-ficial Intelligence and Machine Learning in Precision Mental Health Diagnostics and Predictive Treatment Models. International Journal of Research Publication and Reviews, 6, 85-99. https://doi.org/10.55248/gengpi.6.0325.1107
de Filippis, R. and Al Foysal, A. (2025) AI-Driven Policy Testing for Mental Health Crisis Response: An Agent-Based Modelling and Reinforcement Learning Approach. Open Access Library, 12, 1-20. https://doi.org/10.4236/oalib.1113507
Roayaei, M. and Soltani, Z. (2025) Advancing Healthcare: Reinforcement Learning Applica-tions for Personalized Healthcare. In: Innovations in Biomedical Engineering: Trends in Scientific Advances and Applications, Elsevier, 33-86. https://doi.org/10.1016/b978-0-443-30146-9.00002-2
Al-Hamadani, M., Fadhel, M., Alzubaidi, L. and Harangi, B. (2024) Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review. Sensors, 24, Article 2461. https://doi.org/10.3390/s24082461
Lu, Z.H., Yang, M., Pan, C.H., Zheng, P.Y. and Zhang, S.X. (2022) Multi-Modal Deep Learning Based on Mul-ti-Dimensional and Multi-Level Temporal Data Can Enhance the Prognostic Pre-diction for Multi-Drug Resistant Pulmonary Tuberculosis Patients. Science in One Health, 1, Article 100004. https://doi.org/10.1016/j.soh.2022.100004
Li, T., Shi, W.Q., Isgut, M. Zhong, Y.S., Lais, P., et al. (2023) Integrating Multi-Omics Data with EHR for Precision Medicine Using Advanced Artificial Intelligence. IEEE Reviews in Bio-medical Engineering, 17, 80-97. https://doi.org/10.1109/rbme.2023.3324264
Chakravarty, K., Antontsev, V., Bundey, Y. and Varshney, J. (2021) Driving Success in Personal-ized Medicine through AI-Enabled Computational Modeling. Drug Discovery Today, 26, 1459-1465. https://doi.org/10.1016/j.drudis.2021.02.007
Akkur, M., Singh, B.P., R, P., Singh, T., Panda, B. and Marwaha, P. (2025) Sequential Optimization of Healthcare Processes Using Reinforcement Learning and Sequential Function Models. 2025 International Conference on Automation and Computation (AU-TOCOM), Dehradun, 4-6 March 2025, 631-636. https://doi.org/10.1109/autocom64127.2025.10956379
Silveira, I., Sil-va, L., Veladas, F., Braga, R. and Gamboa, H. (2024) Synple: A Platform for Pri-vacy Preserving Synthetic Patient Data Generation. In: IFIP Advances in Infor-mation and Communication Technology, Springer, 139-151. https://doi.org/10.1007/978-3-031-63851-0_9
Panfilo, D., Boudewijn, A., Saccani, S., Coser, A., Svara, B., Chauvenet, C.R., et al. (2023) A Deep Learning-Based Pipeline for the Generation of Synthetic Tabular Data. IEEE Access, 11, 63306-63323. https://doi.org/10.1109/access.2023.3288336
Frye, M. and Schmitt, R.H. (2020) Structured Data Preparation Pipeline for Machine Learn-ing-Applications in Production. 17th IMEKO TC 10 and EUROLAB Virtual Con-ference, Online, 20-22 October 2020, 241-246.
Rajpurkar, P., Yang, J., Dass, N., Vale, V., Keller, A.S., Irvin, J., et al. (2020) Evaluation of a Machine Learning Model Based on Pretreatment Symptoms and Electroencephalographic Features to Predict Outcomes of Antidepressant Treatment in Adults with Depression: A Prespecified Secondary Analysis of a Randomized Clinical Trial. JAMA Network Open, 3, e206653. https://doi.org/10.1001/jamanetworkopen.2020.6653
Katzman, J.L., Shaham, U., Cloninger, A., Bates, J., Jiang, T. and Kluger, Y. (2018) Deepsurv: Personalized Treatment Recommender System Using a Cox Proportional Haz-ards Deep Neural Network. BMC Medical Research Methodology, 18, Article No. 24. https://doi.org/10.1186/s12874-018-0482-1
Sharma, D., Singh Aujla, G. and Bajaj, R. (2021) Deep Neuro-Fuzzy Approach for Risk and Severity Prediction Using Recommendation Systems in Connected Health Care. Transac-tions on Emerging Telecommunications Technologies, 32, e4159. https://doi.org/10.1002/ett.4159
Tardini, E. (2021) Recursive Me-ta-Reinforcement Learning for Personalized Sequential Dynamic Treatment Policies. Master’s Thesis, University of Illinois at Chicago.
Liu, S.Q., See, K.C., Ngiam, K.Y., Celi, L.A., Sun, X. and Feng, M. (2020) Reinforcement Learning for Clinical Deci-sion Support in Critical Care: Comprehensive Review. Journal of Medical Inter-net Research, 22, e18477. https://doi.org/10.2196/18477
Hong, N., Liu, C., Gao, J.W., Han, L., Chang, F.X., Gong, M.C. and Su, L.X. (2022) State of the Art of Machine Learning-Enabled Clinical Decision Support in Intensive Care Units: Literature Review. JMIR Medical Informatics, 10, e28781. https://doi.org/10.2196/28781
Tsoukalas, A., Albertson, T. and Tagkopoulos, I. (2015) From Data to Optimal Decision Making: A Data-Driven, Probabilistic Machine Learning Approach to Decision Support for Patients with Sepsis. JMIR Medical Informatics, 3, e11. https://doi.org/10.2196/medinform.3445
Adeniran, A.A., Onebunne, A.P. and William, P. (2024) Explainable AI (XAI) in Healthcare: Enhancing Trust and Transparency in Critical Decision-Making. World Journal of Advanced Research and Reviews, 23, 2447-2658. https://doi.org/10.30574/wjarr.2024.23.3.2936
Elhaddad, M. and Hamam, S. (2024) AI-Driven Clinical Decision Support Systems: An Ongoing Pursuit of Potential. Cureus, 16, e57728. https://doi.org/10.7759/cureus.57728
Tuan, D.A. (2024) Bridg-ing the Gap between Black Box AI and Clinical Practice: Advancing Explainable AI for Trust, Ethics, and Personalized Healthcare Diagnostics.
Eke, C.I. and Shuib, L. (2025) The Role of Explainability and Transparency in Fostering Trust in AI Healthcare Systems: A Systematic Literature Review, Open Issues and Po-tential Solutions. Neural Computing and Applications, 37, 1999-2034. https://doi.org/10.1007/s00521-024-10868-x
Jacob, C., Brasier, N., Laurenzi, E., Heuss, S., Mougiakakou, S., Cöltekin, A., et al. (2025) AI for IM-PACTS Framework for Evaluating the Long-Term Real-World Impacts of Ai-Powered Clinician Tools: Systematic Review and Narrative Synthesis. Journal of Medical Internet Research, 27, e67485. https://doi.org/10.2196/67485
Törnqvist, M., Zucker, J., Fauvel, T., Lambert, N., Berthelot, M. and Movschin, A. (2025) A Text-to-Tabular Ap-proach to Generate Synthetic Patient Data Using LLMs. 2025 IEEE 13th Inter-national Conference on Healthcare Informatics (ICHI), Rende, 18-21 June 2025, 18-29. https://doi.org/10.1109/ichi64645.2025.00011
Gamble, A. (2020) Artificial Intelligence and Mobile Apps for Mental Healthcare: A Social Informatics Perspective. Aslib Journal of Information Management, 72, 509-523. https://doi.org/10.1108/ajim-11-2019-0316
Galderisi, S., Appelbaum, P.S., Gill, N., Gooding, P., Herrman, H., Melillo, A., et al. (2024) Ethical Challenges in Contemporary Psychiatry: An Overview and an Appraisal of Possible Strategies and Research Needs. World Psychiatry, 23, 364-386. https://doi.org/10.1002/wps.21230
Yazzourh, S. (2024) Reinforcement Learning and Bayesian Outcome-Weighted Learning for Precision Medicine: In-tegrating Medical Knowledge into Decision-Making Algorithms. PhD Disserta-tion, Université de Toulouse.
Drevets, W.C., Wittenberg, G.M., Bullmore, E.T. and Manji, H.K. (2022) Immune Targets for Therapeutic Development in Depression: Towards Precision Medicine. Nature Reviews Drug Discovery, 21, 224-244. https://doi.org/10.1038/s41573-021-00368-1
Gurcan, F. and Soylu, A. (2024) Learning from Imbalanced Data: Integration of Advanced Resampling Techniques and Machine Learning Models for Enhanced Cancer Diagnosis and Prognosis. Cancers, 16, Article No. 3417. https://doi.org/10.3390/cancers16193417
Moncy, J.C., Fan, Y. and Fu, C.H.Y. (2024) Prediction of Treatment Outcome to Transcranial Direct Current Stimulation in Major Depression Based on Deep Learning of EEG Data. 2024 IEEE Conference on Artificial Intelligence (CAI), Singapore, 25-27 June 2024, 1123-1128. https://doi.org/10.1109/cai59869.2024.00201
Burcu, M., Manzano-Salgado, C.B., Butler, A.M. and Christian, J.B. (2022) A Framework for Extension Studies Using Real-World Data to Examine Long-Term Safety and Ef-fectiveness. Therapeutic Innovation & Regulatory Science, 56, 15-22. https://doi.org/10.1007/s43441-021-00322-8
Schneeweiss, S. and Pa-torno, E. (2021) Conducting Real-World Evidence Studies on the Clinical Out-comes of Diabetes Treatments. Endocrine Reviews, 42, 658-690. https://doi.org/10.1210/endrev/bnab007
Olalekan Kehinde, A. (2025) Leveraging Machine Learning for Predictive Models in Healthcare to Enhance Patient Outcome Management. International Research Journal of Modernization in Engineering Technology and Science, 7, Article 1465.
Baydili, İ., Tasci, B. and Tasci, G. (2025) Artificial Intelligence in Psychiatry: A Review of Biologi-cal and Behavioral Data Analyses. Diagnostics, 15, Article 434. https://doi.org/10.3390/diagnostics15040434