全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

Personalized Antidepressant Treatment Recommendation Using Reinforcement Learning and Predictive Modelling on Synthetic Patient Data 

DOI: 10.4236/oalib.1113957, PP. 1-20

Subject Areas: Artificial Intelligence, Psychiatry & Psychology

Keywords: Reinforcement Learning, Depression, Synthetic Data, Precision Psychiatry, Treatment Optimization, Clinical Decision Support, Dueling DQN, Gradient Boosting, Personalized Medicine

Full-Text   Cite this paper   Add to My Lib

Abstract

This study presents a comprehensive clinical decision support system aimed at personalizing antidepressant treatment selection using synthetic patient data, predictive modelling, and reinforcement learning. Traditional antidepressant prescribing often relies on trial-and-error methods, which can result in prolonged patient suffering and delayed treatment success, particularly in treatment-resistant depression. To address the limitations posed by data scarcity and privacy constraints in psychiatric research, we developed a robust synthetic patient data generator that simulates realistic clinical, genetic, and treatment response profiles. These synthetic datasets capture essential features such as age, gender, baseline depression severity, genetic markers (5HTTLPR, BDNF, COMT, FKBP5), treatment history, and comorbidities including anxiety and chronic pain. We employed Gradient Boosting and Neural Network classifiers to predict treatment response probabilities based on individual patient profiles. These models achieved moderate classification accuracy, with a tendency to predict responders more reliably than non-responders. To further optimize treatment strategies, we integrated a Dueling DQN Reinforcement Learning agent trained within a custom-designed environment that simulates multi-step treatment processes, side effect profiles, and severity progression. While the reinforcement learning agent successfully optimized sequential treatment selections and reduced symptom severity, it did not achieve remission under the current reward configuration, suggesting the need for further reward function tuning. An enhanced clinical decision support system was developed to generate top treatment recommendations with natural language explanations, facilitating transparent and interpretable clinical guidance. This research demonstrates the potential of using synthetic patient simulations and reinforcement learning to advance precision psychiatry, enabling data-driven, patient-specific treatment strategies while addressing ethical and logistical barriers associated with real-world psychiatric data.

Cite this paper

Filippis, R. D. and Foysal, A. A. (2025). Personalized Antidepressant Treatment Recommendation Using Reinforcement Learning and Predictive Modelling on Synthetic Patient Data . Open Access Library Journal, 12, e13957. doi: http://dx.doi.org/10.4236/oalib.1113957.

References

[1]  Proudman, D., Greenberg, P. and Nellesen, D. (2021) The Growing Burden of Major Depressive Disorders (MDD): Implications for Researchers and Policy Makers. PharmacoEconomics, 39, 619-625. https://doi.org/10.1007/s40273-021-01040-7
[2]  Greenberg, P., Chitnis, A., Louie, D., Suthoff, E., Chen, S., Maitland, J., et al. (2023) The Economic Bur-den of Adults with Major Depressive Disorder in the United States (2019). Ad-vances in Therapy, 40, 4460-4479. https://doi.org/10.1007/s12325-023-02622-x
[3]  Papakostas, G.I., Pe-tersen, T., Mahal, Y., Mischoulon, D., Nierenberg, A.A. and Fava, M. (2004) Quality of Life Assessments in Major Depressive Disorder: A Review of the Lit-erature. General Hospital Psychiatry, 26, 13-17. https://doi.org/10.1016/j.genhosppsych.2003.07.004
[4]  Mrazek, D.A., Hornberger, J.C., Altar, C.A. and Degtiar, I. (2014) A Review of the Clinical, Economic, and Societal Burden of Treatment-Resistant Depression: 1996-2013. Psychiatric Services, 65, 977-987. https://doi.org/10.1176/appi.ps.201300059
[5]  Gureje, O., Kola, L. and Afolabi, E. (2007) Epidemiology of Major Depressive Disorder in Elderly Nige-rians in the Ibadan Study of Ageing: A Community-Based Survey. The Lancet, 370, 957-964. https://doi.org/10.1016/s0140-6736(07)61446-9
[6]  Voineskos, D., Daskalakis, Z.J. and Blumberger, D.M. (2020) Management of Treat-ment-Resistant Depression: Challenges and Strategies. Neuropsychiatric Disease and Treatment, 16, 221-234. https://doi.org/10.2147/ndt.s198774
[7]  de Sousa, R.T., V. Zanetti, M., R. Brunoni, A. and Machado-Vieira, R. (2015) Chal-lenging Treatment-Resistant Major Depressive Disorder: A Roadmap for Im-proved Therapeutics. Current Neuropharmacology, 13, 616-635. https://doi.org/10.2174/1570159x13666150630173522
[8]  Al-Harbi, K.S. (2012) Treatment-Resistant Depression: Therapeutic Trends, Challenges, and Future Directions. Patient Preference and Adherence, 6, 369-388. https://doi.org/10.2147/ppa.s29716
[9]  Pandarakalam, J.P. (2018) Chal-lenges of Treatment-Resistant Depression. Psychiatria Danubina, 30, 273-284. https://doi.org/10.24869/psyd.2018.273
[10]  Eap, C.B., Gründer, G., Baumann, P., Ansermot, N., Conca, A., Corruble, E., et al. (2021) Tools for Op-timising Pharmacotherapy in Psychiatry (Therapeutic Drug Monitoring, Molec-ular Brain Imaging and Pharmacogenetic Tests): Focus on Antidepressants. The World Journal of Biological Psychiatry, 22, 561-628.
[11]  Hengartner, M.P. (2022) Evidence-Biased Antidepressant Prescription: Overmedicalisation, Flawed Research, and Conflicts of Interest. Palgrave Macmillan.
[12]  Zeier, Z., Carpenter, L.L., Kalin, N.H., Rodriguez, C.I., McDonald, W.M., Widge, A.S., et al. (2018) Clinical Implementation of Pharmacogenetic Decision Support Tools for Antidepressant Drug Prescribing. American Journal of Psychiatry, 175, 873-886. https://doi.org/10.1176/appi.ajp.2018.17111282
[13]  Webb, C.A., Trivedi, M.H., Cohen, Z.D., Dillon, D.G., Fournier, J.C., Goer, F., et al. (2018) Personalized Prediction of Antidepressant V. Placebo Response: Evidence from the EMBARC Study. Psychological Medicine, 49, 1118-1127. https://doi.org/10.1017/s0033291718001708
[14]  Ionescu, D.F., Rosen-baum, J.F. and Alpert, J.E. (2015) Pharmacological Approaches to the Challenge of Treatment-Resistant Depression. Dialogues in Clinical Neuroscience, 17, 111-126. https://doi.org/10.31887/dcns.2015.17.2/dionescu
[15]  Sabaté, E. (2003) Adherence to Long-Term Therapies: Evidence for Action. World Health Organization.
[16]  Kane, J.M. (2007) Treatment Adherence and Long-Term Outcomes. CNS Spectrums, 12, 21-26. https://doi.org/10.1017/s1092852900026304
[17]  Costello, K., Kennedy, P. and Scanzillo, J.O. (2008) Recognizing Nonadherence in Patients with Multiple Sclerosis and Maintaining Treatment Adherence in the Long Term. The Med-scape Journal of Medicine, 10, Article 225.
[18]  Holsboer, F. (2008) How Can We Realize the Promise of Personalized Antidepressant Medicines? Nature Re-views Neuroscience, 9, 638-646. https://doi.org/10.1038/nrn2453
[19]  Si-mon, G.E. and Perlis, R.H. (2010) Personalized Medicine for Depression: Can We Match Patients with Treatments? American Journal of Psychiatry, 167, 1445-1455. https://doi.org/10.1176/appi.ajp.2010.09111680
[20]  Perna, G., Alciati, A., Daccò, S., Grassi, M. and Caldirola, D. (2020) Personalized Psychi-atry and Depression: The Role of Sociodemographic and Clinical Variables. Psy-chiatry Investigation, 17, 193-206. https://doi.org/10.30773/pi.2019.0289
[21]  Perlis, R.H. (2016) Abandoning Personalization to Get to Precision in the Pharmacotherapy of Depression. World Psychiatry, 15, 228-235. https://doi.org/10.1002/wps.20345
[22]  Ritchie, M.D. (2018) Large-Scale Analysis of Genetic and Clinical Patient Data. Annual Review of Biomedical Data Science, 1, 263-274. https://doi.org/10.1146/annurev-biodatasci-080917-013508
[23]  Molla, G. and Bitew, M. (2024) Revolutionizing Personalized Medicine: Synergy with Mul-ti-Omics Data Generation, Main Hurdles, and Future Perspectives. Biomedicines, 12, Article 2750. https://doi.org/10.3390/biomedicines12122750
[24]  Lightbody, G., Haberland, V., Browne, F., Taggart, L., Zheng, H., Parkes, E., et al. (2019) Re-view of Applications of High-Throughput Sequencing in Personalized Medicine: Barriers and Facilitators of Future Progress in Research and Clinical Application. Briefings in Bioinformatics, 20, 1795-1811. https://doi.org/10.1093/bib/bby051
[25]  Xu, Y.X., Zheng, X.K., Li, Y.J., Ye, X.M., Cheng, H.T., Wang, H. and Lyu, J. (2023) Exploring Patient Medication Adherence and Data Mining Methods in Clinical Big Data: A Contemporary Re-view. Journal of Evidence-Based Medicine, 16, 342-375. https://doi.org/10.1111/jebm.12548
[26]  Hulsen, T., Jamuar, S.S., Moody, A.R., Karnes, J.H., Varga, O., Hedensted, S., et al. (2019) From Big Data to Preci-sion Medicine. Frontiers in Medicine, 6, Article 34. https://doi.org/10.3389/fmed.2019.00034
[27]  Hsin, H., Fromer, M., Peter-son, B., Walter, C., Fleck, M., Campbell, A., et al. (2018) Transforming Psychia-try into Data-Driven Medicine with Digital Measurement Tools. npj Digital Medi-cine, 1, Article No. 37. https://doi.org/10.1038/s41746-018-0046-0
[28]  Gillan, C.M. and Whelan, R. (2017) What Big Data Can Do for Treatment in Psychiatry. Current Opinion in Behavioral Sciences, 18, 34-42. https://doi.org/10.1016/j.cobeha.2017.07.003
[29]  Omiyefa, S. (2025) Arti-ficial Intelligence and Machine Learning in Precision Mental Health Diagnostics and Predictive Treatment Models. International Journal of Research Publication and Reviews, 6, 85-99. https://doi.org/10.55248/gengpi.6.0325.1107
[30]  de Filippis, R. and Al Foysal, A. (2025) AI-Driven Policy Testing for Mental Health Crisis Response: An Agent-Based Modelling and Reinforcement Learning Approach. Open Access Library, 12, 1-20. https://doi.org/10.4236/oalib.1113507
[31]  Roayaei, M. and Soltani, Z. (2025) Advancing Healthcare: Reinforcement Learning Applica-tions for Personalized Healthcare. In: Innovations in Biomedical Engineering: Trends in Scientific Advances and Applications, Elsevier, 33-86. https://doi.org/10.1016/b978-0-443-30146-9.00002-2
[32]  Al-Hamadani, M., Fadhel, M., Alzubaidi, L. and Harangi, B. (2024) Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review. Sensors, 24, Article 2461. https://doi.org/10.3390/s24082461
[33]  Lu, Z.H., Yang, M., Pan, C.H., Zheng, P.Y. and Zhang, S.X. (2022) Multi-Modal Deep Learning Based on Mul-ti-Dimensional and Multi-Level Temporal Data Can Enhance the Prognostic Pre-diction for Multi-Drug Resistant Pulmonary Tuberculosis Patients. Science in One Health, 1, Article 100004. https://doi.org/10.1016/j.soh.2022.100004
[34]  Li, T., Shi, W.Q., Isgut, M. Zhong, Y.S., Lais, P., et al. (2023) Integrating Multi-Omics Data with EHR for Precision Medicine Using Advanced Artificial Intelligence. IEEE Reviews in Bio-medical Engineering, 17, 80-97. https://doi.org/10.1109/rbme.2023.3324264
[35]  Clayton, A.D., Schweidtmann, A.M., Clemens, G., Manson, J.A., Taylor, C.J., Niño, C.G., et al. (2020) Automated Self-Optimisation of Multi-Step Reaction and Separation Processes Using Machine Learning. Chemical Engineering Journal, 384, Article 123340. https://doi.org/10.1016/j.cej.2019.123340
[36]  Chakravarty, K., Antontsev, V., Bundey, Y. and Varshney, J. (2021) Driving Success in Personal-ized Medicine through AI-Enabled Computational Modeling. Drug Discovery Today, 26, 1459-1465. https://doi.org/10.1016/j.drudis.2021.02.007
[37]  Akkur, M., Singh, B.P., R, P., Singh, T., Panda, B. and Marwaha, P. (2025) Sequential Optimization of Healthcare Processes Using Reinforcement Learning and Sequential Function Models. 2025 International Conference on Automation and Computation (AU-TOCOM), Dehradun, 4-6 March 2025, 631-636. https://doi.org/10.1109/autocom64127.2025.10956379
[38]  Silveira, I., Sil-va, L., Veladas, F., Braga, R. and Gamboa, H. (2024) Synple: A Platform for Pri-vacy Preserving Synthetic Patient Data Generation. In: IFIP Advances in Infor-mation and Communication Technology, Springer, 139-151. https://doi.org/10.1007/978-3-031-63851-0_9
[39]  álvarez Gamero, S. (2025) Pipeline Development for Realistic Synthetic Database Generation of SPECT Neuroimaging.
[40]  Panfilo, D., Boudewijn, A., Saccani, S., Coser, A., Svara, B., Chauvenet, C.R., et al. (2023) A Deep Learning-Based Pipeline for the Generation of Synthetic Tabular Data. IEEE Access, 11, 63306-63323. https://doi.org/10.1109/access.2023.3288336
[41]  Frye, M. and Schmitt, R.H. (2020) Structured Data Preparation Pipeline for Machine Learn-ing-Applications in Production. 17th IMEKO TC 10 and EUROLAB Virtual Con-ference, Online, 20-22 October 2020, 241-246.
[42]  Kautzky, A., Möller, H., Dold, M., Bartova, L., Seemüller, F., Laux, G., et al. (2020) Combining Machine Learning Algorithms for Prediction of Antidepressant Treatment Response. Acta Psychiatrica Scandinavica, 143, 36-49. https://doi.org/10.1111/acps.13250
[43]  Rajpurkar, P., Yang, J., Dass, N., Vale, V., Keller, A.S., Irvin, J., et al. (2020) Evaluation of a Machine Learning Model Based on Pretreatment Symptoms and Electroencephalographic Features to Predict Outcomes of Antidepressant Treatment in Adults with Depression: A Prespecified Secondary Analysis of a Randomized Clinical Trial. JAMA Network Open, 3, e206653. https://doi.org/10.1001/jamanetworkopen.2020.6653
[44]  Katzman, J.L., Shaham, U., Cloninger, A., Bates, J., Jiang, T. and Kluger, Y. (2018) Deepsurv: Personalized Treatment Recommender System Using a Cox Proportional Haz-ards Deep Neural Network. BMC Medical Research Methodology, 18, Article No. 24. https://doi.org/10.1186/s12874-018-0482-1
[45]  Sharma, D., Singh Aujla, G. and Bajaj, R. (2021) Deep Neuro-Fuzzy Approach for Risk and Severity Prediction Using Recommendation Systems in Connected Health Care. Transac-tions on Emerging Telecommunications Technologies, 32, e4159. https://doi.org/10.1002/ett.4159
[46]  Tardini, E. (2021) Recursive Me-ta-Reinforcement Learning for Personalized Sequential Dynamic Treatment Policies. Master’s Thesis, University of Illinois at Chicago.
[47]  Rajawar, R.S. (2024) AI-Driven Personalized Sequential Decision-Making in Pharmaceutical Development. Drugs and Clinic, 39, 9-16.
[48]  Liu, S.Q., See, K.C., Ngiam, K.Y., Celi, L.A., Sun, X. and Feng, M. (2020) Reinforcement Learning for Clinical Deci-sion Support in Critical Care: Comprehensive Review. Journal of Medical Inter-net Research, 22, e18477. https://doi.org/10.2196/18477
[49]  Hong, N., Liu, C., Gao, J.W., Han, L., Chang, F.X., Gong, M.C. and Su, L.X. (2022) State of the Art of Machine Learning-Enabled Clinical Decision Support in Intensive Care Units: Literature Review. JMIR Medical Informatics, 10, e28781. https://doi.org/10.2196/28781
[50]  Tsoukalas, A., Albertson, T. and Tagkopoulos, I. (2015) From Data to Optimal Decision Making: A Data-Driven, Probabilistic Machine Learning Approach to Decision Support for Patients with Sepsis. JMIR Medical Informatics, 3, e11. https://doi.org/10.2196/medinform.3445
[51]  Adeniran, A.A., Onebunne, A.P. and William, P. (2024) Explainable AI (XAI) in Healthcare: Enhancing Trust and Transparency in Critical Decision-Making. World Journal of Advanced Research and Reviews, 23, 2447-2658. https://doi.org/10.30574/wjarr.2024.23.3.2936
[52]  Elhaddad, M. and Hamam, S. (2024) AI-Driven Clinical Decision Support Systems: An Ongoing Pursuit of Potential. Cureus, 16, e57728. https://doi.org/10.7759/cureus.57728
[53]  Cutillo, C.M., Sharma, K.R., Foschini, L., Kundu, S., Mackintosh, M., Mandl, K.D., et al. (2020) Machine In-telligence in Healthcare—Perspectives on Trustworthiness, Explainability, Usa-bility, and Transparency. npj Digital Medicine, 3, Article No. 47. https://doi.org/10.1038/s41746-020-0254-2
[54]  Tuan, D.A. (2024) Bridg-ing the Gap between Black Box AI and Clinical Practice: Advancing Explainable AI for Trust, Ethics, and Personalized Healthcare Diagnostics.
[55]  Eke, C.I. and Shuib, L. (2025) The Role of Explainability and Transparency in Fostering Trust in AI Healthcare Systems: A Systematic Literature Review, Open Issues and Po-tential Solutions. Neural Computing and Applications, 37, 1999-2034. https://doi.org/10.1007/s00521-024-10868-x
[56]  Jacob, C., Brasier, N., Laurenzi, E., Heuss, S., Mougiakakou, S., Cöltekin, A., et al. (2025) AI for IM-PACTS Framework for Evaluating the Long-Term Real-World Impacts of Ai-Powered Clinician Tools: Systematic Review and Narrative Synthesis. Journal of Medical Internet Research, 27, e67485. https://doi.org/10.2196/67485
[57]  Törnqvist, M., Zucker, J., Fauvel, T., Lambert, N., Berthelot, M. and Movschin, A. (2025) A Text-to-Tabular Ap-proach to Generate Synthetic Patient Data Using LLMs. 2025 IEEE 13th Inter-national Conference on Healthcare Informatics (ICHI), Rende, 18-21 June 2025, 18-29. https://doi.org/10.1109/ichi64645.2025.00011
[58]  Gamble, A. (2020) Artificial Intelligence and Mobile Apps for Mental Healthcare: A Social Informatics Perspective. Aslib Journal of Information Management, 72, 509-523. https://doi.org/10.1108/ajim-11-2019-0316
[59]  Galderisi, S., Appelbaum, P.S., Gill, N., Gooding, P., Herrman, H., Melillo, A., et al. (2024) Ethical Challenges in Contemporary Psychiatry: An Overview and an Appraisal of Possible Strategies and Research Needs. World Psychiatry, 23, 364-386. https://doi.org/10.1002/wps.21230
[60]  Job, S., Tao, X.H., Li, L., Xie, H.R., Cai, T.T., Yong, J.M. and Li, Q. (2024) Optimal Treatment Strategies for Critical Pa-tients with Deep Reinforcement Learning. ACM Transactions on Intelligent Sys-tems and Technology, 15, 1-22. https://doi.org/10.1145/3643856
[61]  Terven, J. (2025) Deep Reinforce-ment Learning: A Chronological Overview and Methods. AI, 6, Article 46. https://doi.org/10.3390/ai6030046
[62]  Yazzourh, S. (2024) Reinforcement Learning and Bayesian Outcome-Weighted Learning for Precision Medicine: In-tegrating Medical Knowledge into Decision-Making Algorithms. PhD Disserta-tion, Université de Toulouse.
[63]  Drevets, W.C., Wittenberg, G.M., Bullmore, E.T. and Manji, H.K. (2022) Immune Targets for Therapeutic Development in Depression: Towards Precision Medicine. Nature Reviews Drug Discovery, 21, 224-244. https://doi.org/10.1038/s41573-021-00368-1
[64]  Gurcan, F. and Soylu, A. (2024) Learning from Imbalanced Data: Integration of Advanced Resampling Techniques and Machine Learning Models for Enhanced Cancer Diagnosis and Prognosis. Cancers, 16, Article No. 3417. https://doi.org/10.3390/cancers16193417
[65]  Moncy, J.C., Fan, Y. and Fu, C.H.Y. (2024) Prediction of Treatment Outcome to Transcranial Direct Current Stimulation in Major Depression Based on Deep Learning of EEG Data. 2024 IEEE Conference on Artificial Intelligence (CAI), Singapore, 25-27 June 2024, 1123-1128. https://doi.org/10.1109/cai59869.2024.00201
[66]  Burcu, M., Manzano-Salgado, C.B., Butler, A.M. and Christian, J.B. (2022) A Framework for Extension Studies Using Real-World Data to Examine Long-Term Safety and Ef-fectiveness. Therapeutic Innovation & Regulatory Science, 56, 15-22. https://doi.org/10.1007/s43441-021-00322-8
[67]  Schneeweiss, S. and Pa-torno, E. (2021) Conducting Real-World Evidence Studies on the Clinical Out-comes of Diabetes Treatments. Endocrine Reviews, 42, 658-690. https://doi.org/10.1210/endrev/bnab007
[68]  Olalekan Kehinde, A. (2025) Leveraging Machine Learning for Predictive Models in Healthcare to Enhance Patient Outcome Management. International Research Journal of Modernization in Engineering Technology and Science, 7, Article 1465.
[69]  Baydili, İ., Tasci, B. and Tasci, G. (2025) Artificial Intelligence in Psychiatry: A Review of Biologi-cal and Behavioral Data Analyses. Diagnostics, 15, Article 434. https://doi.org/10.3390/diagnostics15040434

Full-Text


Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133