Spin Practices and Low Reporting Quality in Studies on Prediction Model of Diagnosis Based on TCM Information: A Systematic Review and Evidence Mapping

Jieyun Li; Jiekee Lim; Xinang; Mi Zhou; Zhaoxia Xu*

Jieyun Li, Jiekee Lim, Xinang, Mi Zhou and Zhaoxia Xu*

Volume5-Issue2
Dates: Received: 2024-01-12 | Accepted: 2024-02-06 | Published: 2024-02-07
Pages: 117-134

Abstract

Background: Despite the abundance of published studies on prediction models for diagnosing Traditional Chinese Medicine (TCM), there remains a lack of comprehensive assessment regarding reporting and methodological quality, as well as an absence of examination into the objectivity of linguistic aspects within these studies.

Methods: The PubMed, Cochrane Library, Web of Science, CNKI, VIP, and WANFANG databases were systematically searched from inception to October 30th, 2023, to identify studies developing and/or validating diagnostic and prognostic TCM prediction models using supervised machine learning. PROBAST and TRIPOD were employed to assess the reporting and methodological quality of identified studies. A previous article about spin in prognostic factor studies already identified several practices, which we modified for our data extraction the present study was registered on PROSPERO with the registration number CRD42023450907.

Results: 35 and 19 eligible studies published in Chinese and English were identified respectively from 1746 records. The clinical diseases with the most publications were diabetes (n = 7, 14.8%), coronary heart disease (n = 6, 11.1%), and lung cancer (n = 5, 9.26%). Primary analysis and sensitivity analysis confirmed that the reporting and methodological quality of included studies were correlated (rs = 0.504, p < 0.001). The quality of the CM prediction model requires improvement by including a structured title, participants and predictor’s selection, statistical analysis methods, model performance and interpretation. Two studies (4.55%) recommended the model to be used in daily practice lacked any external validation of the developed models. Six studies (13.63%) made recommendations for clinical use in their main text without any external validation. Reporting guidelines were only cited in one study (1.85%).

Conclusion: The available evidence indicated TCM information can provide predict information for different diseases, but the scientific quality of published studies needs to be improved.

FullText HTML FullText PDF DOI: 10.37871/jbres1878

Certificate of Publication

Copyright

How to cite this article

Li J, Lim J, Xiao X, Zhou M, Xu Z. Spin Practices and Low Reporting Quality in Studies on Prediction Model of Diagnosis Based on TCM Information: A Systematic Review and Evidence Mapping. J Biomed Res Environ Sci. 2024 Feb 07; 5(2): 117-134. doi: 10.37871/jbres1878, Article ID: JBRES1878, Available at: https://www.jelsciences.com/articles/jbres1878.pdf

Subject area(s)

Alternative Medicine

Epidemiology

References

Li Z, Ren X, Xiao L, Qi J, Fu T, Li W. Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology. J Healthc Eng. 2022 Mar 29;2022:9372807. doi: 10.1155/2022/9372807. PMID: 35392154; PMCID: PMC8983244.
Li G, Guo Y. Exploring the Medication Pattern of Chinese Medicine for Peptic Ulcer Based on Data Mining. J Healthc Eng. 2021 Nov 11;2021:9072172. doi: 10.1155/2021/9072172. Retraction in: J Healthc Eng. 2022 Nov 29;2022:9782953. PMID: 34804461; PMCID: PMC8601794.
Wang W, Zeng W, He S, Shi Y, Chen X, Liping Tu, Yang B, Xu J, Yin X. A new model for predicting the occurrence of polycystic ovary syndrome: based on data of tongue and pulse. Digital health 2023;9:20552076231160323. doi/10.1177/20552076231160323.
Shi YL, Liu JY, Hu XJ, Tu LP, Cui J, Li J, Bi ZJ, Li JC, Xu L, Xu JT. A New Method for Syndrome Classification of Non-Small-Cell Lung Cancer Based on Data of Tongue and Pulse with Machine Learning. Biomed Res Int. 2021 Aug 11;2021:1337558. doi: 10.1155/2021/1337558. PMID: 34423031; PMCID: PMC8373490.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015 Jan 7;350:g7594. doi: 10.1136/bmj.g7594. PMID: 25569120.
Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, Reitsma JB, Kleijnen J, Mallett S; PROBAST Group†. PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Ann Intern Med. 2019 Jan 1;170(1):51-58. doi: 10.7326/M18-1376. PMID: 30596875.
Li Q, Chi L, Zhao W, et al. Machine learning prediction of motor function in chronic stroke patients: a systematic review and meta-analysis. Frontiers in neurology 2023;14:1039794.
Andaur Navarro CL, Damen JAA, Takada T, Nijman SWJ, Dhiman P, Ma J, Collins GS, Bajpai R, Riley RD, Moons KGM, Hooft L. Systematic review finds "spin" practices and poor reporting standards in studies on machine learning-based prediction models. J Clin Epidemiol. 2023 Jun;158:99-110. doi: 10.1016/j.jclinepi.2023.03.024. Epub 2023 Apr 5. PMID: 37024020.
Sensever FA, de Lucena Alves CP, Lima GDS, Loomans B, Opdam N, Pereira-Cenci T. Spin and reporting in systematic reviews with meta-analysis of randomized clinical trials in restorative dentistry. J Dent. 2022 Oct;125:104282. doi: 10.1016/j.jdent.2022.104282. Epub 2022 Sep 7. PMID: 36084762.
Chiu K, Grundy Q, Bero L. 'Spin' in published biomedical literature: A methodological systematic review. PLoS Biol. 2017 Sep 11;15(9):e2002173. doi: 10.1371/journal.pbio.2002173. PMID: 28892482; PMCID: PMC5593172.
Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021 Mar 29;372:n71. doi: 10.1136/bmj.n71. PMID: 33782057; PMCID: PMC8005924.
Cumpston M, Li T, Page MJ, Chandler J, Welch VA, Higgins JP, Thomas J. Updated guidance for trusted systematic reviews: a new edition of the Cochrane Handbook for Systematic Reviews of Interventions. Cochrane Database Syst Rev. 2019 Oct 3;10(10):ED000142. doi: 10.1002/14651858.ED000142. PMID: 31643080; PMCID: PMC10284251.
Kempf E, de Beyer JA, Cook J, Holmes J, Mohammed S, Nguyên TL, Simera I, Trivella M, Altman DG, Hopewell S, Moons KGM, Porcher R, Reitsma JB, Sauerbrei W, Collins GS. Overinterpretation and misreporting of prognostic factor studies in oncology: a systematic review. Br J Cancer. 2018 Nov;119(10):1288-1296. doi: 10.1038/s41416-018-0305-5. Epub 2018 Oct 24. PMID: 30353050; PMCID: PMC6251031.
Lu C, Ke L, Li J, Zhao H, Lu T, Mentis AFA, Wang Y, Wang Z, Polissiou MG, Tang L, Tang H, Yang K. Saffron (Crocus sativus L.) and health outcomes: a meta-research review of meta-analyses and an evidence mapping study. Phytomedicine. 2021 Oct;91:153699. doi: 10.1016/j.phymed.2021.153699. Epub 2021 Aug 8. PMID: 34419735.
Lu C, Ke L, Li J, Wu S, Feng L, Wang Y, Mentis AFA, Xu P, Zhao X, Yang K. Chinese Medicine as an Adjunctive Treatment for Gastric Cancer: Methodological Investigation of meta-Analyses and Evidence Map. Front Pharmacol. 2022 Jan 10;12:797753. doi: 10.3389/fphar.2021.797753. PMID: 35082677; PMCID: PMC8784830.
Harrison JE, Weber S, Jakob R, Chute CG. ICD-11: an international classification of diseases for the twenty-first century. BMC Med Inform Decis Mak. 2021 Nov 9;21(Suppl 6):206. doi: 10.1186/s12911-021-01534-6. PMID: 34753471; PMCID: PMC8577172.
Chapman SJ, Drake TM, Bolton WS, Barnard J, Bhangu A. Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals. Br J Surg. 2017 Feb;104(3):198-204. doi: 10.1002/bjs.10423. Epub 2016 Dec 21. PMID: 28001294.
Chen X, Wang Y, Zhang L, Xu X. Construction and Evaluation of Neural Network Correlation Model between Syndrome Elements and Physical and Chemical Indexes of Unstable Angina Pectoris Complicated with Anxiety. Comput Math Methods Med. 2022 Aug 21;2022:6217186. doi: 10.1155/2022/6217186. Retraction in: Comput Math Methods Med. 2023 Oct 4;2023:9807987. PMID: 36045947; PMCID: PMC9420622.
Ding L, Zhang XY, Wu DY, Liu ML. Application of an extreme learning machine network with particle swarm optimization in syndrome classification of primary liver cancer. J Integr Med. 2021 Sep;19(5):395-407. doi: 10.1016/j.joim.2021.08.001. Epub 2021 Aug 4. PMID: 34462241.
Hao Y, Cheng F, Pham M, Rein H, Patel D, Fang Y, Feng Y, Yan J, Song X, Yan H, Wang Y. A Noninvasive, Economical, and Instant-Result Method to Diagnose and Monitor Type 2 Diabetes Using Pulse Wave: Case-Control Study. JMIR Mhealth Uhealth. 2019 Apr 23;7(4):e11959. doi: 10.2196/11959. PMID: 31012863; PMCID: PMC6658300.
Jiang T, Guo XJ, Tu LP, Lu Z, Cui J, Xiang Ma X, juan Hu X, Hua Yao X, Tao Cui L, zhi Li Y, Bin Huang J, Xu J. Application of computer tongue image analysis technology in the diagnosis of nafld. Computers in biology and medicine 2021;135:104622. doi: 10.1016/j.compbiomed.2021.104622.
Li J, Chen Q, Hu X, Yuan P, Cui L, Tu L, Cui J, Huang J, Jiang T, Ma X, Yao X, Zhou C, Lu H, Xu J. Establishment of noninvasive diabetes risk prediction model based on tongue features and machine learning techniques. Int J Med Inform. 2021 May;149:104429. doi: 10.1016/j.ijmedinf.2021.104429. Epub 2021 Feb 22. PMID: 33647600.
Li J, Yuan P, Hu X, Huang J, Cui L, Cui J, Ma X, Jiang T, Yao X, Li J, Shi Y, Bi Z, Wang Y, Fu H, Wang J, Lin Y, Pai C, Guo X, Zhou C, Tu L, Xu J. A tongue features fusion approach to predicting prediabetes and diabetes with machine learning. J Biomed Inform. 2021 Mar;115:103693. doi: 10.1016/j.jbi.2021.103693. Epub 2021 Feb 1. PMID: 33540076.
Luo Y, Lin B, Zhao S, He L, Wen C. Neural Network-Based Study about Correlation Model between TCM Constitution and Physical Examination Indexes Based on 950 Physical Examinees. J Healthc Eng. 2020 Sep 1;2020:8812678. doi: 10.1155/2020/8812678. PMID: 32952990; PMCID: PMC7481996.
Luo ZY, Cui J, Hu XJ, Tu LP, Liu HD, Jiao W, Zeng LZ, Jing CC, Qiao LJ, Ma XX, Wang Y, Wang J, Pai CH, Qi Z, Zhang ZF, Xu JT. A Study of Machine-Learning Classifiers for Hypertension Based on Radial Pulse Wave. Biomed Res Int. 2018 Nov 11;2018:2964816. doi: 10.1155/2018/2964816. PMID: 30534557; PMCID: PMC6252205.
Pang B, Zhang D, Li N, Wang K. Computerized tongue diagnosis based on Bayesian networks. IEEE Trans Biomed Eng. 2004 Oct;51(10):1803-10. doi: 10.1109/TBME.2004.831534. PMID: 15490827.
Pang H, Wei S, Zhao Y, He L, Wang J, Liu B, Zhao Y. Effective attention-based network for syndrome differentiation of AIDS. BMC Med Inform Decis Mak. 2020 Oct 15;20(1):264. doi: 10.1186/s12911-020-01249-0. PMID: 33059709; PMCID: PMC7558604.
Qi Z, Zhao ZY, Xu JT, et al. Radial Pulse Wave Signals Combined with Ba-PWV for the Risk Prediction of Hypertension and the Monitoring of Its Accompanying Metabolic Risk Factors. Evidence-based complementary and alternative medicine : eCAM 2020;2020:3926851.
Shi Y, Guo D, Chun Y, Liu J, Liu L, Tu L, Xu J. A lung cancer risk warning model based on tongue images. Front Physiol. 2023 Jun 1;14:1154294. doi: 10.3389/fphys.2023.1154294. PMID: 37324390; PMCID: PMC10267397.
Shi Y, Yao X, Xu J, Hu X, Tu L, Lan F, Cui J, Cui L, Huang J, Li J, Bi Z, Li J. A New Approach of Fatigue Classification Based on Data of Tongue and Pulse With Machine Learning. Front Physiol. 2022 Feb 7;12:708742. doi: 10.3389/fphys.2021.708742. PMID: 35197858; PMCID: PMC8859319.
Wang Q, Zhao C, Qiang Y, Zhao Z, Song K, Luo S. Multitask Interactive Attention Learning Model Based on Hand Images for Assisting Chinese Medicine in Predicting Myocardial Infarction. Comput Math Methods Med. 2021 Oct 26;2021:6046184. doi: 10.1155/2021/6046184. PMID: 34737789; PMCID: PMC8563122.
Xia SJ, Gao BZ, Wang SH, Guttery DS, Li CD, Zhang YD. Modeling of diagnosis for metabolic syndrome by integrating symptoms into physiochemical indexes. Biomed Pharmacother. 2021 May;137:111367. doi: 10.1016/j.biopha.2021.111367. Epub 2021 Feb 13. PMID: 33588265.
Ye H, Gao Y, Zhang Y, Cao Y, Zhao L, Wen L, Wen C. Study on intelligent syndrome differentiation neural network model of stomachache in traditional Chinese medicine based on the real world. Medicine (Baltimore). 2020 May 29;99(22):e20316. doi: 10.1097/MD.0000000000020316. PMID: 32481403.
Zhang J, Xu J, Hu X, Chen Q, Tu L, Huang J Cui J. Diagnostic method of diabetes based on support vector machine and tongue images. BioMed research international 2017;2017:7961494. doi: 10.1155/2017/7961494.
Y Cao, Y Lu, JX Chen, et al. Application of traditional Chinese medicine intelligent syndrome differentiation model for gastroesophageal reflux disease based on machine learning. Journal of Beijing University of TCM, 2019;42(10).
LZ Zeng. Study on diagnostic features and risk model of tongue image in patients with non-small cell lung cancer. Shanghai University of TCM, Doctoral dissertation. 2019.
C Chen. Study on early warning model of coronary heart disease risk event based on four diagnostic parameters of traditional Chinese medicine. Shanghai University of TCM, Doctoral dissertation. 2020.
JL Chen. Establishment of NAFLD prediction model based on tongue diagnosis and correlation study of liver fat content by magnetic resonance imaging. Academy of Chinese Medical Sciences, Doctoral dissertation. 2020.
ML Chen. The tongue image characteristics of lung cancer patients based on digital tongue map. Beijing University of TCM, Masteral dissertation.2022.
RB Chen. Research on diagnosis and prediction model of hyperliver-fire syndrome in hypertension based on XGboost algorithm. Academy of Chinese Medical Sciences, Doctoral dissertation. 2018.
YN Chu. Construction of prediction model and classifier of urticaria syndrome type based on ANN. Guangzhou University of TCM, Masteral dissertation. 2018.
. HR Cui. Research on classification model of TCM syndrome of disintegrating leakage based on machine learning. Changchun University of TCM, Masteral dissertation. 2018.
LL Hu. To study the risk prediction model of coronary heart disease based on the information of four diagnostic methods of traditional chinese medicine. Shanghai University of TCM, Masteral dissertation. 2022.
Jun Li, XJ Hu, LP Tu, et al. A type 2 diabetes risk prediction model based on tongue image parameters combined with multiple index features. Chinese Journal of Basic Medicine of Chinese Medicine, 2021;27(03):451-56+501.
Y Li. Using feature selection and machine learning algorithm to predict TCM syndrome type of patients with rheumatoid arthritis. University of Science and Technology of China, Masteral dissertation. 2020.
Y Li. Clinical prediction model of coronary heart disease combined with chronic heart failure. Guangzhou University of TCM, Masteral dissertation. 2021.
JF Lin. To establish a traditional chinese medicine artificial intelligence syndrome differentiation scheme for depression based on a variety of physiological information and symptoms and signs. Shanghai University of TCM, 2021. Doctoral dissertation.
YT Lin. Analysis of the characteristics of tongue and pulse diagnosis in patients with abnormal blood glucose. Shanghai University of TCM, Masteral dissertation. 2020.
JT Liu. Construction of clinical prediction model of hypertension with left ventricular hypertrophy combined with traditional chinese and western medicine. Tianjing University of TCM, 2020. Masteral dissertation.
Y Liu, P Yuan, X Qi, et al. Study on the diagnostic value of traditional Chinese medicine pulse chart parameters for coronary heart disease in hypertensive patients. Tianjin traditional Chinese medicine, 2022;39(08):982-86.
QJ Ru, WJ Ye, DH Yang, et al. Quantitative assessment of gastric gas in patients with liver failure and its relationship with prognosis. J China Journal of Traditional Chinese Medicine and Pharmacy 2012;27(5):1304-08.
BC Song. Analysis of risk factors and establishment of clinical prediction model for vascular dementia (deficiency stasis syndrome). Beijing University of TCM, Masteral dissertation. 2020.
JR Sun. Correlation study and prediction of tongue image characteristics and myelosuppression after chemotherapy in lung cancer. Beijing University of TCM, Masteral dissertation. 2021.
ZJ Sun, J J, CY Ma, et al. Journal of Hunan University of Chinese Medicine. 2023;43(4).
Tang Y, Li Z, Yang D, Fang Y, Gao S, Liang S, Liu T. Research of insomnia on traditional Chinese medicine diagnosis and treatment based on machine learning. Chin Med. 2021 Jan 6;16(1):2. doi: 10.1186/s13020-020-00409-8. PMID: 33407711; PMCID: PMC7789502.
HP Wang. To study the clinical prediction model of survival prognosis of colorectal cancer liver metastasis involving tcm factors. Academy of Chinese Medical Sciences, Masteral dissertation. 2021.
HW Wang. Construction of diabetic foot risk prediction model based on tongue image. J Trad Chin Med. 2022;63(19).
Q Wang. Exploration of establishing and verifying the diagnosis model of phlegm-stasis syndrome of apoplexy based on lasso regression. J Journal of Zhejiang Chinese Medical University 2023;47(4):416-21.
XR Wang. A preliminary study of artificial intelligence methodology for predicting blood pressure and virtual demonstration based on three-channel pulse information. Beijing University of TCM, Doctoral dissertation. 2021.
Feng W. Clinical prediction model of mci phlegm turbidification blocking oqiao syndrome and clinical study on treating mci phlegm turbidification blocking oqiao syndrome with qianxin decoction. Hubei University of TCM, Doctoral dissertation. 2022.
Y Wu. Establishment of clinical prediction model of COPD complicated with chronic pulmonary heart disease and study on distribution of TCM syndromes. Tianjin University of TCM, 2022. Masteral dissertation.
TW Xia. Based on machine learning, the prediction model of chinese and western multi-modal feature fusion of type 2 diabetes complicated with kidney disease was constructed. Chengdu University of TCM, Doctoral dissertation. 2020.
WW Xu, WJ Gu, GP Liu, et al. Empirical feature selection and syndrome classification recognition of chronic gastritis based on random forest and multi-label learning algorithm. Information Journal of Chinese Medicine. 2016;23(08):18-23.
YQ Xu, JD Yang, Q Jiang, et al. Research on tongue image classification of tcm syndrome based on multi-feature fusion. Intelligent computers and applications. 2022;12(07):25-34.
MB Xu, YF Liu, ZY Zhao, et al. Construction and application of infertility tcm syndrome differentiation model based on artificial intelligence. Chinese Journal of Traditional Chinese Medicine. 2021;36(09):5532-36.
CF Du, JH Yang, Y Yao. Construction of chinese medicine intelligent diagnosis model of perimenopausal syndrome based on integrated learning. J Trad Chin Med 2023;64(6).
Y Yang. Development of clinical prediction model for hospital death of heart failure by combination of chinese and western medicine. Liaoning University of TCM, Doctoral dissertation. 2022.
Y Zhang. Research on prediction model of TCM syndrome type of eczema based on machine learning. Liaoning University of TCM, Masteral dissertation. 2022.
Y Zhao, YS Li, XR Wu. Crack tongue recognition algorithm based on tongue image multi-feature fusion and machine learning. Journal of Yanshan University. 2022;46(06):522-28.
Damen JA, Hooft L, Schuit E, Debray TP, Collins GS, Tzoulaki I, Lassale CM, Siontis GC, Chiocchia V, Roberts C, Schlüssel MM, Gerry S, Black JA, Heus P, van der Schouw YT, Peelen LM, Moons KG. Prediction models for cardiovascular disease risk in the general population: systematic review. BMJ. 2016 May 16;353:i2416. doi: 10.1136/bmj.i2416. PMID: 27184143; PMCID: PMC4868251.
Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014 Jan 18;383(9913):267-76. doi: 10.1016/S0140-6736(13)62228-X. Epub 2014 Jan 8. PMID: 24411647.
Jiang T, Hu XJ, Yao XH, Tu LP, Huang JB, Ma XX, Cui J, Wu QF, Xu JT. Tongue image quality assessment based on a deep convolutional neural network. BMC Med Inform Decis Mak. 2021 May 5;21(1):147. doi: 10.1186/s12911-021-01508-8. PMID: 33952228; PMCID: PMC8097848.
Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009 Jul 4;374(9683):86-9. doi: 10.1016/S0140-6736(09)60329-9. Epub 2009 Jun 12. PMID: 19525005.