Special Issue
Innovations in Biomedical Research and Clinical Medicine
Guest Editor: Editorial Board — Journal of Biomedical Research & Environmental Sciences
Submission
Covid-19 Research
Safety Profile of COVID-19 Vaccines: Retrospective Analysis of Short, Medium, and Long-Term Side Effects: The Military Hospital Experience – Read more Evaluating the Efficacy of Different SARS-Cov-2 Drug Targets Using the Topo-Geometrical Superposition Algorithm, Molecular Docking and Chemical Reactivity Frameworks – Read more Preventing COVID-19 Infection by Complementary Medicine and Oral Health – Read more Analysis of Body Temperature in Patients with Trauma Visiting a Local Emergency Medical Center during the SARS-CoV-2 Outbreak – Read more N95 Respirator Fit Testing Experience during the Pandemic at a Singapore Tertiary Health Institution: Streamlining Workflow and Improving Respirator Fit Rate – Read more COVID-19 is an Amplifier of Social Inequalities Structural Violence against Students with Special Learning Needs and Low Socio-Economic Status – Read more Interaction between Chronic Influenza and COVID-19: Novel Aspects of Immune System Combat – Read more Daily Life, Fear of COVID-19 and Social Support in the Older Adults in Home Isolation: A Cross-Sectional Study – Read more The Impact of COVID-19 Pandemic on Cardiovascular Diseases in Brazil – Read more Diversity of Non-Influenza Respiratory Viruses Associated with Influenza-Like Illness during 2009 pre and pandemic periods in Sao Paulo, Brazil, a Historical Overview – Read more Cardiovascular Complications of SARS-CoV-2 (COVID-19) in Adults – Read more Impact of COVID-19 Pandemic on the Development of Childrens Executive Functions Implications for School-Based Interventions – Read more The Impact of the COVID-19 Pandemic on Youth Education – Read more Association between Dietary Habits, Lifestyle and Migraine Attacks During Social Isolation in the COVID-19 Pandemic: A Systematic Review of Observational Studies – Read more The Brazilian Increase in Cases of Lung Cancer and COVID-19, Can They be related? – Read more The Possible Therapeutic Application of CO on COVID-19 – Read more Planetary View of COVID Impact vs. IQ & PISA Rank as National Level of Intelligence – Read more Electrophysiological Study in a Patient with Visual Deficit after Severe Coronavirus 2 Pneumonia – Read more A Presentation of Analyses of COVID-19 Vaccine Samples, Blood Samples, Urine Samples, Foot Bath Samples, Sitz Bath Samples, and Skin-Extract Samples – Read more Is Anosmia-Ageusia in COVID-19 Patients Associated with Neuro-Philic Virus Mutant and Mild Respiratory Involvement? – Read more
Home/ All Articles/ Multimodal Lesion Classification and Automated Interpretation Algorithm using Image-Captio…

Abstract & Article Details

Research Article • Vol.7, Issue 8 • ISSN: 2766-2276 • Open Access • CC BY 4.0

Open Access Research Article Vol.7, Issue 8 August 5, 2026

Multimodal Lesion Classification and Automated Interpretation Algorithm using Image-Caption Pairs of Pediatric Abdominal X-ray Synthetic Data Provided by AI-Hub

DOI: 10.37871/jbres2321
Authors
Hana Yoo and Youngbok Cho*
FullText PDF

Abstract

Background: Automated lesion classification and interpretation of pediatric abdominal X-rays is clinically important but constrained by data scarcity and strict privacy regulations. Synthetic image-caption pair datasets offer a practical solution. Methods: We used the AI Hub synthetic pediatric abdominal X-ray dataset (10,000 image-caption pairs, five disease classes, stratified 8:1:1 split with atomic pair splitting to prevent data leakage) to develop a BioMedCLIP-based multimodal system. The system integrates a ViT-B/16 visual encoder fine-tuned with InfoNCE contrastive loss, an MLP classification head with MC Dropout for uncertainty quantification (T = 20 forward passes), and a three-tier confidence-conditioned report generation module. Clinical performance was assessed using accuracy, sensitivity, specificity, precision, and F1-score; report generation was assessed with BLEU-4, ROUGE-L, and CIDEr. ResNet-50 (B1) and DenseNet-121 (B2) served as classification baselines; template-based (B_tmpl) and LLaVA-Med (B3) as generation baselines. Results: The proposed model achieved accuracy 97.95%, sensitivity 91.57%, specificity 96.28%, and macro F1-score 93.49%, outperforming B1 (+5.04 pp) and B2 (+2.55 pp) in accuracy. For report generation, BLEU-4 6.46, ROUGE-L 20.51, and CIDEr 49.26 exceeded both baselines on all metrics. Grad-CAM analysis confirmed anatomically plausible attention patterns. Conclusions: Multimodal vision-language contrastive learning on synthetic image-caption data yields consistent gains over single-modality baselines. The sim-to-real distribution gap and the need for external clinical validation are identified as the primary barriers to clinical translation.

How to Cite

Hana Yoo and Youngbok Cho* (2026). Multimodal Lesion Classification and Automated Interpretation Algorithm using Image-Caption Pairs of Pediatric Abdominal X-ray Synthetic Data Provided by AI-Hub. Journal of Biomedical Research & Environmental Sciences, 7(8). https://doi.org/10.37871/jbres2321

Article Information

JournalJournal of Biomedical Research & Environmental Sciences (JBRES)
ISSN2766-2276
DOI DOI 10.37871/jbres2321
Volume / IssueVol. 7, Issue 8
ReceivedAugust 16, 2026
AcceptedAugust 1, 2026
PublishedAugust 5, 2026
Article TypeResearch Article
Pages1-13
LicenseCC BY 4.0 — Open Access
PublisherSciRes Literature LLC, Sheridan, WY, USA
LanguageEnglish
Creative Commons BY 4.0

Published under CC BY 4.0 — free to share, copy, adapt, and redistribute with attribution.

Certificate of Publication

Certificate of Publication — Multimodal Lesion Classification and Automated Interpretation Algorithm using Image-Caption Pairs of Pediatric Abdominal X-ray Synthetic Data Provided by AI-Hub

Certificate verifies that this article was peer-reviewed and published in the Journal of Biomedical Research & Environmental Sciences.

Publish with JBRES — Peer-reviewed, multidisciplinary Open Access with rigorous double-blind review, CrossRef DOI, and global visibility.
Double-Blind CrossRef DOI Discoverable