language English
Article 2025 · 2 atıf

Reading systemic disease from the feline fundus: A multicenter comparison of multimodal large language models and veterinary clinicians

Eren, Emre, Ilgun, Murat, Kibar, Busra, Okur, Sitkican, Arslan, Taner, Aktas, Mustafa Sinan, Eroglu, Muhammed Sertac

Özet

This multicenter observer-performance study evaluated whether systemic diseases in cats can be inferred from fundus images and structured fundus descriptors and compared the diagnostic performance of large language models (LLMs) with experienced and novice veterinary clinicians. A total of 50 feline cases with representative fundus photographs and harmonized descriptors were retrospectively collected from three centers in T & uuml;rkiye. Each case was assigned a single canonical diagnosis by a masked expert panel. Two LLMs (ChatGPT-5, ChatGPT-5 Thinking) are tested in text-only and text and image (multimodal) modes and compared with two expert ophthalmologists and two novice clinicians. The primary endpoint was an ordinal diagnostic score (0-3), while secondary endpoints included Top-1/Top-2/Top-3 accuracy, inter-reader agreement, and response times. Multimodal LLMs achieved near-expert diagnostic performance, with Top-1, Top-2, and Top-3 accuracies ranging from 34 % to 46 %, 62-74 %, and 74-86 %, respectively. Multimodal LLMs performed significantly better than novice readers (p < 0.05), whereas no significant differences were found between LLMs and expert clinicians. Response times were substantially shorter for LLMs (13.7-84.6 s) compared to humans (117-132 s), indicating potential workflow efficiency gains. These findings suggest that multimodal LLMs can provide rapid, near-expert-level diagnostic support in interpreting feline fundus images for systemic disease screening. Incorporating LLM assisted analysis into veterinary ophthalmology workflows could enhance diagnostic efficiency without compromising clinician oversight.

Anahtar Kelimeler
Retinal imaging Reader study Observer performance Inter-rater agreement Proportional odds model Clinical decision support CATS
WoS Kategorileri
Veterinary Sciences
Künye
Dergi
VETERINARY JOURNAL
Yıl
2025
Cilt
314
ISSN
1090-0233
eISSN
1532-2971
DOI
10.1016/j.tvjl.2025.106476
WoS UID
WOS:001615213200001
Yayını aç (DOI)