Performance of large language models versus clinicians and novices in veterinary theriogenology decision support
Özet
Objective: To compare the clinical decision-support performance of 2 large language models (LLMs), ChatGPT-5 and ChatGPT-5 Thinking, with that of experienced clinicians and novices in veterinary theriogenology. Methods: 15 standardized obstetric and gynecologic scenarios were independently evaluated by 2 expert clinicians, 2 novice veterinarians, and both LLMs under matched, cold-start conditions. Responses were assessed with a 5-point global quality score by a blinded expert panel. Results: ChatGPT-5 Thinking achieved the highest overall quality ratings, followed by ChatGPT-5 and the expert clinicians. Novice veterinarians received the lowest scores. Responses generated by LLM were generally more consistent and complete than those of human readers. Conclusions: Within the constraints of a simulated scenario design, LLMs, particularly ChatGPT-5 Thinking, provided clinically appropriate guidance that exceeded novice performance and approached that of expert clinicians. These findings support the potential role of LLMs as adjunct decision-support tools in time-sensitive obstetric and gynecologic cases. Clinical Relevance: LLMs may assist clinicians and trainees in managing reproductive emergencies by offering rapid, structured, guideline-aligned recommendations. Further evaluation in real clinical settings is warranted.
Anahtar kelimeler
Atıf için künye
OKUR, D. T., Cengiz, M., Küçükaslan, İ., Peker, C., Çiplak, A. Y., Tohumcu, V., & Aydın, Ş. (2026). Performance of large language models versus clinicians and novices in veterinary theriogenology decision support. Journal of the American Veterinary Medical Association, 264(5), 616–623. https://doi.org/10.2460/javma.25.09.0615
BibTeX
@article{okur2026-261176,
author = {OKUR, Damla Tuğçe and Cengiz, Mehmet and Küçükaslan, İbrahim and Peker, Cevdet and Çiplak, Alper Yasin and Tohumcu, Vefa and Aydın, Şifanur},
title = {Performance of large language models versus clinicians and novices in veterinary theriogenology decision support},
journal = {Journal of the American Veterinary Medical Association},
year = {2026},
volume = {264},
number = {5},
pages = {616--623},
issn = {0003-1488},
doi = {10.2460/javma.25.09.0615},
url = {https://akademik.atauni.edu.tr/yayinlar/261176-performance-of-large-language-models-versus-clinicians-and-novices-in-veterinary}
}