Applied Sciences · 20 Nov 2026
Small Clinical Change, Big AI Decision? Metamorphic Testing of Large Language Models in Dental Clinical Decision-Making
Neşet Akayh-index 0, Hüseyin Yanık, Fethi Atılh-index 11
Citations by database
Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.
- OpenCitations0
- Crossref0
Citations per year
The current year is still counting.
- 2026 so far0
Abstract
Large language model (LLM) chatbots are increasingly consulted for dental decisions, but case-by-case accuracy does not show whether their advice changes when, and only when, a clinically decisive fact changes. Metamorphic testing checks whether answers to two nearly identical cases relate as clinical rules require, without defining a single correct answer for each case. We applied it to oral and maxillofacial surgery and emergency dental decision-making. Thirty guideline-anchored relations were locked before querying, and 60 synthetic case pairs differing in one variable were submitted with a structured prompt to the ChatGPT (GPT-6 Astra) and Gemini (Gemini 3.8) web interfaces. Two blinded specialists scored each pair, with blinded adjudication of disagreements. In the main analysis (58 pairs; two defective vignettes withdrawn), relations were violated in 0 ChatGPT and 8 Gemini pairs (13.8%; p = 0.016, accounting for clustering within relations); with all 60 pairs, 1 vs. 8 (p = 0.063). Gemini violations clustered at numerical thresholds, escalation red flags and a sex-label invariance relation, and 13 of 116 Gemini responses, but no ChatGPT response, contained a safety violation. Chatbots that appear competent case by case can fail at clinically decisive thresholds; metamorphic testing offers a reproducible audit before clinical use.
What the data shows
- No database records a citation yet, as is usual for a paper this new.
- Fethi Atıl has the highest h-index among the authors (11).
Graph
This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.
Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.
Start with
Cited by 0 papers
Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.
References (36)
What it cites, from open citation data, with Crossref's record of each.
Sign in to see 16 more references
A free account opens the rest of the citing papers and references on every paper’s page.