PhilArchive
open access
Preprint Open Procedural Completion Without Perceptual Input: A Pilot Observation of Input-Gating Failure in a Deployed Clinical Large Language Model
Background: Large language models deployed in clinical contexts may produce structured diagnostic responses without verifying that required perceptual input is present, a failure mode here termed missing-input procedural completion. The mechanism is architectural: transformer language models are autoregressive next-token samplers that lack a discrete verification step gating output on input presence. Constraint-based prompting may rewrite response surface without installing such a gate. Methods: A within-session mixed-order protocol was conducted over six consecutive days in fresh chat sessions on the ChatGPT web platform. Each session executed four conditions in randomized order: image-present baseline (A+), no-image baseline (A−), image-present with HRIS-consistent reasoning constraints and ground-truth correction (B+), and no- image with the same constraint set (B−). The same novel clinical image of subungual melanoma was used for all image-present trials. Memory features were intentionally left enabled to reflect typical clinical use. The platform updated from ChatGPT 5.4 to 5.5 between days 4 and 5. Diagnostic accuracy on image trials and gating behavior on no- image trials (clean refusal, partial leak, or full ungrounded completion) were recorded. Results: Of 12 image trials, 12 (100%) correctly identified subungual melanoma across both versions. Of 12 no-image trials, gating outcomes differed by version. Under ChatGPT 5.4 (eight trials), six produced clean refusals, one a partial leak, and one a full ungrounded completion. Under ChatGPT 5.5 (four trials), one produced a clean refusal, two produced partial leaks, and one produced a full, ungrounded completion. The first no-image trial under 5.5 produced a full structured diagnostic response in the absence of any image and verbalized cross-session retrieval (“based on the assumption this is a similar lesion to prior cases you’ve been testing”) as the basis for proceeding. Conclusions: Input-gating failure observed in an earlier accidental trial was reproduced in a planned protocol. Polluted refusal, surface decline, coupled with continued schema population, including malignant differentials, emerged as a distinct intermediate failure mode under 5.5. Constraint-based prompting did not prevent ungrounded procedural completion. Findings are exploratory given the small sample size and single-stimulus, single-platform design, and motivate larger studies currently underway, including stimulus generalization, cross-vendor replication, and a clinician-tuned model arm.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Syntactic patterns of Italo-Romance CP-layers in Transformers, ChatGPT and Deepseek: two case studies from Romansh and Neapolitan#732119
- Large language models' performances regarding common patient questions about broken endodontic instruments: a comparative analysis of ChatGPT-5.2, Gemini 3 and DeepSeek V3.2 in accuracy, consistency and readability.#239785
- Structured prompting as reusable clinical tools.#615804
- When Cosine Similarity Fails to Reflect Linearly Accessible Structure in Dialogue Models#1037205
- Benchmark evaluation of DeepSeek large language models in clinical decision-making#359604
Record · ID 170125
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive