arXiv (All)
open access
Identity or Prompt Noise? A Calibrated Invariance Audit of LLM Code Generation
Identity cues are irrelevant to a fixed programming specification, but raw counterfactual differences can arise from unequal samples and prompt wording. We audit 30.73 million executed Python generations from seven checkpoints on HumanEval+ and MBPP+, supplemented by an exploratory 550B slice, under
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Identity or Prompt Noise? A Calibrated Invariance Audit of LLM Code Generation#1028784
- Detecting Contaminated Code-Generation Prompt Batches via Influence Functions#458288
- Auditing Black-Box LLM APIs with a Rank-Based Uniformity Test#128412
- SONAR: Task-Aware Code Summary Evaluation for LLM Consumers Without References#429435
- WeSCE: A Benchmark for Measuring Security Drift in LLM-Driven Code Editing#612519
Record · ID 1037194
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive