arXiv (All)
open access
Greedy Decoding Is Not Precision-Invariant: Cross-Precision Output Divergence in LLM Inference
Greedy decoding from large language models is commonly treated as deterministic. We show it is not precision-invariant: the same model, prompt, and decoding algorithm produce different outputs in BF16 versus FP16 on identical hardware. Across our evaluations of six models (1.1B-7B parameters, four f
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Greedy Decoding Is Not Precision-Invariant: Cross-Precision Output Divergence in LLM Inference#1043092
- Where Activation Sparsity and KV-Cache Sparsity Cross in LLM Decoding#1118962
- GleanVID: Complementary Token Selection for Efficient Video Large Language Models#1132243
- Beyond Acoustic Prefixes: Persistent Access to Serialized Acoustic Memory for LLM-Based Multi-Talker Speech Recognition#1131493
- Deep Models, Shallow Alignment: Uncovering the Granularity Mismatch in Neural Decoding#662397
Record · ID 1062509
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive