arXiv (All)
open access
SubGPU Pipelining: Intra-GPU Fine-Grained Spatial Parallelism for LLM Inference
Large language model (LLM) decode is dominated by short, predominantly memory-bound kernels that make bursty use of on-chip execution resources and memory bandwidth. This paper introduces SubGPU Pipelining, a fine-grained, intra-GPU spatial execution model that cuts an operator graph into ordered co
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- SubGPU Pipelining: Intra-GPU Fine-Grained Spatial Parallelism for LLM Inference#1640068
- Training an MoE LLM in MXFP4: How We Closed the Gap to BF16#1447596
- PipeLive: Efficient Live In-place Pipeline Parallelism Reconfiguration for Dynamic LLM Serving#1063894
- Simulate Before You Scale: High-Fidelity LLM Inference Planning Without GPUs#1324856
- Elastic Precision: Software-Hardware Co-Design of a Mixed-Precision Architecture for Long-Context LLM Inference#1536730
Record · ID 1648934
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive