arXiv (All)
open access
PackServe: SLO-Aware Request Scheduling for Agentic LLM Serving at Scale
Request scheduling is a key challenge in large-scale clusters serving agentic large language model (LLM) workloads. An effective scheduler must preserve key-value cache (KVC) reuse across long, shared prefixes, meet token-level latency service-level objectives (SLOs), and minimize GPU resource footp
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- PackServe: SLO-Aware Request Scheduling for Agentic LLM Serving at Scale#1108733
- TROVE: Adaptive Agent Skill Orchestration via Trace-Grounded Route Validation and Editing#971975
- Resource-Efficient Speculative Decoding for Long-Context LLM Serving#1117896
- ATTUNER: Recomputation-Free KV Cache Reuse via Query-Side Adaptation#1131923
- Asymmetry PRISM: A CPU/GPU Portfolio Optimization Engine for Deadline-Bounded Institutional Rebalancing#299879
Record · ID 1117936
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive