arXiv (All)
open access
HiNa-MoE: High-Performance, Non-Intrusive MoE Inference on CPUs with Matrix Engines
Mixture-of-Experts (MoE) inference is increasingly deployed in local and on-premise environments, where expert parameters often exceed GPU memory capacity. In latency-sensitive, low-concurrency settings, repeatedly staging routed-expert weights from CPU memory to the GPU can be prohibitive, leaving
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- HiNa-MoE: High-Performance, Non-Intrusive MoE Inference on CPUs with Matrix Engines#1194398
- FORGE: Procedural Weight Generation for Sparse MoE Inference#1341772
- FORGE: Procedural Weight Generation for Sparse MoE Inference#1318978
- Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism#158558
- A Multi-Engine Dataflow for MoE Decoding on Scratchpad-Based Tensor Accelerators#1050941
Record · ID 1201136
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive