Conceptio › Archive › arXiv (OAI)
arXiv (OAI)open access

MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression

Elias, Noel et al. · 2024
arXiv (OAI) · Papers · License: Open Access · 2024
Open Source ↗Direct PDF ↓
computation and language, information theory, machine learning
This document is indexed with metadata only — full text is not available in the archive for this record. Open the official source ↗

Related documents

Record · ID 163063
Retrieved via Conceptio — every document is proof-bundled with source, license, and retrieval metadata.