text-generationtransformersllama3.1

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

huggingface.co/hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

111Likes
173,521Downloads
2024-08-07Updated
transformerssafetensorsllamatext-generationllama-3.1metaautoawqconversationalendefritpthiesthlicense:llama3.1text-generation-inferenceendpoints_compatible4-bitawqregion:usdeploy:azure
The README has not been fetched yet (metadata-first ingest). The model page and the metadata below are live.

Model card

Mirrored from the Hugging Face Hub and served from the Conceptio Open Knowledge Archive. Read the original card at https://huggingface.co/hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4.
Legal contextLicense llama3.1 · EU AI Act — Art. 53 (GPAI model obligations)