Balancing Accuracy and Cost: Trade-Offs in Large Language Model Quantization for the Systems Engineering Domain

As Large Language Models (LLMs) are increasingly deployed within the systems engineering domain, optimizing these models to balance performance accuracy and cost for given computational resources becomes essential. One process for finding the right balance is quantization, a process that involves co