Abstract: Resource-constrained organizations with vast datasets often face significant challenges in training and fine-tuning large language models (LLMs) due to privacy and compliance requirements.