This post discusses the process of fine-tuning LLMs, particularly focusing on budget instruction fine-tuning of Llama 3 8B Instruct on medical data. It covers different approaches to fine-tuning, such as supervised fine-tuning, few-shot learning, full transfer learning, and domain-specific fine-tuning. The post also introduces LoRA and QLoRA, which are enhanced fine-tuning approaches. It provides a guide for preparing data and fine-tuning Llama 3 8B Instruct using tools and platforms like Hugging Face, Unsloth, and Google Colab.

•17m read time•From mlops.community
Post cover image
Table of contents
Fine-tuning by Data UtilizationFine-tuning by Weight AdjustmentWhat are LoRA & QLoRa ?Preparing instruction data for Llama 3 8B Instruct (Optional)Fine-tuning Llama 3 8B InstructConclusionResourcesAuthor
Share this post