How to fine tune Large Language Model?

Why would we want to fine-tune an LLM in the first place? There 2 main reasons.

First, we may want to augment the model's data bank with private data, and second, we may want the model to specialize in specific learning tasks. A full fine-tuning takes time and money and generates a very large resulting model file.

The typical way to go about it is to use Low-Rank Adaptaters (LoRA) to minimize the fine-tuning cost.