Clone the Abilities of Powerful LLMs into Small Local Models Using Knowledge Distillation

An Overview of the LoRA Family

Easily Train a Specialized LLM: PEFT, LoRA, QLoRA, LLaMA-Adapter, and More

Evaluating Fine-Tuned LLMs with WeightWatcher Part II: PEFT / LoRa Models

Implementing LoRA from Scratch

The LLM Revolution: Transforming Language Models