AWS Certified AI PractitionerAI/ML and Generative AI FundamentalsMedium
A developer is building a large language model (LLM) for a specialized legal domain. They have a pre-trained general-purpose LLM and a smaller, highly relevant dataset of legal documents. To adapt the LLM effectively to the legal domain without training from scratch, which technique should they employ?
- ADimensionality reduction
- BFeature engineering
- CBatch normalization
- DTransfer learning (fine-tuning)
Show answer & explanationAnswer & explanation
Correct answer: D. Transfer learning (fine-tuning)
Transfer learning, specifically fine-tuning, is the most effective technique for adapting a pre-trained model to a new, but related, domain with a smaller dataset. It leverages the general knowledge learned by the large model and adjusts its parameters to the specifics of the target domain (legal documents in this case).
Why the other options are wrong
- A. Dimensionality reduction aims to reduce the number of features, not to adapt a model to a new domain.
- B. Feature engineering involves creating new input features from existing ones and is not the primary method for adapting a pre-trained LLM to a new domain.
- C. Batch normalization is a technique used during training to improve stability and speed, not for domain adaptation of a pre-trained model.
Transfer Learning (Fine-tuning LLMs)
Transfer learning, specifically fine-tuning, is a technique where a pre-trained large language model (LLM) is further trained on a smaller, domain-specific dataset to adapt its knowledge and performance to a particular task or domain.
- Leverages general knowledge from pre-training.
- Requires less data and computational resources than training from scratch.
- Effective for specialized tasks or domains.
- Involves adjusting specific layers or the entire model.
Memory trick: General knowledge plus specific training equals expertise.