AWS Certified AI PractitionerFoundation ModelsEasy
A startup is developing an application that uses a foundation model to generate creative content, such as marketing slogans and product descriptions. They notice that sometimes the model produces highly repetitive phrases or ideas, even when prompted for variety. Which common issue with generative foundation models is most likely occurring?
- ALack of creativity / Repetitiveness
- BHallucination
- CAlgorithmic bias
- DOverfitting
Show answer & explanationAnswer & explanation
Correct answer: A. Lack of creativity / Repetitiveness
When a generative model produces repetitive phrases or ideas despite prompts for variety, it indicates a lack of true creativity or diversity in its output, which is a known challenge in generative AI.
Why the other options are wrong
- B. Hallucination involves generating factually incorrect or nonsensical information, which is different from being repetitive.
- C. Algorithmic bias relates to unfair or prejudiced outputs based on training data, not repetitiveness.
- D. Overfitting means the model has learned training data too well and performs poorly on new data, not necessarily producing repetitive content.
Generative Model Repetitiveness
A common issue in generative foundation models where the output lacks diversity, producing similar or identical phrases, ideas, or structures despite prompts for variety.
- Can be due to sampling strategies or model architecture
- Reduces perceived creativity and utility
- Addressed through techniques like diverse decoding or fine-tuning
Memory trick: Generative FMs can Repeat, Hallucinate, or Bias.