Microsoft Azure AI Fundamentals (AI-900)Describe fundamental principles of machine learning on AzureMedium
A data scientist is building a machine learning model to predict the likelihood of equipment failure in a manufacturing plant. The model will analyze sensor data, maintenance logs, and environmental conditions. The primary goal is to classify whether a piece of equipment will fail within the next month (binary outcome). Which evaluation metric is most critical if missing a potential failure (false negative) is extremely costly, but flagging a healthy machine as potentially failing (false positive) is less severe?
- AF1-Score
- BRecall
- CPrecision
- DAccuracy
Show answer & explanationAnswer & explanation
Correct answer: B. Recall
Recall (Sensitivity) measures the proportion of actual positive cases that were correctly identified. In this scenario, 'missing a potential failure' is a false negative, and maximizing recall minimizes false negatives, which is crucial when false negatives are costly.
Why the other options are wrong
- A. F1-Score is the harmonic mean of Precision and Recall, providing a balance. While useful, it doesn't prioritize minimizing false negatives as directly as Recall.
- C. Precision measures the proportion of positive identifications that were actually correct, prioritizing minimizing false positives.
- D. Accuracy measures overall correct predictions, but can be misleading with imbalanced classes, and doesn't prioritize false negatives.
Recall (Sensitivity)
Recall, also known as sensitivity or the true positive rate, is a metric that measures the proportion of actual positive cases that were correctly identified by the model. It is particularly important when the cost of false negatives is high.
- Calculated as True Positives / (True Positives + False Negatives).
- Focuses on minimizing false negatives.
- High recall means fewer actual positive cases are missed.
- Crucial in medical diagnosis, fraud detection, and safety systems.
Memory trick: Remembering 'PR-FACT': Precision, Recall, F1, Accuracy, Confusion Matrix, True/False.