Microsoft Azure AI Fundamentals (AI-900)Describe fundamental principles of machine learning on AzureMedium
A data scientist is evaluating a machine learning model designed to predict whether a customer will click on an advertisement. The model outputs a probability score between 0 and 1. To assess the model's performance across all possible classification thresholds, which visualization tool should be used?
- AConfusion Matrix
- BScatter Plot
- CHistogram
- DROC Curve
Show answer & explanationAnswer & explanation
Correct answer: D. ROC Curve
The ROC Curve (Receiver Operating Characteristic) is a graphical plot that illustrates the diagnostic ability of a binary classifier system as its discrimination threshold is varied. It plots the True Positive Rate against the False Positive Rate at various threshold settings.
Why the other options are wrong
- A. A Confusion Matrix provides a snapshot of model performance at a single classification threshold.
- B. A Scatter Plot shows the relationship between two numerical variables.
- C. A Histogram displays the distribution of a single numerical variable.
ROC Curve
The Receiver Operating Characteristic (ROC) curve is a graphical plot that illustrates the diagnostic ability of a binary classifier system as its discrimination threshold is varied. It plots the True Positive Rate (Sensitivity) against the False Positive Rate (1-Specificity) at various thresholds.
- Evaluates binary classification models.
- Shows performance across all possible thresholds.
- Plots True Positive Rate vs. False Positive Rate.
- Area Under the Curve (AUC-ROC) summarizes overall performance.
- Useful for comparing different models.
Memory trick: Visualizing performance: 'ROC' for thresholds, 'Confusion' for counts.