FAA Fundamentals of Instructing (FOI)Assessment and CritiqueHard
A ground instructor is writing multiple-choice test items for a private pilot knowledge exam and wants to follow best practices for item construction. Which practice should the instructor avoid?
- APhrasing an item stem with a double negative, such as 'Which of the following is NOT unacceptable...'
- BWriting each item so it tests a single, clearly defined idea
- CVarying the position of the correct answer among the choices
- DEnsuring all distractors are plausible and grammatically consistent with the stem
Show answer & explanationAnswer & explanation
Correct answer: A. Phrasing an item stem with a double negative, such as 'Which of the following is NOT unacceptable...'
Double-negative or confusingly negative phrasing makes test items unclear and can trick even well-prepared students, harming both the validity and fairness of the assessment. Effective item writing avoids such ambiguous wording.
Why the other options are wrong
- B. Testing a single clear idea per item is a recommended best practice, not something to avoid.
- C. Varying answer position prevents pattern guessing and is a recommended practice.
- D. Plausible, grammatically consistent distractors are recommended to make the test meaningful.
Test Item Construction Guidelines
A set of best practices for writing valid, clear multiple-choice test items that accurately measure student knowledge.
- Avoid negative or double-negative phrasing in stems
- Test only one idea per item
- Make distractors plausible and grammatically parallel
- Randomize the position of the correct answer
Memory trick: Don't tangle the student in a double-negative knot 🪢