FAA Fundamentals of Instructing (FOI)Assessment and CritiqueMedium

A ground school instructor gives the same written test to a group of students on two separate occasions a week apart, and the students' relative rank order of scores stays essentially the same both times. This consistency demonstrates which characteristic of a good test?

  1. AUsability
  2. BValidity
  3. CReliability
  4. DObjectivity
Show answer & explanation

Correct answer: C. Reliability

Reliability refers to the consistency of test results over repeated administrations; a reliable test yields similar rankings/results each time it is given under similar conditions. Validity concerns whether the test measures what it is supposed to measure, which is a different quality.

Why the other options are wrong

  • A. Usability concerns practicality of administering and scoring the test.
  • B. Validity is about measuring the intended content/objectives, not consistency across administrations.
  • D. Objectivity concerns freedom from grader bias, not repeat-test consistency.

Reliability (Test Characteristic)

The degree to which a test produces consistent results when administered repeatedly under similar conditions.

  • Consistency of scores/rankings over time
  • Different from validity (measuring the right thing)
  • One of several characteristics of a good test

Memory trick: 'VROCD': Valid, Reliable, Objective, Comprehensive, Discriminating, usable.

More Assessment and Critique questions