16Hit1600
Problem-Solving and Data AnalysisMediumFlaw in a comparison of teaching methods

Problem-Solving and Data Analysis practice question

A school tested two teaching methods by using method A with its strongest mathematics students and method B with the rest. Students taught by method A scored higher, and the school concluded that method A is more effective. Which of the following best describes the flaw in this conclusion?

  1. A. The students were not assigned to the methods at random, so the higher scores may reflect the students rather than the method.Correct
  2. B. The school should have used more than two methods.
  3. C. Test scores are not a valid measure of learning.
  4. D. Method B was used with too many students.

Answer: A. The students were not assigned to the methods at random, so the higher scores may reflect the students rather than the method.

Stronger students in group A confound the comparison.

Why the other answers are wrong

B. The school should have used more than two methods.
Two methods can be compared fairly if groups are assigned at random.
C. Test scores are not a valid measure of learning.
Scores are the outcome being compared; the flaw is in assignment.
D. Method B was used with too many students.
Group size is not the issue.

More Problem-Solving and Data Analysis questions

Not affiliated with the College Board. SAT is a trademark of the College Board.