Beyond Bias: Methods for Fairness in Testing

Resources

Attributes and Evaluation of Discussion Contributions.

Professional Communications and Writing Guide.

In the unit readings from your Psychological Testing and Assessment text, you read about misconceptions regarding test bias and test fairness, two terms that are often incorrectly considered synonymous. While questions regarding test bias have been addressed through technical means, issues with test fairness are tied to values. The text attempts to define test fairness in a psychometric context and provides eight techniques for preventing or remedying adverse impact on one or another group (see page 209). One of these techniques included differential cutoffs. Furthermore, you were introduced to a variety of methods for setting cut scores. These methods have been based on either CTT or IRT.

For this discussion, synthesize the information you learned about these two theories and respective methods. In your post:

Determine which one is preferential for responding to questions about a test's fairness.

Identify at least two advantages and two disadvantages in using each theory, citing appropriate AERA standards from your readings.

Defend your preference in terms of the methods used within each theory and how they apply to concepts of fairness across groups. Essentially, how does it best address test fairness?

Describe how advances in technology are improving the process of test development and inclusion of appropriate items.