Test Bias

Psychological Measurements

Lecture, Chapter 19

Test Bias

nControversial nature of test bias

nWhile the focus of American Ideals is grounded in the statement that all men are created equal, the goal of testing and assessment is to identify differences. When those differences are found, then the controversy of explaining those differences begins

nThere are clear cultural and racial differences on assessment outcomes.

nHow we explain differences has major implications for test fairness and the law.  Particularly in situations where the test results will be utilized to make decisions that have significant impact on the test taker (I.e. ACT, SAT, GRE, & Miller’s)

Test Fairness & the Law

n1964 Civil Rights Act – created the Equal Employment Opportunity Commission (EEOC)

nThis act clearly prohibits discrimination in employment on the basis of race, color, religion, gender, or national origin.

nAny screening process will be viewed as having an adverse impact if it systematically rejects higher proportions of minority than non-minority applicants

nIn 1978, the EEOC released Uniform Guidelines on Employee Selection Procedures indicated that the government will view any screening procedure, including the use of psychological tests, as having an adverse impact if it systematically rejects more minority than non-minority applicants.

Traditional Defense of Testing

nAll of the types of evidence for validity come into play when the issue of test bias is considered.

nDifferences in ethnic groups on test performance come into question.

nBias in test items can be presented in language, or terminology used, and content that is culture-specific.

Minority Group Testing

nSome argue that IQ scores, for instance, are more a result of learned ability in how to perform well on the test as opposed to actual intelligence. This is the core issue in score differences among cultural groups.

nChitling Test – assessing knowledge of which white middle class is unaware; has no predictive validity.

nBlack Intelligence Test of Cultural Homogeneity – respondents define 100 words from African American Slang Dictionary

Suggestions for Solutions

nPromoting the moral position of qualified individualism, a compromise between quotas and unqualified individualism

nQuota (selection from different racial groups according to their proportions in the general population)

nUnqualified individualism (selecting the best-suited people, regardless of their social group)

nRecognize differences as patterns of problem-solving within different subcultures.

nEvaluate tests against outcome criteria relevant to minority groups.

Nature of Differences

nSome believe the differences in test performance are biological in nature; little can be done about differences in test performance.

nSome believe the differences are due to influences from the social environment; efforts to eliminate inequality should  be escalated.

nStill others believe there is evidence for influence from both biology and social environment.

Generally, the Social environment explanation is the most popular.