Move on to the reading area
Shiftpedia

Adverse impact in selection procedures: 5 key takeaways

Shiftpedia Editorial Team · Posted · Last checked · 13 min read

How to validate selection procedures for adverse impact

To validate a selection procedure for adverse impact, compare selection rates across groups using the four-fifths rule, then document job linkage and validity evidence. The U.S. Office of Personnel Management defines the scope of selection decisions in its Assessment and Selection guidance. According to the U.S. Office of Personnel Management, selection decisions include, but are not limited to, hiring, placement, promotion, referral, retention, and entry into programs leading to advancement, such as apprenticeship, training, or career development. This broad scope means your compliance review must extend beyond initial recruitment to cover internal mobility and developmental opportunities.

Key takeaways for how to validate selection procedures for adverse impact

  • Adverse impact threshold: A selection rate less than four-fifths (80%) of the group with the highest rate is generally regarded as evidence of adverse impact by Federal enforcement agencies, according to Legal Information Institute.
  • Validity evidence: The Uniform Guidelines (Section 5G) expressly permit using a procedure in a manner supported by validity and utility evidence, even if another method of using that procedure has lesser adverse impact, according to U.S. Equal Employment Opportunity Commission.
  • Alternative procedure choice: When two or more procedures serve a legitimate business purpose with substantially equal validity, users should use the one demonstrated to have lesser adverse impact, according to U.S. Equal Employment Opportunity Commission.
  • Documentation requirements: For any selection procedure that is part of a selection process with adverse impact, and that procedure itself has adverse impact, users should maintain and have available the documentation described in section 15, according to Legal Information Institute.
  • Selection decision scope: If a user decides to use a selection procedure on a ranking basis with greater adverse impact than pass/fail, they should have sufficient evidence of validity and utility to support that use, according to Legal Information Institute.

Defining assessment tools and mapping decisions

Understanding what constitutes an assessment tool is the first step in validation. The U.S. Office of Personnel Management provides a general definition for these instruments. According to the U.S. Office of Personnel Management, an assessment tool is any test or procedure administered to individuals to evaluate their job-related competencies, interests, or fitness for employment. This definition covers a wide range of instruments, from cognitive ability tests to structured interviews. For a related screening tool, see Workplace drug testing: 8 requirements from state statutes.

To validate these procedures, you must map each tool to the specific selection decision it informs. If a tool is used for hiring, it must meet the standards for that decision. If it is used for promotion, it must meet the standards for that specific context.

Understanding the four-fifths rule and statistical significance

The four-fifths rule serves as a primary benchmark for identifying potential adverse impact in selection procedures. According to the Legal Information Institute, a selection rate for any group that is less than 4/5 (or eighty percent) of the rate for the group with the highest rate will generally be regarded by Federal enforcement agencies as evidence of adverse impact, while a greater than four-fifths rate will generally not be regarded by Federal enforcement agencies as evidence of adverse impact. This threshold provides a clear initial filter for HR compliance managers to evaluate whether their hiring or promotion tools produce disparate outcomes across protected groups.

However, the four-fifths rule is not the sole determinant of adverse impact. The U.S. Equal Employment Opportunity Commission clarifies that the Guidelines expressly state (section 4D) that differences in selection rates of less than 20% may still amount to adverse impact where the differences are significant in both statistical and practical terms. This distinction is critical for compliance managers who rely solely on the eighty percent benchmark. A selection-rate ratio above four-fifths might still constitute adverse impact if statistical analysis reveals the difference is significant. Therefore, validating selection procedures requires examining both the ratio of selection rates and the statistical significance of those differences.

When applying these standards, compliance managers must consider the practical significance of the data alongside statistical metrics. The U.S. Equal Employment Opportunity Commission notes that significance in both statistical and practical terms is the standard for determining adverse impact in cases where the rate difference is under 20%. This dual requirement means that a small numerical difference in selection rates could still trigger legal scrutiny if the sample size or context makes the difference statistically robust and practically meaningful.

Illustrative example: applying the four-fifths rule

Suppose 100 applicants in each of Group A and Group B take a promotion test. Group A passes 80 of its applicants, a rate of 80%. Group B passes 55 of its applicants, a rate of 55%. Group B's rate is less than four-fifths of Group A's rate, so it would generally be regarded as evidence of adverse impact.

Reference table of publisher guidelines

The following table summarizes the specific validation standards and documentation requirements outlined by federal agencies and legal repositories for selection procedures.

Publisher Guideline Focus Key Requirement or Standard
Legal Information Institute Adverse impact threshold Evaluate individual components if the total selection process shows adverse impact, according to Legal Information Institute.
Legal Information Institute Component evaluation Federal enforcement agencies may request evaluation of individual components in unusual circumstances, according to Legal Information Institute.
Legal Information Institute Regulation citation The rules are codified in 29 CFR § 1607.4 - Information on impact, according to Legal Information Institute.
Legal Information Institute Classification standards Race, sex, and ethnic classifications must align with the EEO-1 series of reports, according to Legal Information Institute.
U.S. Office of Personnel Management Job analysis linkage Documentation of job analysis and linkages to selection tool content is essential for legal compliance, according to U.S. Office of Personnel Management.
U.S. Office of Personnel Management Selection decision scope Selection decisions include hiring, placement, promotion, referral, retention, and program entry, according to U.S. Office of Personnel Management.
U.S. Equal Employment Opportunity Commission Validity evidence A procedure may be used in a manner supported by evidence of validity and utility, even if another method of using that procedure has lesser adverse impact, according to U.S. Equal Employment Opportunity Commission.
Job Accommodation Network Job description components Job descriptions typically consist of six major components including essential job functions and physical demands, according to Job Accommodation Network.

Review your current selection tools to ensure they are linked to a documented job analysis.

Linking job analysis to assessment tool content

The U.S. Office of Personnel Management states that documentation of the job analysis process and the linkages between job tasks, competencies, and selection tool content are essential to ensure an assessment strategy meets legal and professional guidelines U.S. Office of Personnel Management. This requirement applies to the "Assessment and Selection" framework, which mandates that the connection between what a job requires and what a test measures is explicitly recorded. Without this documented linkage, an organization cannot demonstrate that its selection tools align with the actual duties of the position.

Basing personnel assessment closely on job analysis results makes the connection between job requirements and personnel assessment tools more transparent, thereby improving the perceived fairness of the assessment process U.S. Office of Personnel Management. Transparency is a key component of this approach, as it allows applicants and reviewers to see how specific job duties inform the criteria used in hiring or promotion. The U.S. Office of Personnel Management emphasizes that this transparency directly supports the perception of fairness, which is a critical factor in defending selection procedures against claims of bias or arbitrary decision-making.

To create a robust job analysis, you can refer to the components outlined by the Job Accommodation Network. A job description typically consists of six major components: 1) essential job functions; 2) knowledge and critical skills; 3) physical demands; 4) environmental factors; 5) the roles of the ADA and other federal laws such as the Occupational Safety Health Act (OSH Act); and 6) any explanatory information that may be necessary to clarify job duties or responsibilities Job Accommodation Network. These components provide a structured way to identify the specific tasks and conditions that should be reflected in your assessment tools.

Review your current job descriptions to ensure they include all six components identified by the Job Accommodation Network. Update your assessment tools to reflect the essential job functions and critical skills listed in these descriptions. Document the linkage between each job task and the corresponding assessment criterion, as recommended by the U.S. Office of Personnel Management. This documentation will support the transparency and fairness of your selection process.

Choosing between ranking and pass/fail methods

The choice between ranking applicants and using a pass/fail cutoff is a critical decision point for HR compliance managers. According to the U.S. Equal Employment Opportunity Commission, the Uniform Guidelines (Section 5G) expressly permit the use of a procedure in a manner supported by the evidence of validity and utility, even if another method of use has a lesser adverse impact. This provision allows organizations to select a specific application method based on the strength of their validity data rather than solely on the resulting selection rates.

However, the EEOC also notes that Section 3B indicates that, when two or more selection procedures are available which serve a legitimate business purpose with substantially equal validity, the user should use the one which has been demonstrated to have the lesser adverse impact. This rule creates a hierarchy for decision-making: if two methods are equally valid, the one with the lower adverse impact is the preferred choice. Compliance managers must therefore compare the validity evidence of their available procedures to assess whether they have substantially equal validity, then compare adverse impact to choose between them.

When a ranking basis is chosen, the Legal Information Institute explains that if a user decides to use a selection procedure on a ranking basis, and that method of use has a greater adverse impact than use on an appropriate pass/fail basis, the user should have sufficient evidence of validity and utility to support the use on a ranking basis. This specific requirement highlights that a ranking use with greater adverse impact than pass/fail demands a more rigorous justification. The validity evidence must explicitly support the ranking approach itself, not just the general use of the assessment tool.

By aligning your method choice with these guidelines, you can support a selection process that is both legally defensible and fair. For additional context on how structured processes can support fair hiring, you might also review Structured interviews: 8 checks for fair hiring.

Documentation and maintenance of validity studies

The U.S. Equal Employment Opportunity Commission clarifies that federal equal employment opportunity law does not require validity studies to be conducted unless there is adverse impact, according to U.S. Equal Employment Opportunity Commission. This rule means that if your selection procedures do not produce adverse impact, you are not legally compelled to generate new validity data solely for compliance purposes. However, the EEOC also notes that nothing in the guidelines should be interpreted as discouraging the use of properly validated selection procedures, according to U.S. Equal Employment Opportunity Commission. You may choose to validate your tools voluntarily to strengthen your defense or improve job performance.

When adverse impact does occur, documentation duties become strict. The Legal Information Institute cites 29 CFR § 1607.5, stating that for any selection procedure which is part of a selection process which has an adverse impact and which selection procedure has an adverse impact, each user should maintain and have available such documentation as is described in section 15 below, according to Legal Information Institute. This requirement applies to the specific procedures causing the impact within the broader selection process. You must ensure that the documentation referenced in section 15 is not only created but also maintained and available for inspection. If a particular test or interview component contributes to adverse impact, the validity evidence for that specific component must be ready.

FAQ: how to validate selection procedures for adverse impact

What selection rate ratio indicates adverse impact?

Federal enforcement agencies generally regard a selection rate that is less than four-fifths (or eighty percent) of the rate for the group with the highest rate as evidence of adverse impact, according to Legal Information Institute. Conversely, a rate greater than four-fifths will generally not be regarded by these agencies as evidence of adverse impact, according to Legal Information Institute. This threshold serves as the primary metric for identifying potential legal issues in selection processes.

Does federal law require validity studies if there is no adverse impact?

Federal equal employment opportunity law does not require validity studies to be conducted unless there is adverse impact, according to U.S. Equal Employment Opportunity Commission. The guidelines clarify that nothing should be interpreted as discouraging the use of properly validated selection procedures, according to U.S. Equal Employment Opportunity Commission. Therefore, validity studies are not required unless there is adverse impact.

What evidence supports continued use of a procedure?

The Uniform Guidelines expressly permit the use of a procedure in a manner supported by the evidence of validity and utility, even if another method of use has a lesser adverse impact, according to U.S. Equal Employment Opportunity Commission. This provision allows organizations to maintain current tools if they possess sufficient evidence of their job-relatedness and utility. Users should verify that their existing documentation meets this standard of supported evidence before continuing use.

Which selection decisions are covered by these guidelines?

Selection decisions include, but are not limited to, hiring, placement, promotion, referral, retention, and entry into programs leading to advancement, according to U.S. Office of Personnel Management. Examples of such advancement programs include apprenticeship, training, and career development, according to U.S. Office of Personnel Management. This broad scope ensures that compliance reviews extend beyond initial hiring to include ongoing career progression and internal mobility decisions.

How does job analysis support the fairness of assessment tools?

Basing personnel assessment closely on job analysis results makes the connection between job requirements and personnel assessment tools more transparent, according to U.S. Office of Personnel Management. This transparency improves the perceived fairness of the assessment process, according to U.S. Office of Personnel Management. Aligning tools with documented job requirements helps demonstrate that assessments measure relevant competencies rather than unrelated characteristics.

Sources