Testing Validation

We extensively validate our assessments, both in the process of developing the assessments as well as on an ongoing basis with client implementations. We adhere to relevant government and professional guidelines (e.g., UGESP), and take a multilayered approach that optimizes prediction of job performance, while mitigating any subgroup differences.

As part of this process, we look to enhance the reliability of our assessments (e.g., Cronbach’s Alpha), as well as construct validity, and criterion-related validity. On skill-based assessments and those where the assessment itself is considered part of the job domain, we also engage in content validation. The following describes each of these at a high level:

Reliability

Reliability refers to a test’s ability to produce consistent results over time. In other words, if someone takes a test and then retakes the same test a week later, are their scores similar? We validate for reliability using Cronbach’s Alpha, the most common means of measuring the internal consistency or reliability of an assessment.

Construct Validity

This determines if a test is measuring what it is supposed to measure. Depending on the test in question, the process for determining construct validity typically involves leveraging other scientifically validated tests to find consistent correlations (e.g., convergent, as well as discriminant validity).

Content Validity

This measures how well the subject matter of a test relates to the capabilities and skills required by a certain job. In other words, is the content of the test job-relevant? We leverage the Department of Labor’s KSA’s for over 1,100 roles to confirm content validity for our assessments.

Criterion Validity

Also known as predictive validity, this refers to the ability of the test to correlate with a business outcome. For example, is the test correlated with lower turnover, stronger performance metrics, or higher sales? This validation step involves gathering data from organizations to demonstrate that the assessments can predict these outcomes. We also continue to validate our assessments with local validation studies and case studies performed with our customers.