It is important a psychometric assessment is Reliable
An aptitude test or personality assessment needs to measure each factor it is attempting to measure reliably, for the given population (e.g., customer service applicants, males, females etc).
Reliability is the consistency or precision with which the test or assessment method measures what it claims to measure.
- Any assessment method or test needs to be a consistent measure – this means if the test was used repeatedly on the same candidate it would produce similar results.
- Assessments or tests with lower reliability are of little practical use. Reliability is a very important concept and works in tandem with validity.
- A guiding principle for psychology is that a test can be reliable but not valid for a particular purpose, however, a test cannot be valid if it is unreliable.
- Most psychological test makers provide a reliability coefficient which establishes the reliability of the test and is usually based on test-retest methodology or split half technique (otherwise known as internal consistency reliability).
- The reliability coefficient is used to set up a band for error around individual scores that is acceptable and renders the results reliable.
Test retest reliability is when the same test is administered to a sample group of people twice.
- The limitations of this method are the impact on performance of any information the subject remembers or has learnt from the first testing session that may impact how well they answer the test the second time around.
- To get around this issue, many test developers design an alternative form of the test and administer this – this second form however does have to measure the issue exactly as the first measure does for reliability to be assessed.
Alternatively, reliability is measured through a Split Half Reliability technique.
- This is where subjects may have half of their test answers correlated with the other half (say all odd numbered items compared to all even numbered items).
- If both halves correlate highly with each other, the test is considered reliable.
Test reliability is also represented by a correlation coefficient (r). As with validity coefficients, the closer the correlation coefficient is to 1 the better. While many personality tests are considered to have acceptable levels of reliability if they have reliability coefficients greater than r = .70, ability tests should have reliability coefficients greater than r = .80.
Read more about the different types of Validity...