Table 2 Criteria to use when developing a new test or evaluating a newly proposed test

Minimum requirements

Good arguments are given for why a new test is needed

Good arguments are given for the content of the test

Analyses are based on representative samples of at least 200 participants

Data loss is handled in a principled way

The selection of items is well explained

Reliability of each scale is at least .7 in an independent validation study

The distribution of scores from the validation study is given

The test is easily available

Raw data and analysis code of all studies are freely available in a repository

Additional marks of distinction

Samples of 400 participants and more

Test reliability greater than .8

Factor analysis and/or IRT analysis of the test

Evidence of convergent validity or criterion validity

Test–retest reliability in addition to internal consistency

Wrong criteria

A related test already exists

The test must be validated on native English speakers