Skip to main content

Table 1 Summary of primary studies contributing to preregistered quasi-experimental secondary analysis

From: Limited not lazy: a quasi-experimental secondary analysis of evidence quality evaluations by those who hold implausible beliefs

Primary study

N

Sample

Design

Factor 1

(Levels)

Factor 2

(Levels)

Factor and level included in preregistered secondary analysis

High quality

Low quality

1

106

Mturk

Factorial

Attractiveness

(Absent, High, Low)

Expert persuasion expectancy

(a.k.a.‘ExPEx’ Strong, Weak)

Attractiveness Absent/Strong ExPEx

Attractiveness Absent/Weak ExPEx

2

116

Mturk

Factorial

Attractiveness

(Absent, High, Low)

Expert persuasion expectancy (a.k.a. ‘ExPEx’ Strong, Weak)

Attractiveness Absent/Strong ExPEx

Attractiveness Absent/Weak ExPEx

3

54

Mturk

Oneway

Legal admissibility

(Control, Explicit Admit, Implicit Admit, Explicit Exclude)

-

Explicit Admit

Explicit Exclude

4

96

Mturk

Factorial

Legal admissibility

(Explicit Admit, Implicit Admit, Explicit Exclude)

Expert ability

(High, Low)

Explicit Admit/High ability

Explicit Exclude/Low ability

5

138

Mturk

Factorial

Discipline reliability

(High, Low)

Report disclosure

(Detailed, sparse)

High reliability/Detailed disclosure

Low reliability/Detailed disclosure

6

326

Mturk

Oneway

Reasoning measure

(versions 1, 2, 3)

–

–

Reasoning measure versions 1, 2 and 3a

7

37

Student

Factorial

Analysis method

(Biased, Unbiased)

Method disclosure

(Present, Absent)

Unbiased analysis /Disclosure Present

Biased analysis/Disclosure Absent

  1. aAll participants in Study 6 evaluated a low-quality (flawed) expert report prior to receiving the experimental manipulation