Skip to main content

Table 4 External criterion tasks

From: g versus c: comparing individual and collective intelligence across two meta-analyses

Study

Criterion

Description

Woolley et al. (2010): Study 1

Computerized checkers

A group sat in front of a single screen, were trained for 5 min, and played a single match of checkers against a computerized opponent

Woolley et al. (2010): Study 2

Architectural design task

Groups design and build a house, garage, and pool with limited materials and strict building codes. (10 min planning, 20 min building)

Enge et al. (2015a, b): Study 2 (Germany)

Student project

Student team projects were completed and rated by university students (peer review)

Woolley and Aggarwal (under review); (Also reported in Woolley and Aggarwal 2017)

Group learning

Slope (rate and size) of learning gains in 4 × repeated MBA student exams over 6 weeks

Woolley and Aggarwal (under review); (Also reported in Woolley and Aggarwal 2017)

Group synergy

As above. Synergy slope was measured against coordination and process gains attributable to groups once individual gains are controlled for on the slope

Glikson, Harush, et al. (under review); also reported in Woolley, Glikson, Haan, Harush, and Kim, (2018)

Group presentation

Student group PowerPoint presentation worth 40–60% of final subject score (establish new business in foreign country), measured with significant (e.g., semester) delay post group IQ test

Kim et al. (2017ab)

Group learning

'League of Legends' video-game team learning behavior (via Edmondson’s scale of error detection / correction); repeated measure T1 = baseline and T2 = 6-month follow-up (learning = T2-T1)

Aggarwal et al. (2019)

Group learning

Group learning defined as “the rate of change (or slope) in earnings for each group across ten rounds of the [minimum-effort tacit coordination] game” (a behavioral economics game, see p.5). Results controlled for team size and intercept

Rowe (2019)

Group decision-making and prioritization task (moon survival)

A hypothetical situation in which a crew stranded on the moon must survive the journey back to their mothership with only 15-items salvaged from the wreck of their explorer craft. Items must be ranked according to their survival utility and compared against experts. (6 min)

  1. Note: Criterion tasks were always measured external and subsequent to the group IQ test battery; an additional study by Engel et al. (2014ab) used the Desert Survival Task or DST (as reported in study one of Engel et al. 2015ab) as the criterion and reported an outcome of b = .24 and p = .058. The DST asks groups to rank, in order of survival value, a random set of items while stranded in a desert. Results were not included in the meta-analysis because we were not clear about: (a) whether the beta coefficient was (un)standardized; (b) what the predictor variable was (it was assumed to pertain to the regression weight of the c-factor); (c) and was not reported as to whether the score pertained to the online, face-to-face, or combined subset of the sample