Many Labs 3: Evaluating participant pool quality across the academic semester via replication

A short form for assessing individual differences in need for cognition is described.

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.

The Work Preference Inventory (WPI) is designed to assess individual differences in intrinsic and extrinsic motivational orientations. Both the college student and the working adult versions aim to capture the major elements of intrinsic motivation (self-determination, competence, task involvement, curiosity, enjoyment, and interest) and extrinsic motivation (concerns with competition, evaluation, recognition, money or other tangible incentives, and constraint by others). The instrument is scored on two primary scales, each subdivided into 2 secondary scales. The WPI has meaningful factor structures, adequate internal consistency, good short-term test-retest reliability, and good longer term stability. Moreover, WPI scores are related in meaningful ways to other questionnaire and behavioral measures of motivation, as well as personality characteristics, attitudes, and behaviors.