Beyond positive thinking: A randomized trial of mental contrasting with implementation intentions to curb academic procrastination

ERCT Criteria Breakdown

• Level 1 Criteria

  • C

    Class-level RCT

    • Random assignment was at the individual student level rather than at the class (or school) level.
    • "A total of 101 first-year undergraduate students (Mage = 19.8 years, SD = 1.2; 58 % female) met the eligibility criteria and were randomly assigned to either the MCII intervention group (n = 50) or the PTS control group (n = 51)." (p. 3)
    • Relevant Quotes: 1) "This study used a randomized, controlled, between-subjects design with two intervention conditions as the independent variable: MCII and PTS as the control group." (p. 3) 2) "A total of 101 first-year undergraduate students (Mage = 19.8 years, SD = 1.2; 58 % female) met the eligibility criteria and were randomly assigned to either the MCII intervention group (n = 50) or the PTS control group (n = 51)." (p. 3) Detailed Analysis: ERCT Criterion C requires randomization at the class level (or a stronger unit such as school/site), unless the intervention is clearly one-to-one tutoring/personal teaching (in which case student-level randomization is acceptable). The paper explicitly describes a "between-subjects design" and states that individual undergraduate students were "randomly assigned" to MCII versus PTS. There is no indication that intact classes, course sections, or schools/sites were randomized, and the intervention is not described as individualized tutoring. Final Summary: Criterion C is not met because randomization occurred at the individual student level rather than at the class (or higher) level.
  • E

    Exam-based Assessment

    • Outcomes were measured with self-report items and diaries rather than standardized exam-based academic assessments.
    • "Four dependent variables were examined, all measured through self-report: task aversiveness, outcome utility, willingness to act, and task initiation (see Table 1)." (p. 3)
    • Relevant Quotes: 1) "Four dependent variables were examined, all measured through self-report: task aversiveness, outcome utility, willingness to act, and task initiation (see Table 1)." (p. 3) 2) "To assess behavioral engagement, all participants completed two brief diary prompts per day (one in the morning and one in the evening), indicating whether they had started working on their assigned academic task." (p. 3) Detailed Analysis: ERCT Criterion E requires standardized exam-based assessments of educational outcomes (e.g., standardized achievement tests). Measures that are self-report items, experience-sampling prompts, or diary indicators of starting a task are not exam-based academic assessments. The paper explicitly states that all dependent variables were measured through self-report, and describes diary prompts for task initiation. Although PASS is used at baseline for screening, PASS is not an exam-based academic outcome measure, and it is not used as the main post-intervention academic assessment. Final Summary: Criterion E is not met because the study does not use standardized exam-based academic assessments as outcomes.
  • T

    Term Duration

    • Outcomes were measured over a seven-day period with a one-week follow-up, which is much shorter than one academic term.
    • "The three psychological variables, namely task aversiveness, outcome utility, and willingness to act, were measured twice daily throughout the seven-day intervention period and again at a one- week follow-up." (p. 3)
    • Relevant Quotes: 1) "The three psychological variables, namely task aversiveness, outcome utility, and willingness to act, were measured twice daily throughout the seven-day intervention period and again at a one- week follow-up." (p. 3) 2) "Immediately after the intervention, participants entered a seven-day post-test phase using the ESM." (p. 4) 3) "One week after the intervention, a follow-up assessment was conducted to examine the durability of the first three variables." (p. 4) Detailed Analysis: ERCT Criterion T requires outcomes to be measured at least one full academic term after the intervention begins (typically ~3–4 months), even if the intervention itself is brief. The paper describes (a) a "seven-day intervention period," (b) a "seven-day post-test phase," and (c) a "one-week follow-up." This indicates that outcomes are tracked on the scale of days to about two weeks rather than months, and therefore do not reach a term- length follow-up interval. Final Summary: Criterion T is not met because follow-up is about one week after a seven-day intervention, far shorter than an academic term.
  • D

    Documented Control Group

    • The PTS control condition is described, group sizes are reported, and baseline comparability is discussed.
    • "Participants in the PTS condition followed a similar procedure in both structure and timing, but were instructed to visualize only two positive outcomes of achieving their academic goal, without reflecting on obstacles or developing implementation plans." (p. 4)
    • Relevant Quotes: 1) "This study used a randomized, controlled, between-subjects design with two intervention conditions as the independent variable: MCII and PTS as the control group." (p. 3) 2) "A total of 101 first-year undergraduate students (Mage = 19.8 years, SD = 1.2; 58 % female) met the eligibility criteria and were randomly assigned to either the MCII intervention group (n = 50) or the PTS control group (n = 51)." (p. 3) 3) "Participants in the PTS condition followed a similar procedure in both structure and timing, but were instructed to visualize only two positive outcomes of achieving their academic goal, without reflecting on obstacles or developing implementation plans." (p. 4) 4) "In the pre-test, there was no significant difference in task aversiveness between MCII and PTS groups (p = .276), indicating that both groups started at a comparable baseline." (p. 5) Detailed Analysis: ERCT Criterion D requires that the control group be documented sufficiently to interpret the comparison, including a clear description of what the control group received, sample sizes, and information supporting comparability. The paper explicitly identifies PTS as the control group, provides a description of what PTS participants did, reports group sizes at randomization, and states that at pre-test there was no significant difference between groups on task aversiveness, indicating baseline comparability on at least one key construct. Final Summary: Criterion D is met because the control condition (PTS) is clearly described and the paper reports group sizes and baseline comparability information.

• Level 2 Criteria

  • S

    School-level RCT

    • The unit of randomization is individual students, not schools/sites.
    • "A total of 101 first-year undergraduate students (Mage = 19.8 years, SD = 1.2; 58 % female) met the eligibility criteria and were randomly assigned to either the MCII intervention group (n = 50) or the PTS control group (n = 51)." (p. 3)
    • Relevant Quotes: 1) "A total of 101 first-year undergraduate students (Mage = 19.8 years, SD = 1.2; 58 % female) met the eligibility criteria and were randomly assigned to either the MCII intervention group (n = 50) or the PTS control group (n = 51)." (p. 3) Detailed Analysis: ERCT Criterion S requires school-level (or site/institution-level) randomization (i.e., schools/sites are randomly assigned to intervention vs control). The quoted text shows that randomization was performed for individual undergraduate students, with no indication that multiple schools/sites were randomized. Final Summary: Criterion S is not met because randomization was not conducted at the school/site level.
  • I

    Independent Conduct

    • The study procedures describe researcher-led implementation and fidelity checks without stating an independent external evaluator.
    • "A trained researcher reviewed each submission in accordance with the official WOOP evaluation guidelines (Oettingen et al., 2015)." (p. 4)
    • Relevant Quotes: 1) "To ensure consistency and procedural validity, the researcher obtained the official WOOP intervention kit from the WOOPmylife.org website prior to implementation." (p. 4) 2) "A trained researcher reviewed each submission in accordance with the official WOOP evaluation guidelines (Oettingen et al., 2015)." (p. 4) Detailed Analysis: ERCT Criterion I requires independent conduct of the evaluation (i.e., data collection/implementation/analysis performed by an independent third party, or otherwise clearly separated from the intervention designers/authors), with explicit documentation of that independence. The paper describes actions performed by "the researcher" (obtaining the kit, reviewing fidelity submissions). In the provided paper text, there is no explicit statement that an independent external evaluation team conducted the trial or the analysis. Final Summary: Criterion I is not met because independent third-party conduct is not explicitly documented.
  • Y

    Year Duration

    • The study duration is far shorter than 75% of an academic year, and ERCT rules also require Y to be false when T is false.
    • "The three psychological variables, namely task aversiveness, outcome utility, and willingness to act, were measured twice daily throughout the seven-day intervention period and again at a one- week follow-up." (p. 3)
    • Relevant Quotes: 1) "The three psychological variables, namely task aversiveness, outcome utility, and willingness to act, were measured twice daily throughout the seven-day intervention period and again at a one- week follow-up." (p. 3) 2) "One week after the intervention, a follow-up assessment was conducted to examine the durability of the first three variables." (p. 4) Detailed Analysis: ERCT Criterion Y requires outcomes to be measured at least 75% of an academic year after the intervention begins. Additionally, per the ERCT dependency rule provided with this task, if Criterion T is not met then Criterion Y is not met. Here, the study’s tracking spans a seven-day intervention period and a one-week follow-up, which is far shorter than an academic year. Criterion T is also not met, which independently forces Y to be not met under the rule. Final Summary: Criterion Y is not met because outcomes were tracked for about two weeks, not for most of an academic year (and T is not met).
  • B

    Balanced Control Group

    • The control condition is described as time- and structure-matched, and the additional MCII fidelity feedback appears limited and integral to delivering MCII rather than a large resource imbalance.
    • "Participants in the PTS condition followed a similar procedure in both structure and timing, but were instructed to visualize only two positive outcomes of achieving their academic goal, without reflecting on obstacles or developing implementation plans." (p. 4)
    • Relevant Quotes: 1) "Participants in the PTS condition followed a similar procedure in both structure and timing, but were instructed to visualize only two positive outcomes of achieving their academic goal, without reflecting on obstacles or developing implementation plans." (p. 4) 2) "Approximately 18 % of participants received brief written feedback requesting greater specificity (for example, 'Please specify the exact situation that triggers your plan')." (p. 4) Detailed Analysis: ERCT Criterion B asks whether the control condition provides a balanced substitute for the intervention’s time/resources unless extra time/budget/resources are explicitly the treatment variable. The paper explicitly states PTS "followed a similar procedure in both structure and timing," indicating an active control designed to match engagement. The MCII group additionally received brief written feedback for plan specificity for a subset of participants (18%). This is an extra input, but it is described as brief and as part of ensuring MCII plans are operational (i.e., consistent with the defined MCII/WOOP protocol), rather than as extended tutoring time, extra instructional hours, or materially different educational opportunities. While the feedback could be viewed as extra attention, the paper’s description supports treating it as a limited, protocol-integral fidelity component rather than a confounding resource difference large enough to invalidate balance in this study context. Final Summary: Criterion B is met because the control is designed to match structure/timing and no major non-integral resource imbalance is documented beyond limited protocol fidelity feedback.

• Level 3 Criteria

  • R

    Reproduced

    • No independent replication of this specific RCT was found in the paper or via external searching.
    • "First, the study relied on a single-sample, single-site design." (p. 8)
    • Relevant Quotes: 1) "First, the study relied on a single-sample, single-site design." (p. 8) Detailed Analysis: ERCT Criterion R requires that this study (or an explicitly comparable replication of it) be independently reproduced by a different research team and published in a peer-reviewed outlet. The paper itself frames the trial as a single-site study, and it does not claim to be a replication nor provide citations to an independent replication of this specific RCT. An internet search (using the DOI, title, and author combinations) did not identify a peer-reviewed independent replication of this specific MCII vs PTS RCT in the same form as of the ERCT check date. Final Summary: Criterion R is not met because no independent peer-reviewed replication of this specific RCT was found.
  • A

    All-subject Exams

    • The study does not use standardized exams and therefore cannot meet the all-subject standardized exam requirement (and A fails when E fails).
    • "Four dependent variables were examined, all measured through self-report: task aversiveness, outcome utility, willingness to act, and task initiation (see Table 1)." (p. 3)
    • Relevant Quotes: 1) "Four dependent variables were examined, all measured through self-report: task aversiveness, outcome utility, willingness to act, and task initiation (see Table 1)." (p. 3) Detailed Analysis: ERCT Criterion A requires standardized exam-based assessment across all main subjects, and the ERCT dependency rule states that if Criterion E is not met then Criterion A is not met. Because the paper explicitly states outcomes are measured via self-report and does not report standardized exams in any subject, it cannot meet the all-subject standardized exam requirement. Final Summary: Criterion A is not met because the study does not use standardized exams (and E is not met).
  • G

    Graduation Tracking

    • The study reports only a one-week follow-up and no graduation tracking; additionally, G must be false when Y is false.
    • "One week after the intervention, a follow-up assessment was conducted to examine the durability of the first three variables." (p. 4)
    • Relevant Quotes: 1) "One week after the intervention, a follow-up assessment was conducted to examine the durability of the first three variables." (p. 4) 2) "Third, the follow-up period was short, limiting insights into the long-term persistence of MCII effects." (p. 8) Detailed Analysis: ERCT Criterion G requires tracking participants until graduation. The ERCT dependency rule for this task also states that if Criterion Y is not met then Criterion G is not met. The paper explicitly describes only a one-week follow-up and explicitly acknowledges that the follow-up period was short. No plan or results for tracking students to degree completion or graduation are described. An internet search for follow-up papers by the same author team reporting graduation tracking for this specific cohort did not identify any such publication as of the ERCT check date. Final Summary: Criterion G is not met because the study does not track outcomes beyond a one-week follow-up and does not track participants until graduation (and Y is not met).
  • P

    Pre-Registered

    • The paper explicitly states the study was not preregistered.
    • "Fourth, the study was not preregistered." (p. 8)
    • Relevant Quotes: 1) "Fourth, the study was not preregistered." (p. 8) 2) "Although the analytic plan was specified prior to data inspection, the absence of formal preregistration limits the transparency of analytic decisions and should be considered when interpreting the findings." (p. 8) Detailed Analysis: ERCT Criterion P requires a public preregistration record (with an identifiable registry entry and date before data collection). The paper directly states it "was not preregistered," which is definitive evidence that the criterion is not satisfied. Final Summary: Criterion P is not met because the authors explicitly report that the study was not preregistered.