Effect of a Universal Mindfulness Program on Well-Being in Adolescents: A Cluster Randomized Controlled Trial

ERCT Criteria Breakdown

• Level 1 Criteria

  • C

    Class-level RCT

    • Randomization was clustered (school-level or class-level), meeting the class-level-or-stronger ERCT randomization requirement.
    • "Randomization was performed at the school level to ensure balanced intervention and control groups, based on the language of teaching (Finnish, Swedish or English), number of classes participating, grade, location, and socioeconomic indicators in the school’s area (e.g., average apartment prices per square meter)." (p. 3)
    • Relevant Quotes: 1) "Randomization was performed at the school level to ensure balanced intervention and control groups, based on the language of teaching (Finnish, Swedish or English), number of classes participating, grade, location, and socioeconomic indicators in the school’s area (e.g., average apartment prices per square meter)." (p. 3) 2) "Prior to the collection of baseline data, the classes were randomly assigned to the intervention (N=94), active control (N=85), and inactive control (N=31)." (p. 3) Detailed Analysis: Criterion C requires random assignment at the class level (or stronger, such as school) to reduce contamination. The paper explicitly reports randomization "at the school level" and also states that "the classes were randomly assigned" to arms. Either way, the assignment is clustered (school/class), not student-within-class, which satisfies Criterion C. Final summary: Criterion C is met because the unit of randomization is clustered at class level or higher (school level).
  • E

    Exam-based Assessment

    • Outcomes were measured with well-being questionnaires/scales, not standardized exam-based educational assessments.
    • "Well-being was assessed with life satisfaction and positive and negative affect measures." (p. 8)
    • Relevant Quotes: 1) "Well-being was assessed with life satisfaction and positive and negative affect measures." (p. 8) 2) "Positive and negative affect were assessed with Positive and negative affect schedule (PANAS) (Watson et al., 1988)." (p. 8) Detailed Analysis: Criterion E requires standardized exam-based assessment of educational outcomes (e.g., state/national standardized achievement tests). This paper measures hedonic well-being using self-report instruments (OECD life satisfaction item, SWLS-C, and PANAS). While these are widely used and validated scales for psychological well-being, they are not standardized academic exams and they do not measure academic achievement. Final summary: Criterion E is not met because the study does not use standardized exam-based educational assessments.
  • T

    Term Duration

    • Outcomes were measured at a 26-week follow-up, exceeding a term-length (3–4 month) tracking window from baseline/intervention start.
    • "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8)
    • Relevant Quotes: 1) "The intervention group had a 9-week mindfulness program called .b (Stop and Breathe/Be) (Huppert & Johnson, 2010)." (p. 3) 2) "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8) Detailed Analysis: Criterion T requires that outcomes be measured at least one academic term after the intervention begins (typically about 3–4 months). The intervention is described as a "9-week" program and outcomes are measured not only at the end of the program but also at "26 weeks of follow-up." A 26-week follow-up is about six months, which exceeds a typical term-length follow-up requirement. Final summary: Criterion T is met because outcomes were assessed at a 26-week follow-up from baseline/intervention start.
  • D

    Documented Control Group

    • The paper clearly describes both active and inactive control groups and reports group sizes and measurement timing.
    • "The inactive control group had a normal school curriculum without intervention." (p. 8)
    • Relevant Quotes: 1) "The active control group had a 9-week relaxation program, “Relax”, with 45-min group lessons weekly and recommendation for home practice 5–6 times per week." (p. 3) 2) "The inactive control group had a normal school curriculum without intervention." (p. 8) 3) "There were 2995 participants (1334 in the intervention group, 1291 in the active control group, and 370 in the inactive control group) who filled at least one well-being measure at baseline, 9 weeks, or 26 weeks (Table 1)." (p. 3) 4) "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8) Detailed Analysis: Criterion D requires that the control group(s) be well documented, including what they received and how/when they were measured. The paper documents (a) an active control program ("Relax") with stated duration, lesson length, and home practice recommendations, and (b) an inactive control described as a normal curriculum without intervention. It also reports group sizes and that all groups completed the same measures at baseline and both follow-ups. Final summary: Criterion D is met because both control conditions are described and measured alongside the intervention with clear group documentation.

• Level 2 Criteria

  • S

    School-level RCT

    • The paper states that randomization was performed at the school level and later reiterates school-level execution of randomization.
    • "Randomization was performed at the school level to ensure balanced intervention and control groups, based on the language of teaching (Finnish, Swedish or English), number of classes participating, grade, location, and socioeconomic indicators in the school’s area (e.g., average apartment prices per square meter)." (p. 3)
    • Relevant Quotes: 1) "Randomization was performed at the school level to ensure balanced intervention and control groups, based on the language of teaching (Finnish, Swedish or English), number of classes participating, grade, location, and socioeconomic indicators in the school’s area (e.g., average apartment prices per square meter)." (p. 3) 2) "Furthermore, experienced mindfulness facilitators conducted the intervention, and the randomization process was executed at the school level, which reduced the potential for contamination." (p. 15) Detailed Analysis: Criterion S requires randomization at the school level (schools, not only classes/students, are assigned to conditions). The paper explicitly states that randomization was performed "at the school level" and later reiterates that the randomization process was executed at the school level to reduce contamination. While the paper also uses language about classes being randomly assigned, the explicit school-level statements support that the allocation was done at the school level (or at least school-level clustering was used for assignment). Final summary: Criterion S is met because the paper explicitly reports school-level execution of randomization.
  • I

    Independent Conduct

    • The paper does not clearly document independent external evaluation; key trial activities (data collection and analysis) were performed by the author team.
    • "Material preparation and data collection were performed by Salla-Maarit Volanen. Analysis was performed by Jemina Qvick and Tero Vahlberg." (p. 16)
    • Relevant Quotes: 1) "Authors Contributions All authors contributed to the study conception and design. Material preparation and data collection were performed by Salla-Maarit Volanen. Analysis was performed by Jemina Qvick and Tero Vahlberg." (p. 16) 2) "Each facilitator was evaluated in a qualification process that included delivering a b-lesson assessed by the research team and external MBSR-trained colleagues." (p. 3) Detailed Analysis: Criterion I requires clear documentation that the evaluation was conducted independently from the intervention designers/providers (or otherwise external/independent oversight that reduces bias risks). The paper attributes material preparation/data collection and analysis to the author team. It also indicates the research team assessed facilitator qualification (with some involvement of "external MBSR-trained colleagues"), but it does not clearly document that the overall trial conduct and evaluation (data collection, outcome assessment, analysis, and reporting) were performed by an independent external evaluator. Final summary: Criterion I is not met because independent external conduct of the evaluation is not clearly documented.
  • Y

    Year Duration

    • The longest follow-up reported in this paper is 26 weeks, which is below the ERCT threshold of at least 75% of a typical academic year.
    • "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8)
    • Relevant Quotes: 1) "The intervention group had a 9-week mindfulness program called .b (Stop and Breathe/Be) (Huppert & Johnson, 2010)." (p. 3) 2) "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8) Detailed Analysis: Criterion Y requires outcomes to be measured at least 75% of one academic year after the intervention begins (commonly about 9–10 months). This paper reports baseline, 9-week, and 26-week measurement occasions. A 26-week follow-up is about six months, which is meaningfully shorter than the 75% of a typical academic year threshold. Final summary: Criterion Y is not met because the longest follow-up in this paper is 26 weeks rather than approximately a school year.
  • B

    Balanced Control Group

    • The active control closely matches the intervention on session duration and home-practice recommendations, and the extra time/resources are part of the intervention packages being tested.
    • "The active control group had a 9-week relaxation program, “Relax”, with 45-min group lessons weekly and recommendation for home practice 5–6 times per week." (p. 3)
    • Relevant Quotes: 1) "The program involved 45-min weekly group lessons, with participants being encouraged to practice independently at home 5–6 times per week for 3–15 min." (p. 3) 2) "The active control group had a 9-week relaxation program, “Relax”, with 45-min group lessons weekly and recommendation for home practice 5–6 times per week." (p. 3) 3) "The inactive control group had a normal school curriculum without intervention." (p. 8) 4) "The facilitators in both intervention and control groups, except one, had basic education in education or health and welfare: teachers, psychologists, health professionals, a nutritionist, and a lawyer." (p. 8) Detailed Analysis: Criterion B compares the nature, quantity, and quality of resources (time, materials, adult support) provided to intervention and control conditions, unless the extra resources are integral to the treatment package being tested. Here, the mindfulness intervention includes weekly 45-minute lessons and recommended home practice. The active control ("Relax") is described with the same weekly 45-minute lessons and the same home practice frequency, which supports balanced time/attention between the two active arms. The paper also indicates broadly comparable facilitator background across intervention and control groups. The inactive control is "normal school curriculum without intervention," which does not match additional program time. However, the study includes a closely time-matched active control designed to isolate mindfulness specific effects from general program attention/time, and the extra time is an integral part of the intervention packages being tested. Final summary: Criterion B is met because the active control condition closely matches the intervention in time and participant burden, and the added resources are integral to the tested program packages.

• Level 3 Criteria

  • R

    Reproduced

    • No peer-reviewed independent replication of this specific trial by a separate research team was found.
    • "To the best of our knowledge, this is the first large-scale randomized controlled trial (RCT) with active and inactive control groups to examine the effects of universal mindfulness-based intervention (MBI) on the well-being of adolescents in a school setting." (p. 2)
    • Relevant Quotes: 1) "To the best of our knowledge, this is the first large-scale randomized controlled trial (RCT) with active and inactive control groups to examine the effects of universal mindfulness-based intervention (MBI) on the well-being of adolescents in a school setting." (p. 2) Detailed Analysis: Criterion R requires an independently replicated study (a different research team reproducing the study in a different context and publishing it in a peer-reviewed outlet). I searched for replication studies explicitly aiming to reproduce this specific Finnish Healthy Learning Mind (ISRCTN18642659) trial as reported in this paper. I found multiple publications analyzing outcomes from the same Healthy Learning Mind trial, but these were authored by the same overall research group/cohort and therefore do not constitute independent replication for ERCT purposes. Final summary: Criterion R is not met because independent replication of this specific trial by a separate research team was not found.
  • A

    All-subject Exams

    • Because the study does not use standardized exam-based academic assessments (Criterion E is not met), the all-subject exams criterion is automatically not met.
    • "Well-being was assessed with life satisfaction and positive and negative affect measures." (p. 8)
    • Relevant Quotes: 1) "Well-being was assessed with life satisfaction and positive and negative affect measures." (p. 8) Detailed Analysis: Criterion A requires standardized exam-based assessments across all main school subjects, and ERCT rules specify that if Criterion E is not met, Criterion A is not met. This paper assesses well-being via questionnaires/scales rather than standardized academic exams in any subject area. Final summary: Criterion A is not met because Criterion E is not met and the outcomes are not all-subject standardized exams.
  • G

    Graduation Tracking

    • Graduation tracking is not reported, and ERCT rules also require G to be not met when Y (year duration) is not met.
    • "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8)
    • Relevant Quotes: 1) "All the groups filled in the same questionnaires at baseline, 9 weeks (after the intervention), and at 26 weeks of follow-up." (p. 8) Detailed Analysis: Criterion G requires tracking participants until graduation from the relevant educational stage. This paper reports follow-up only through 26 weeks and does not mention graduation outcomes or tracking to graduation. Additionally, ERCT rules specify that if Criterion Y is not met, then Criterion G is not met. Since this paper does not meet the year-duration threshold (Y is not met), G cannot be met. I also searched for follow-up publications by the same author group that tracked this cohort to graduation, but I did not find any papers reporting graduation tracking for this trial cohort. Final summary: Criterion G is not met because graduation tracking is not reported and the year-duration prerequisite is not satisfied.
  • P

    Pre-Registered

    • The trial registration is described as retrospective and is dated after data collection began.
    • "ISRCTN18642659 retrospectively registered on 13 October 2015." (p. 1)
    • Relevant Quotes: 1) "The data were collected from 2014 to 2016." (p. 2) 2) "ISRCTN18642659 retrospectively registered on 13 October 2015." (p. 1) Detailed Analysis: Criterion P requires that the study protocol be pre-registered before data collection begins. The paper states data collection occurred "from 2014 to 2016," and the paper’s abstract explicitly labels the ISRCTN registration as "retrospectively registered on 13 October 2015," which is not prospective relative to a 2014 start. I also checked the ISRCTN record for ISRCTN18642659, which lists a registration date of 13/10/2015 and a study start period beginning in January 2014, consistent with registration occurring after the study began. Final summary: Criterion P is not met because the registration was retrospective and occurred after the reported start of data collection.