Level 1 Criteria
-
C Class-level RCT
- Randomization was at the student level within one school, not at the class (or higher) level, and the intervention is not described as one-to-one tutoring.
- "We randomly assigned these students to an experimental group of 31 (15 boys) and a control group of 31 (16 boys)." (p. 2)
- Relevant Quotes: 1) "A total of 62 students signed up for MBSR program at a middle school in Changsha, Hunan province." (p. 2) 2) "We randomly assigned these students to an experimental group of 31 (15 boys) and a control group of 31 (16 boys)." (p. 2) 3) "Then they were randomly divided into experimental group and control group." (p. 3) Detailed Analysis: Criterion C requires randomization at the class level (or stronger), to reduce contamination when students within the same class interact and teachers may inadvertently apply aspects of the intervention to all students. The paper describes a single middle school and states that students were randomly assigned to experimental vs. control groups. There is no statement that intact classes (or schools) were randomized. The intervention is a group program plus homework practice, not one-to- one tutoring, so the tutoring exception does not apply. Final sentence: Criterion C is not met because students (not classes or schools) were randomized within one school and the intervention is not one-to-one tutoring.
-
E Exam-based Assessment
- Outcomes were measured with self-report questionnaires/scales (PSQI, ASQ, FFMQ), not standardized exam-based academic assessments.
- "Assessments using the Pittsburgh Sleep Quality Index (PSQI), the Academic Stress Questionnaire (ASQ), and the Five Factors Mindfulness Scale (FFMQ) were conducted before and after the intervention period." (p. 1)
- Relevant Quotes: 1) "Assessments using the Pittsburgh Sleep Quality Index (PSQI), the Academic Stress Questionnaire (ASQ), and the Five Factors Mindfulness Scale (FFMQ) were conducted before and after the intervention period." (p. 1) 2) "Academic stress was measured by the Academic Stress Questionnaire (ASQ) (Chung, 2018)." (p. 2) 3) "Sleep quality over the past month was assessed with the Chinese version of Pittsburgh Sleep Quality Index (PSQI)..." (p. 3) 4) "The Five Facet Mindfulness Questionnaire (FFMQ) prepared by Baer et al. (2006) was used to measure Mindfulness." (p. 3) Detailed Analysis: Criterion E requires standardized exam-based assessments of educational outcomes (i.e., academic achievement tests/exams). This study measures sleep quality, academic stress, and mindfulness using self-report instruments (PSQI, ASQ, FFMQ). These are not standardized academic exams. Final sentence: Criterion E is not met because the outcomes are measured with questionnaire scales rather than standardized academic exams.
-
T Term Duration
- Outcomes were measured immediately after an 8-week intervention, which is shorter than a full academic term (typically ~3-4 months).
- "After the pre-test, the experimental group was given 8 weeks of MBSR training, while the control group was given no training." (p. 3)
- Relevant Quotes: 1) "After the pre-test, the experimental group was given 8 weeks of MBSR training, while the control group was given no training." (p. 3) 2) "The experimental group participated in a 90-min mindfulness-based stress reduction program every Tuesday afternoon for eight weeks." (p. 3) 3) "After eight weeks, sleep quality, academic stress, and mindfulness scales were measured in both the intervention and control groups." (p. 3) Detailed Analysis: Criterion T requires that outcomes are measured at least one full academic term after the intervention begins (or that a shorter intervention has at least term-long follow-up). Here, the intervention lasts eight weeks and outcomes are measured immediately after eight weeks. Eight weeks is substantially shorter than a typical academic term (approximately 12-16 weeks), and the paper does not describe later follow-up measurement. Final sentence: Criterion T is not met because outcomes were measured at the end of an 8-week period, shorter than a full academic term.
-
D Documented Control Group
- The control group is clearly described (no training) and the paper reports sample sizes, demographics, and baseline comparability across groups.
- "After the pre-test, the experimental group was given 8 weeks of MBSR training, while the control group was given no training." (p. 3)
- Relevant Quotes: 1) "We randomly assigned these students to an experimental group of 31 (15 boys) and a control group of 31 (16 boys)." (p. 2) 2) "In the end, a total of 46 subjects completed the experiment, including 22 in the experimental group (10 boys) and 24 in the control group (12 boys)." (p. 2) 3) "After the pre-test, the experimental group was given 8 weeks of MBSR training, while the control group was given no training." (p. 3) 4) "TABLE 1 Demographic characteristics." (p. 4) 5) "Using independent sample t test analysis of baseline data experimental group and control group, according to the results, experimental group and control group before intervention sleep quality, academic stress and mindfulness scores had no significant difference (p 0.05)..." (p. 4) Detailed Analysis: Criterion D requires that the control group is well documented, including what it received, its size, and baseline characteristics/baseline comparability. The paper states the control group was given "no training," provides final group sizes, provides demographic characteristics (Table 1), and reports baseline equivalence on the main measured variables. Final sentence: Criterion D is met because the control group condition and baseline group characteristics/comparability are documented.