Effectiveness of Task-Trainer Simulation Versus Peer Education on Nursing Students' Learning Outcomes in Mechanical Ventilation: A Randomized Controlled Trial

ERCT Criteria Breakdown

• Level 1 Criteria

  • C

    Class-level RCT

    • Randomization was performed at the individual student level within a single nursing school, not at the class or school level, and the intervention was not purely one-to-one tutoring.
    • "60 sixth-semester undergraduate nursing students from a nursing school in Tehran, Iran, were purposively selected and randomly assigned to three groups: simulation (n=20), peer education (n=20), and control (n=20)."
    • Relevant Quotes: 1) "This is part of a three-arm randomized controlled trial that was conducted from 2023 to 2024..." (p. 3) 2) "60 sixth-semester undergraduate nursing students from a nursing school in Tehran, Iran, were purposively selected and randomly assigned to three groups: simulation (n=20), peer education (n=20), and control (n=20)." (p. 3) 3) "The second author generated the random sequence using the online Random Generator software, and a researcher assistant who was blind to the study design assigned students into groups." (p. 3) 4) "Each learner was individually trained, with the help of a peer student and under the supervision of researchers" (p. 4) 5) "One of the limitations of this study was the possibility of information transfer between the three groups of students." (p. 13) Detailed Analysis: The ERCT 'C' criterion requires that randomization be conducted at the class level or stronger (school level), unless the intervention is one-to-one personal tutoring, in which case student-level randomization is acceptable. Here, the unit of randomization was clearly the individual student: 60 students from a single nursing school were randomly assigned to the three arms. This is student-level randomization within one institution, not class-level or school-level allocation. Although parts of the practical training were delivered individually or in small groups of five, the theory was taught in shared group sessions, and the study is a structured skills-training intervention rather than a classic one-to-one tutoring program. Moreover, the authors explicitly acknowledge a contamination risk ("the possibility of information transfer between the three groups of students"), which is precisely the problem that class-level randomization is meant to prevent. The tutoring exception therefore does not clearly apply. Criterion C is not met because randomization occurred at the individual student level within a single school, with an acknowledged contamination risk, and the intervention is not unambiguously one-to-one tutoring.
  • E

    Exam-based Assessment

    • The knowledge questionnaire and skill checklist were custom-designed by the researchers, not standardized, widely recognized exams.
    • "A knowledge questionnaire was designed by the researchers with 20 four-choice questions in three dimensions."
    • Relevant Quotes: 1) "An individual characteristics questionnaire, a knowledge questionnaire, and a skill assessment checklist regarding BPMV were used to collect data." (p. 4) 2) "A knowledge questionnaire was designed by the researchers with 20 four-choice questions in three dimensions." (p. 4) 3) "The checklist was designed by the researchers and included 25 items in four dimensions." (p. 5) 4) "In this study, researcher-developed tools were designed to align closely with the study's learning objectives, curriculum content, and the specific competencies targeted in both educational methods." (p. 12) 5) "Future studies are recommended to adopt standardized assessment frameworks to enhance cross-study comparability." (p. 12) Detailed Analysis: The 'E' criterion requires the use of standardised, widely recognised exam-based assessments that are not created specifically for the study. In this paper, both the knowledge questionnaire and the skill checklist were explicitly designed by the researchers themselves. While the authors report validity (CVR, CVI) and reliability metrics, these tools remain custom, study-specific instruments rather than standardised national or state exams. The authors themselves note that no comprehensive standardized instrument was used and recommend that future studies adopt standardized assessment frameworks. Criterion E is not met because outcomes were measured with researcher-designed custom tools rather than a recognized standardised exam.
  • T

    Term Duration

    • The intervention consisted of two 2-hour sessions and the final measurement was only one month later, well short of a full academic term.
    • "Data were collected before, immediately, and one month after the intervention."
    • Relevant Quotes: 1) "Based on the curriculum communicated by the Ministry of Health, Treatment, and Medical Education at Iranian medical universities, the BPMV was taught to nursing students in two experimental groups in two 2-hour sessions." (p. 3) 2) "The training consisted of two parts: theoretical topics (60 minutes) and practical work (180 minutes)." (p. 3) 3) "Data were collected before, immediately, and one month after the intervention." (p. 6) Detailed Analysis: The 'T' criterion requires that outcomes be measured at least one full academic term (approximately 3-4 months) after the intervention begins. Here, the intervention itself was very short (two 2-hour sessions), and the longest follow-up measurement occurred only one month after the intervention. Even allowing for short interventions with term-long follow-up tracking, a one-month interval falls well short of a full academic term. Criterion T is not met because the interval from intervention start to the final measurement was only about one month, shorter than one academic term.
  • D

    Documented Control Group

    • The control group (n=20) is documented with baseline demographics, baseline scores, and confirmation that it received no study intervention.
    • "During the study, the researchers did not perform any intervention in the control group."
    • Relevant Quotes: 1) "...randomly assigned to three groups: simulation (n=20), peer education (n=20), and control (n=20)." (p. 3) 2) "Data were collected first from the control group and then from the experimental groups. During the study, the researchers did not perform any intervention in the control group. After the study, the researchers taught the BPMV to the control group students through the task-trainer simulator." (p. 6) 3) "Table 1. Comparison of Individual Characteristics of Students in Task-Trainer Simulation, Peer Education, and Control Groups" - reporting age, GPA, gender, marital status, work history, and prior MV experience for the control group (p. 8) 4) "Table 2 ... Control Mean (SD) (n=20)" reporting baseline (pre-intervention) knowledge, performance, and speed scores for the control group (p. 9) 5) "In addition, the control group was not really a pure control group, because these students also learned related content during the internship." (p. 13) Detailed Analysis: The 'D' criterion requires the control group to be well-documented, including demographic information, baseline performance, and the treatment received. This study provides a dedicated control column in Table 1 (demographics, GPA, prior experience) and Table 2 (baseline knowledge, performance, and speed scores), clearly reports the control group size (n=20), and states that the control group received no study intervention (with the honest caveat that these students still learned related content during their internship). This gives readers sufficient information to judge baseline comparability and control conditions. Criterion D is met because the control group's size, demographics, baseline scores, and conditions are clearly documented.

• Level 2 Criteria

  • S

    School-level RCT

    • Randomization occurred at the individual student level within one nursing school, not at the school or institution level.
    • "60 sixth-semester undergraduate nursing students from a nursing school in Tehran, Iran, were purposively selected and randomly assigned to three groups..."
    • Relevant Quotes: 1) "60 sixth-semester undergraduate nursing students from a nursing school in Tehran, Iran, were purposively selected and randomly assigned to three groups: simulation (n=20), peer education (n=20), and control (n=20)." (p. 3) 2) "Additionally, this study was conducted in a nursing school that this 'single-center' design limits the generalizability of findings. So, it is suggested to conduct future multi-center triple-blind randomized controlled trials." (p. 13) Detailed Analysis: The 'S' criterion requires randomization at the school (or implementing-institution) level, with multiple schools randomly assigned. This study was conducted in a single nursing school and randomized individual students to conditions. There is only one center and no school-level randomization. The authors themselves describe the design as "single-center." Criterion S is not met because randomization was at the individual student level within a single school, not at the school level.
  • I

    Independent Conduct

    • The researchers designed the educational content and also delivered and evaluated the intervention, with no independent third-party conduct of the trial.
    • "First, educational content on the BPMV was prepared based on the nursing student curriculum and approved by two clinical instructors specializing in this field."
    • Relevant Quotes: 1) "First, educational content on the BPMV was prepared based on the nursing student curriculum and approved by two clinical instructors specializing in this field." (p. 3) 2) "The first researcher, a critical care master's student, taught 20 undergraduate students (five students each day)." (p. 3) 3) "The statistical analyst was unaware of the allocation of students to the experimental and control groups. Specifically, group assignments were coded using neutral identifiers (Group A, B, and C) by one of the researchers who was not involved in data analysis." (pp. 6-7) 4) "ZF contributed to the conceptualization, planning, data analysis, interpretation, and writing the manuscript. AR contributed to the planning, data collection, and writing the first draft..." (p. 14) Detailed Analysis: The 'I' criterion requires the study to be conducted independently from those who designed the intervention, to reduce bias in implementation, measurement, and analysis. Here, the same research team prepared the educational content, delivered the intervention (the first researcher taught the simulation group and trained/supervised the peers), and collected the data. While the statistical analyst was blinded to group allocation - a positive feature - the trial as a whole was designed, implemented, and evaluated by the authors themselves, with no external or third-party evaluation team. Analyst blinding alone does not establish independent conduct of the intervention. Criterion I is not met because the authors who designed the intervention also delivered and evaluated it, without independent third-party conduct.
  • Y

    Year Duration

    • The intervention and follow-up spanned only about one month, far short of the required 75% of an academic year, and criterion T is not met.
    • "Data were collected before, immediately, and one month after the intervention."
    • Relevant Quotes: 1) "...the BPMV was taught to nursing students in two experimental groups in two 2-hour sessions." (p. 3) 2) "Data were collected before, immediately, and one month after the intervention." (p. 6) 3) "Also, long-term follow-up assessments are recommended to evaluate the retention of MV knowledge and skills beyond the immediate post-intervention period." (p. 13) Detailed Analysis: The 'Y' criterion requires outcomes to be measured at least 75% of a full academic year (~9-10 months) after the intervention begins. The maximum follow-up here was one month after a very brief intervention, which is far below this threshold. Additionally, per the standard, because the weaker term-duration criterion (T) is not met, the year-duration criterion (Y) cannot be met. The authors themselves call for future long-term follow-up. Criterion Y is not met because tracking lasted only about one month, far short of an academic year, and criterion T is not met.
  • B

    Balanced Control Group

    • The additional educational time is the treatment variable being tested against a business-as-usual control, and the two experimental arms received the same educational package and equal time.
    • "The educational package included a lesson plan, a timetable, a teaching content booklet, slides prepared in PowerPoint software, and educational scenarios that were the same in the two experimental groups."
    • Relevant Quotes: 1) "The educational package included a lesson plan, a timetable, a teaching content booklet, slides prepared in PowerPoint software, and educational scenarios that were the same in the two experimental groups." (p. 3) 2) "...the BPMV was taught to nursing students in two experimental groups in two 2-hour sessions. The training consisted of two parts: theoretical topics (60 minutes) and practical work (180 minutes)." (p. 3) 3) "During the study, the researchers did not perform any intervention in the control group. After the study, the researchers taught the BPMV to the control group students through the task-trainer simulator." (p. 6) 4) "In this study, no intervention was performed in the control group by the researchers, but this group also learned skills related to BPMV from their instructor during the internship period..." (p. 11) Detailed Analysis: Criterion B compares the nature, quantity, and quality of resources (time, materials, support) given to the intervention and control conditions. The experimental groups received additional educational input: two 2-hour BPMV teaching sessions using either a task-trainer simulator or peer instruction, with an identical educational package. The control group received no study intervention (only business-as-usual internship learning). Applying the decision tree: extra resources are present, but the additional educational instruction IS the explicit treatment variable being tested - the study's aim is to evaluate whether task-trainer simulation and peer education improve learning outcomes relative to business-as-usual. Under the standard, when the additional resource is the treatment variable, the control group may remain business-as-usual by design. Crucially, the primary contrast (simulation vs. peer education) is well balanced: both experimental arms received the same educational package and the same amount of instructional time. The main acknowledged confound is teacher identity and practice setting, not an unmatched time/budget add-on. Criterion B is met because the additional teaching is the integral treatment variable tested against a business-as-usual control, and the two experimental arms received equal, matched educational time and materials.

• Level 3 Criteria

  • R

    Reproduced

    • No independent replication of this specific trial by a different research team in a peer-reviewed journal is reported or identified.
    • "to the best of researchers' knowledge, no study has examined the differences between these two educational methods in conducting BPMV."
    • Relevant Quotes: 1) "Although some studies have reported the effectiveness of simulation and peer education in improving learners' knowledge and skills, to the best of researchers' knowledge, no study has examined the differences between these two educational methods in conducting BPMV." (p. 3) 2) "Similarly, Bakhshi et al reported that integrated simulated-practical training with HamiltonC2 software and practical training had similar effectiveness in nursing students' knowledge of ventilator use..." (p. 8) Detailed Analysis: The 'R' criterion requires that this specific study (or its central claim in the same context and design) be independently replicated by a different research team and published in a peer-reviewed journal. This paper cites related studies on simulation and peer education for MV (e.g., Bakhshi, Salameh, Hayashi), but these are separate studies with different designs and tools, not independent replications of this particular three-arm trial. The authors explicitly state that no prior study has compared these two methods for BPMV. An independent internet search (the paper is a recent 2026 publication) did not reveal any subsequent independent replication of this specific trial by a different team. Criterion R is not met because no independent replication of this specific study has been reported or identified.
  • A

    All-subject Exams

    • Only mechanical ventilation knowledge and skills were assessed, using custom tools, so the all-subject standardized-exam requirement is not met.
    • "This study examined the effects of task-trainer simulation and peer education on nursing students' knowledge, clinical performance, and action speed related to basic principles of mechanical ventilation (BPMV)."
    • Relevant Quotes: 1) "This study examined the effects of task-trainer simulation and peer education on nursing students' knowledge, clinical performance, and action speed related to basic principles of mechanical ventilation (BPMV)." (p. 1) 2) "A knowledge questionnaire was designed by the researchers with 20 four-choice questions..." (p. 4) 3) "The checklist was designed by the researchers and included 25 items in four dimensions." (p. 5) Detailed Analysis: The 'A' criterion requires impact to be measured across all main subjects using standardised exam-based assessments, and it explicitly depends on criterion E. This study measured outcomes only within a single specialized clinical topic (basic principles of mechanical ventilation), and did so with custom researcher-designed tools. It did not assess any other subjects, and criterion E (standardised exam) is not met, which by rule also fails criterion A. Criterion A is not met because only a single specialized topic was assessed with custom tools, and criterion E is not met.
  • G

    Graduation Tracking

    • Follow-up ended one month after the intervention with no tracking to graduation, and criterion Y is not met.
    • "Data were collected before, immediately, and one month after the intervention."
    • Relevant Quotes: 1) "Data were collected before, immediately, and one month after the intervention." (p. 6) 2) "Also, long-term follow-up assessments are recommended to evaluate the retention of MV knowledge and skills beyond the immediate post-intervention period." (p. 13) Detailed Analysis: The 'G' criterion requires participants to be followed until graduation to assess long-term impact, and it depends on criterion Y. This study's longest follow-up was one month after the intervention, with no tracking through to graduation. An independent internet search for follow-up publications by the same authors tracking this cohort to graduation returned no such papers. Because criterion Y is not met, criterion G also cannot be met by rule. Criterion G is not met because tracking stopped one month after the intervention with no graduation follow-up, and criterion Y is not met.
  • P

    Pre-Registered

    • Internet verification of the TCTR registry shows the trial was registered retrospectively, after enrollment and after data collection had been completed.
    • "Retrospective registration - This protocol was registered after enrollment of the first participant." (TCTR record TCTR20231012001)
    • Relevant Quotes: 1) "This is part of a three-arm randomized controlled trial that was conducted from 2023 to 2024, and it was registered in the TCTR clinical trials system (No. TCTR20231012001, Date: 12 October 2023. It was registered before participant enrollment, which started at 13 December 2023)." (p. 3) 2) "Clinical Trial Number: No. TCTR20231012001, Date: 04/29/2024." (p. 14) Verbatim evidence from the Thai Clinical Trials Registry record for TCTR20231012001 (https://www.thaiclinicaltrials.org/show/TCTR20231012001): 3) "Retrospective registration - This protocol was registered after enrollment of the first participant." 4) "First Submitted Date : 10 October 2023" and "First Posted Date : 12 October 2023". 5) "Study Start Date (First enrollment) : 03 May 2023 Indicate Type : Actual". 6) "Completion Date (Last subject, Last visit) : 09 October 2023 Indicate Type : Actual". Detailed Analysis: The 'P' criterion requires the study protocol to be pre-registered on a recognized registry before data collection began. The paper claims prospective registration, stating the trial "was registered before participant enrollment, which started at 13 December 2023." However, internet verification of the primary source - the TCTR registry record itself - directly contradicts this claim. The registry explicitly flags the entry as a "Retrospective registration" and states that "This protocol was registered after enrollment of the first participant." According to the registry, the actual first enrollment date was 03 May 2023 and the last subject / last visit was completed on 09 October 2023, whereas the protocol was only first posted on 12 October 2023 - after the entire data-collection window had closed. There is also an internal inconsistency in the paper's own dates (the enrollment date of 13 December 2023 in the Design section versus the clinical trial number date of 04/29/2024 in the back matter), but the authoritative registry metadata settles the question: registration occurred after enrollment and after data collection were complete. Criterion P is not met because the TCTR registry shows the trial was registered retrospectively (first posted 12 October 2023), after enrollment began (03 May 2023) and after data collection was completed (09 October 2023), so the protocol was not pre-registered before data collection.