A Randomized Controlled Trial of the Self-Regulated Strategy Development (SRSD) Instructional Model Using Tier 2 Response-To-Intervention Framework for Middle School Students At-Risk for Writing Difficulties

ERCT Criteria Breakdown

• Level 1 Criteria

  • C

    Class-level RCT

    • Although randomization was within classrooms, the intervention was delivered as supplemental small-group instruction (tutoring-like), so student-level randomization is acceptable under the ERCT exception.
    • "All participating students were randomized within classroom via a random number generator." (p. 5)
    • Relevant Quotes: 1) "All participating students were randomized within classroom via a random number generator." (p. 5) 2) "All students met in small groups for 24 sessions, twice a week, across a 12-week period, for approximately 30 minutes per session (Harris et al., 2008)." (p. 5) Detailed Analysis: Criterion C requires random assignment at the class level (or stronger, such as school-level) to reduce within-classroom contamination, but it provides an exception for interventions that are designed as personal teaching (e.g., tutoring), where student- level randomization is acceptable. Here, the paper explicitly reports student-level randomization "within classroom." However, the delivery format is not a whole- class instructional change implemented by the classroom teacher; it is supplemental Tier 2 instruction delivered in small groups for a defined number of sessions. This is tutoring-like in its structure (pull-out or supplemental small-group instruction), and therefore fits the ERCT exception where class-level randomization is not required. Criterion C is met because the intervention is delivered as supplemental small-group instruction and student-level randomization is acceptable under the tutoring/personal teaching exception.
  • E

    Exam-based Assessment

    • The outcomes include widely used standardized, norm-referenced writing assessments (e.g., WIAT-III and TOWL-4).
    • "Outcome measures included Wechsler Individualized Achievement Test III (WIAT-III), Test of Written Language-Fourth Edition (TOWL-4), and Number of Essay Parts (NOEP)." (Abstract)
    • Relevant Quotes: 1) "Outcome measures included Wechsler Individualized Achievement Test III (WIAT-III), Test of Written Language-Fourth Edition (TOWL-4), and Number of Essay Parts (NOEP)." (Abstract) 2) "The Wechsler Individualized Achievement Test III (WIAT-III; Wechsler, 2009) is a normed referenced achievement test with strong reliability and validity (Ellingsen et al., 2012)." (p. 8) 3) "The Test of Written Language-Fourth Edition (TOWL-4; Hammill & Larson, 2009) is a norm-referenced, comprehensive test of writing that was administered at pre-instruction, post-instruction, and 7th grade follow-up." (p. 8) Detailed Analysis: Criterion E requires standardized exam-based assessments rather than researcher-created tests aligned to the intervention. The WIAT-III and TOWL-4 are established, norm-referenced standardized assessments with documented psychometric properties, and the paper describes them as such. Although NOEP is described as a proximal measure and is not presented as a standardized test, the presence and central use of WIAT-III and TOWL-4 satisfies the ERCT requirement. Criterion E is met because the study used standardized, norm-referenced assessments (WIAT-III and TOWL-4) for outcomes.
  • T

    Term Duration

    • Outcomes were measured after a 12-week instructional period (about one academic term) and again at an approximately 6-month follow-up.
    • "All students met in small groups for 24 sessions, twice a week, across a 12-week period, for approximately 30 minutes per session (Harris et al., 2008)." (p. 5)
    • Relevant Quotes: 1) "All students met in small groups for 24 sessions, twice a week, across a 12-week period, for approximately 30 minutes per session (Harris et al., 2008)." (p. 5) 2) "All data were collected pre-SRSD instruction and post-SRSD instruction in 6th grade, and approximately 6 months later at the follow-up in 7th grade." (p. 7) Detailed Analysis: Criterion T requires outcomes to be measured at least one full academic term after the intervention begins. The intervention ran for "a 12-week period," which is approximately three months and is consistent with a term-length window. The paper also reports an additional follow-up measurement approximately six months later. Because the study clearly documents a 12-week instructional period and includes post-instruction measurement after that period, it satisfies the minimum term-duration requirement. Criterion T is met because outcomes were measured after a 12-week (term-length) intervention period (with an additional follow-up).
  • D

    Documented Control Group

    • The paper documents the control group’s size, baseline characteristics, and what activities it received during sessions.
    • "Table 1. Sample characteristics of SRSD intervention group versus control group." (p. 6)
    • Relevant Quotes: 1) "Seven children subsequently withdrew (4 from SRSD and 3 from control), resulting in a final sample of 243 (160 SRSD and 83 control) students..." (p. 5) 2) "Table 1. Sample characteristics of SRSD intervention group versus control group." (p. 6) 3) "SRSD writing instruction was implemented in the SRSD groups, and the control group met for a similar length of time and engaged in writing tasks, but no explicit instruction was provided." (p. 5) 4) "Rather than receiving explicit writing instruction, students in the control group participated in a brief literacy-based game and engaged in a creative writing activity with a structured prompt or a free write during each session with the researcher." (p. 7) Detailed Analysis: Criterion D requires that the control group be well documented, including its size, baseline characteristics, and what it received. The paper provides the control group sample size (n = 83), baseline demographic characteristics in Table 1, and a concrete description of the control condition activities and the fact that it received no explicit SRSD instruction. This is sufficient documentation to understand what the control group was and what inputs it received during the study. Criterion D is met because the control group is described with sample size, baseline characteristics, and condition activities.

• Level 2 Criteria

  • S

    School-level RCT

    • Randomization occurred within classrooms, not at the school level.
    • "All participating students were randomized within classroom via a random number generator." (p. 5)
    • Relevant Quotes: 1) "All participating students were randomized within classroom via a random number generator." (p. 5) 2) "Students (N = 250) were recruited from three public school districts in the United States that ultimately comprised four cohorts of 6th grade students." (p. 5) Detailed Analysis: Criterion S requires school-level randomization (schools assigned to intervention vs control). While the sample spans multiple public school districts, the paper explicitly states that students were randomized "within classroom," indicating assignment was not made at the school level. Criterion S is not met because allocation was within classroom, not by school.
  • I

    Independent Conduct

    • The authors evaluate an established SRSD model developed by other researchers and report no conflicts of interest, so independence from intervention designers is reasonably documented.
    • "The SRSD group of at-risk writers received explicit instruction based on the SRSD model in the use of specific writing and self- regulation strategies using lesson plans and materials in Powerful Writing Strategies for All Students (Harris et al., 2008)." (p. 6)
    • Relevant Quotes: 1) "The SRSD group of at-risk writers received explicit instruction based on the SRSD model in the use of specific writing and self- regulation strategies using lesson plans and materials in Powerful Writing Strategies for All Students (Harris et al., 2008)." (p. 6) 2) "Disclosure statement No potential conflict of interest was reported by the author(s)." (p. 18) 3) "While the researchers were not blind to group assignment for the posttests, the measures were standardized and age-normed..." (p. 7) Detailed Analysis: Criterion I requires that the evaluation be conducted independently from the authors who designed the intervention. In this paper, the intervention being evaluated is the SRSD model and associated materials authored elsewhere (e.g., Harris et al., 2008), and the current paper’s author team is not presented as the SRSD model’s developer. The paper also includes a disclosure statement reporting no conflicts of interest, which supports independence from a provider or developer with a financial stake in outcomes. The paper does acknowledge assessors were not blind to group assignment at posttest, which is a potential risk of bias, but blinding is not the ERCT criterion I requirement; the ERCT focus is independence from intervention designers. Criterion I is met because the intervention evaluated is an established SRSD model developed by other authors and no conflicts of interest are reported.
  • Y

    Year Duration

    • From intervention start (12-week program) to follow-up assessment approximately 6 months later is roughly 9 months, meeting the 75%-of-academic-year threshold.
    • "All data were collected pre-SRSD instruction and post-SRSD instruction in 6th grade, and approximately 6 months later at the follow-up in 7th grade." (p. 7)
    • Relevant Quotes: 1) "All students met in small groups for 24 sessions, twice a week, across a 12-week period, for approximately 30 minutes per session (Harris et al., 2008)." (p. 5) 2) "All data were collected pre-SRSD instruction and post-SRSD instruction in 6th grade, and approximately 6 months later at the follow-up in 7th grade." (p. 7) Detailed Analysis: Criterion Y requires outcomes to be measured at least 75% of one academic year after the intervention begins. The paper states the instructional period lasted 12 weeks, and that outcomes were also measured approximately 6 months later at a follow-up in 7th grade. Interpreting the timeline as (a) a 12-week intervention window and (b) a follow-up approximately 6 months after post-instruction, the total elapsed time from intervention start to follow-up is approximately 9 months, which is at least 75% of a typical academic year. Criterion Y is met because the study includes follow-up measurement at roughly 9 months after intervention start.
  • B

    Balanced Control Group

    • Both groups received the same scheduled instructional time, and the additional individualized supports (e.g., goal setting) appear to be integral to the SRSD package rather than a separable confound.
    • "The control groups participated for the same amount of time as the students in the SRSD group." (p. 7)
    • Relevant Quotes: 1) "All students met in small groups for 24 sessions, twice a week, across a 12-week period, for approximately 30 minutes per session (Harris et al., 2008)." (p. 5) 2) "SRSD writing instruction was implemented in the SRSD groups, and the control group met for a similar length of time and engaged in writing tasks, but no explicit instruction was provided." (p. 5) 3) "The control groups participated for the same amount of time as the students in the SRSD group." (p. 7) 4) "Students would also meet one-on-one with the researcher to discuss each essay, monitor current goal(s), and set a new goal if needed." (p. 6) 5) "The researchers did not conference or set goals with the students, since those were elements of SRSD instruction." (p. 7) Detailed Analysis: Criterion B compares the nature, quantity, and quality of resources (time, materials, adult support) provided to intervention and control conditions, and asks whether the control condition offers a comparable substitute for the intervention’s inputs unless the additional resources are integral to (or explicitly framed as) the treatment. The study explicitly states that both groups met for the same number and length of sessions (24 sessions, approximately 30 minutes) and that the control groups participated for the same amount of time. This strongly supports that the core resource "scheduled instructional time" was balanced. The SRSD condition includes additional adult-support components such as one-on-one conferencing and goal setting, while the control condition explicitly did not include conferencing or goal setting. This is a real difference in the quality/type of adult support. However, the paper frames conferencing and goal setting as SRSD elements (i.e., integral to the SRSD instructional model being tested). The trial’s intent is to evaluate the SRSD package versus a non-explicit-instruction comparison condition with matched time. Under the ERCT criterion B guidance, integral instructional components that differentiate treatment from control do not automatically violate balance, provided overall time/budget is comparable, which it is here. Criterion B is met because session time is explicitly matched and the additional adult-support components are integral to the SRSD package rather than an unintended add-on.

• Level 3 Criteria

  • R

    Reproduced

    • No peer-reviewed independent replication of this specific 2026 RCT was found, though an IES replication project is underway.
    • "Future work with SRSD should replicate the findings of the SRSD model in small group settings as well as explore its applicability to the general classroom setting." (p. 18)
    • Relevant Quotes: 1) "Future work with SRSD should replicate the findings of the SRSD model in small group settings as well as explore its applicability to the general classroom setting." (p. 18) 2) "In summary, this is one of largest studies of SRSD to date, and one of the few randomized controlled trials to examine the efficacy of SRSD in a small group instructional setting for students at-risk for writing difficulties." (p. 18) Relevant Quotes (Internet / other sources): 3) "The research team will aim to replicate findings from a previous IES efficacy trial on student-level moderators (R305A120145) and teacher ratings of executive functions." (IES replication project description; 2022 award) Detailed Analysis: Criterion R requires an independent replication by a different research team in a different context, published in a peer-reviewed scientific journal. The paper itself frames replication as future work, which is consistent with replication not yet being established for this specific RCT. Internet searching for publications explicitly presenting an independent replication of this specific 2026 RCT (by DOI/title and by citations to this work) did not identify any peer- reviewed replication report as of the ERCT check date. An IES-funded "systematic replication" project exists that aims to replicate findings from the prior efficacy trial (R305A120145), but this is a grant/project description rather than a published replication outcome in the peer-reviewed literature. Criterion R is not met because no published independent replication of this specific RCT was found.
  • A

    All-subject Exams

    • The standardized outcome assessments are focused on writing rather than covering all core school subjects.
    • "For this study, the Essay Composition (EC) subtest that incorporates Word Count (WC) and the Theme Development and Text Organization (TDTO) subtests, were used to assess opinion essay writing skills at pre-instruction, post-instruction, and 7th grade follow-up." (p. 7)
    • Relevant Quotes: 1) "For this study, the Essay Composition (EC) subtest that incorporates Word Count (WC) and the Theme Development and Text Organization (TDTO) subtests, were used to assess opinion essay writing skills at pre-instruction, post-instruction, and 7th grade follow-up." (p. 7) 2) "The Test of Written Language-Fourth Edition (TOWL-4; Hammill & Larson, 2009) is a norm-referenced, comprehensive test of writing that was administered at pre-instruction, post-instruction, and 7th grade follow-up." (p. 8) Detailed Analysis: Criterion A requires standardized exam-based assessments covering all main subjects, not only the subject targeted by the intervention, and it requires Criterion E to be met (it is met here). The standardized outcomes described are writing-focused (WIAT-III writing subtests and TOWL-4 writing measures). The study also includes reading measures as moderators/covariates, but it does not report standardized outcome testing across the full set of core subjects (e.g., mathematics, science, social studies) to detect possible cross-subject impacts. Criterion A is not met because the standardized outcome assessment is limited to writing rather than all core subjects.
  • G

    Graduation Tracking

    • Neither the paper nor identifiable follow-up publications track the cohort to graduation; follow-up is only to approximately 7th grade.
    • "All data were collected pre-SRSD instruction and post-SRSD instruction in 6th grade, and approximately 6 months later at the follow-up in 7th grade." (p. 7)
    • Relevant Quotes: 1) "All data were collected pre-SRSD instruction and post-SRSD instruction in 6th grade, and approximately 6 months later at the follow-up in 7th grade." (p. 7) 2) "Carryover effects of SRSD were examined 6-months post-instruction." (Abstract) Detailed Analysis: Criterion G requires tracking participants until graduation from the relevant educational stage. The present paper reports follow-up outcomes at approximately 6 months post-instruction (in 7th grade), which is far short of graduation-length tracking. Internet searching for follow-up papers by the same author team (Hooper, Costa, Fernandez) that report longer-term outcomes for this same RCT cohort through graduation did not identify any such peer-reviewed follow-up publication or report describing graduation-based tracking for this cohort. Criterion G is not met because follow-up ends in early secondary years (7th grade) and graduation tracking evidence was not found in subsequent publications.
  • P

    Pre-Registered

    • No protocol pre-registration record (registry/ID and pre-study date) was identified in the paper or via registry searching.
    • Relevant Quotes: 1) "Data collection began in the Spring of 2012 (i.e., all data were collected before the COVID pandemic)." (p. 10) 2) "Data availability statement The public database for this study can be located by contacting the first author." (p. 18) Detailed Analysis: Criterion P requires a publicly accessible pre-registered protocol, including a registry name/link (or ID) and a registration date that precedes the start of data collection. The paper provides a data collection start timeframe (Spring 2012) but does not provide a pre-registration URL, registry name, or registration identifier. The data availability statement indicates data access by contacting the first author, which is not equivalent to pre-registration. Internet searching for a pre-registration record associated with this study (by title, authors, and award/grant number) did not identify an eligible protocol registration with a documented date prior to Spring 2012. Criterion P is not met because no verifiable pre-registration record (ID/link and pre-data-collection date) was found.