Improving ESL Reading Comprehension with Task-Based Language Instruction: Emphasizing the Identification of the Main Idea

ERCT Criteria Breakdown

• Level 1 Criteria

  • C

    Class-level RCT

    • Randomisation was carried out at the individual student level (60 volunteers split in half), not at the class or school level, and no tutoring exception applies since this is regular classroom reading instruction.
    • "selecting 60 volunteers (aged between 14 and 16) and divvying them in half, forming two groups: experimental and control groups" (p. 2436-2437)
    • Relevant Quotes: 1) "sixty ESL students aged 14-16 were randomly assigned to experimental (TBLT-based instruction) and control (traditional teaching methods) groups." (Abstract, p. 2431) 2) "selecting 60 volunteers (aged between 14 and 16) and divvying them in half, forming two groups: experimental and control groups." (p. 2436-2437) 3) "Sixty secondary-level ESL students took part in the study. These students were between the ages of 14 and 16. There were two participant groups created." (p. 2437) Detailed Analysis: The paper describes randomisation at the level of individual student volunteers, who were split in half to form the experimental and control groups. There is no mention of randomising intact classes or schools, and no description of measures taken to prevent contamination between the two groups (e.g. separate classrooms, separate schools). The intervention is a classroom reading-comprehension program, not a one-to-one tutoring intervention, so the tutoring exception in the ERCT standard does not apply. Criterion C is not met because randomisation occurred at the student level without a valid exception, and there is no evidence of protection against contamination.
  • E

    Exam-based Assessment

    • The reading comprehension test was a custom instrument created for the study, and the authors explicitly state no standardised assessment tool was used.
    • "Task-Based Exercises for the Test Group although no explicit assessment tool was utilized, the effectiveness of the task-based activities was implicitly assessed by comparing the experimental group's pre-test and post-test outcomes." (p. 2438)
    • Relevant Quotes: 1) "Such multiple-choice, short-answer, and inferential tasks of the pre-test were based on reading passages in which it was aimed at measuring the analogy and understanding skills of students." (p. 2436-2437) 2) "The reading comprehension portions of the pre-test and post-test were followed by multiple-choice, short-answer, and inferential questions. The assessment's goal was to gauge how well pupils understood and analyzed textual content." (p. 2437-2438) 3) "Task-Based Exercises for the Test Group although no explicit assessment tool was utilized, the effectiveness of the task-based activities was implicitly assessed by comparing the experimental group's pre-test and post-test outcomes." (p. 2438) Detailed Analysis: The assessment used was a researcher-designed pre-test/post-test built from selected reading passages with multiple-choice, short-answer and inferential items. No named, widely recognised standardised exam (e.g. a national or internationally validated reading test) is referenced anywhere in the paper, and the authors themselves note that "no explicit assessment tool was utilized." This is precisely the custom, study-specific test scenario the ERCT standard warns against. Criterion E is not met because the outcome measure was a custom-built test, not a standardised exam.
  • T

    Term Duration

    • Outcomes were measured about eight to nine weeks after the intervention began, which falls short of a full academic term.
    • "In order to determine the effects of Task-Based Language Teaching (TBLT) on reading comprehension in ESL learners at the secondary school level, the research was expected to be completed within a period of ten weeks" (p. 2436)
    • Relevant Quotes: 1) "In order to determine the effects of Task-Based Language Teaching (TBLT) on reading comprehension in ESL learners at the secondary school level, the research was expected to be completed within a period of ten weeks; with post and pretest control group research design." (p. 2436) 2) "An Education phase lasted seven weeks and took place in Weeks 3-9." (p. 2437) 3) "Finally to ensure valid comparisons both the groups completed a post-test in Week 10 with the same format as the pre-test." (p. 2437) Detailed Analysis: The intervention (education phase) began in Week 3 and the outcome (post-test) was measured in Week 10, an interval of roughly 7-8 weeks (under two months). The ERCT standard requires outcomes to be measured at least one full academic term (approximately 3-4 months) after the intervention begins, even for naturally short interventions. This study's entire duration, including preparation and orientation weeks, was only ten weeks, well short of a full term. Criterion T is not met because the interval from intervention start to outcome measurement was well under one academic term.
  • D

    Documented Control Group

    • The control group's size, baseline (pre-test) performance, and the nature of the instruction it received are clearly described in the text and accompanying tables.
    • "The students in the control group (N=30) were taught reading comprehension using traditional methods without any homework." (p. 2437)
    • Relevant Quotes: 1) "The students in the control group (N=30) were taught reading comprehension using traditional methods without any homework." (p. 2437) 2) "The control group received traditional reading comprehension instruction from the teacher, who provided explanations and comprehension questions without utilizing a task-based approach." (p. 2437) 3) "Control No Mean S D Df T p-value / Pre RMI 30 6.9333 2.30342 29 -.471 .641 / Post RMI 30 7.1667 1.85850" (Table 4.3, p. 2439) 4) "Sixty secondary-level ESL students took part in the study. These students were between the ages of 14 and 16." (p. 2437) Detailed Analysis: The paper documents the control group's sample size (N=30), age range (14-16, shared with the full sample), baseline (pre-test) mean and standard deviation scores, and the specific teaching approach it received (teacher-centred explanation and comprehension questions, no task-based activities, no homework). While the description does not break down socio-demographic variables separately by group, it does provide quantitative baseline performance data and a clear qualitative account of what the control condition consisted of, which allows readers to judge comparability with the experimental group. Criterion D is met because the control group's size, baseline scores, and instructional conditions are documented in the text and tables.

• Level 2 Criteria

  • S

    School-level RCT

    • Randomisation occurred among individual student volunteers at what appears to be a single site, not among schools.
    • "selecting 60 volunteers (aged between 14 and 16) and divvying them in half, forming two groups: experimental and control groups" (p. 2436-2437)
    • Relevant Quotes: 1) "selecting 60 volunteers (aged between 14 and 16) and divvying them in half, forming two groups: experimental and control groups." (p. 2436-2437) 2) "Sixty secondary-level ESL students took part in the study." (p. 2437) Detailed Analysis: There is no mention of multiple schools being randomised to conditions; the paper describes a single pool of 60 student volunteers split into two groups. This does not meet the stronger school-level randomisation requirement. Criterion S is not met because there is no evidence of school-level (or higher) randomised assignment.
  • I

    Independent Conduct

    • There is no statement that the study was conducted by an independent, third-party evaluation team separate from the researchers who designed and delivered the intervention.
    • Relevant Quotes: No quotes in the paper describe an external or independent evaluation team, data collection agency, or blinded test administrators. The Methodology section describes the authors/ researchers themselves as arranging authorisation, selecting volunteers, briefing both groups on their respective teaching philosophies, and administering the pre-/post-tests, with no mention of any independent party. Detailed Analysis: The ERCT standard requires evidence that the evaluation was conducted independently of those who designed the intervention (e.g. an external evaluation agency or blinded administrators). No such statement appears anywhere in the paper; the research team appears to have designed, delivered, and assessed both conditions itself. Criterion I is not met because no evidence of independent conduct is provided.
  • Y

    Year Duration

    • Since criterion T (Term Duration) is not met, the stronger Year Duration criterion cannot be met either.
    • Relevant Quotes: 1) "the research was expected to be completed within a period of ten weeks" (p. 2436) Detailed Analysis: Per the ERCT standard, if the weaker Term Duration criterion (T) is not met, the stronger Year Duration criterion (Y) cannot be met. The study's entire duration was only ten weeks, far short of 75% of an academic year. Criterion Y is not met because criterion T is not met and the study duration (ten weeks) is far below a full academic year.
  • B

    Balanced Control Group

    • Both groups received instruction over the same schedule and the same reading passages; the intervention differed in teaching method, not in additional time or budget, so no imbalance in resources arises.
    • "The same reading passages were taught to the control group during the same time with the use of conventional teaching." (p. 2437)
    • Relevant Quotes: 1) "The same reading passages were taught to the control group during the same time with the use of conventional teaching. The lecturer did not rely on any of the task-based elements or activities in a group setting and guided understanding, responded to questions, and provided direct explanations in the form of the lecture." (p. 2437) 2) "The students in the control group (N=30) were taught reading comprehension using traditional methods without any homework." (p. 2437) Detailed Analysis: Re-applying the current Criterion B decision procedure: the intervention here is a change in teaching method (task-based activities vs. teacher-led explanation), applied to the same reading passages, during the same weeks and, by implication, the same class time. There is no quote indicating that the experimental group received extra instructional hours, additional materials, or extra budget compared to the control group; both groups appear to have had comparable contact time across the ten-week schedule. Since EXTRA_RESOURCES_PRESENT is false (no additional time or budget is described as being given to the intervention group), the decision tree's first branch applies and the criterion is met without needing to assess whether any extra resource was integral to the treatment. Criterion B is met because no additional time/budget was allocated to the intervention group beyond a different instructional method applied to the same material and schedule.

• Level 3 Criteria

  • R

    Reproduced

    • No independent replication of this specific study by a different research team is reported or was found.
    • Relevant Quotes: No quotes in the paper reference a prior or subsequent replication of this specific study by an independent research team. The references list contains related literature on TBLT and reading comprehension generally, but none describes a direct replication of this study's design and results in a different context. Detailed Analysis: The ERCT standard requires evidence of independent replication, published in a peer-reviewed journal, of this specific study. No such replication is cited in the paper. An internet search (conducted 2026-07-29) for other studies replicating this specific TBLT-vs-traditional-teaching design for main-idea identification among 14-16 year old ESL students in Rahim Yar Khan, Pakistan, did not identify any independent replication by a different research team; this is a small, single-cohort study in a minor regional journal with no citing or replicating literature found. Criterion R is not met because no independent replication of this study was found.
  • A

    All-subject Exams

    • Only reading comprehension was assessed, and since criterion E (standardised exam) is not met, this stronger criterion cannot be met either.
    • Relevant Quotes: 1) "The reading comprehension portions of the pre-test and post-test were followed by multiple-choice, short-answer, and inferential questions." (p. 2437-2438) Detailed Analysis: The study exclusively measured reading comprehension (specifically main-idea identification); no other core subjects (e.g. mathematics, science) were assessed, and no exception rationale for a specialised vocational focus is given. Additionally, per the ERCT standard, since Criterion E (standardised exam) is not met, Criterion A is automatically not met. Criterion A is not met because only one subject (reading) was assessed using a non-standardised instrument.
  • G

    Graduation Tracking

    • There is no follow-up tracking beyond the ten-week study, and since criterion Y is not met, this criterion cannot be met either.
    • "the effects of TBLT were not measured in the long-term" (p. 2441)
    • Relevant Quotes: 1) "Nevertheless, the study had a number of limitations. The intervention was rather short in its duration, and the effects of TBLT were not measured in the long-term." (p. 2441) 2) "To determine the long-term implications of TBLT in terms of age and proficiency levels, longitudinal study is needed." (p. 2442) Detailed Analysis: The authors explicitly acknowledge that no long-term or longitudinal tracking was conducted, and recommend it as future work rather than reporting it. An internet search (conducted 2026-07-29) for subsequent follow-up publications by the same author team (Muhammad Akram, Hina Rasheed, Qasim Ali) tracking this cohort did not identify any such papers. Additionally, per the ERCT standard, since Criterion Y is not met, Criterion G is automatically not met. Criterion G is not met because the study explicitly lacks long-term follow-up, no follow-up publication was found, and Criterion Y is not met.
  • P

    Pre-Registered

    • There is no mention anywhere in the paper of a pre-registered protocol, registry platform, or registration date.
    • Relevant Quotes: No quotes referencing a pre-registration platform (e.g. OSF, ClinicalTrials.gov, ISRCTN), a registration ID, or a registration date appear anywhere in the paper, including the Methodology and References sections. Detailed Analysis: The ERCT standard requires explicit evidence that the study protocol (hypotheses, methods, planned analyses) was pre-registered before data collection began. This paper contains no such statement, and an internet search (conducted 2026-07-29) found no registry entry for this study. Criterion P is not met because no evidence of pre-registration is provided.