Providing Testing Supports to English Learners Taking the ACT

ACT provides supports on the ACT test to US students who are not proficient in English. These supports are designed to improve access and equity for those students whose proficiency in English might prevent them from fully demonstrating the skills and knowledge they have learned in school.

The following supports are available to eligible English learners (ELs):

ACT is committed to evaluating the validity and efficacy of these testing supports. Two recent studies examined the performance, demographics, and high school experiences of ELs who took the ACT with supports between September 2017 and July 2019. Additional details about these analyses can be found in the following reports.

English Learners Research

 

English Learners who Take the ACT with Testing Supports: An Examination of Performance, Demographics, and Contextual Factors (Moore, 2021)

This study was ACT’s first look at the performance of ELs taking the ACT with ACT-approved testing supports. Demographic and contextual factors, along with limited English proficiency, played a substantial role in predicting the performance of ELs taking the ACT. ELs tended to score lower than non-ELs, took fewer core academic courses and fewer honors or AP courses, and had lower high school grades than non-ELs. ELs were more likely to be non-White, from a low income family, and/or a first-generation college student. This study highlights the importance of providing ELs with a rigorous education that includes instruction in both English language and core academic content to ensure that they have equitable opportunities and experiences as compared to their English proficient peers.

 

Score Gains and Validity Evidence for English Learners Testing with Supports on the ACT (Moore, Li, & Lu, 2021)

This study examined score gains for ELs who first tested without supports and retested with supports, as well as investigating technical aspects of test items and test scores of ELs testing with supports. Providing testing supports for ELs was found to have a positive effect on score gains, especially in reading, as well as stronger relationships between ACT scores and high school grades. Psychometric properties of scores for ELs who tested with supports generally supported score validity, with evidence of high classification accuracy, classification consistency, and comparable conditional standard errors of measurement. Some evidence of differential item functioning was found, but approximately half favored ELs and half favored non-ELs, suggesting minimal impact on total scores. Score reliability and standard errors of measurement were both lower for ELs who tested with supports, likely related to differences in score distributions. This study provides evidence that testing supports are providing a benefit to ELs and removing construct-irrelevant variance without conferring an unfair advantage, while pointing to the need for additional research to further examine the impact of the supports on predicting college performance.

 

Reliability of English Learners' Test Scores (Moore, Li, & Lu, 2020)

This technical brief summarized score reliability for ELs and non-ELs across multiple assessments, subject areas, and grade levels, and found that reliability of ELs’ scores is consistently lower than reliability of non-ELs’ scores. Score reliability for ELs taking the ACT was comparable, and in some cases higher than reliability for ELs taking other assessments. Psychometric characteristics of ACT scores of ELs found high classification consistency and no evidence of differential item functioning.

 

Testing Supports for English Learners: A Literature Review and Preliminary ACT Research Findings (Moore, Huang, Huh, Li, & Camara, 2018)

This study examined ACT performance of ELs taking the ACT with state-allowed supports prior to the introduction of ACT-approved supports. ELs were found to have lower ACT scores and lower high school grades than non-ELs, as well as lower correlations between ACT scores and high school grades. Some evidence was found that providing testing supports had a positive effect on ELs’ ACT scores.

 

EL Research Partnership Opportunity

ACT is currently recruiting colleges to submit first-year academic performance data to study relationships between ACT scores and college grades and provide evidence that the testing supports result in scores that can accurately predict ELs’ success in first-year college courses. Find additional information about how to participate in this study.

ACT Leadership Blog

Testing Supports for English Learners Taking the ACT: Improving Access and Performance
By Joann Moore, Senior Research Scientist, August 31, 2021

A recent blog by Joann Moore, senior research scientist at ACT summarized recent research examining performance of ELs taking the ACT with testing supports and highlighted the need for ELs to have access to a rigorous education to prepare them for college and career readiness.