A. Research and Evidence-Based Practices

Research and evidence-based practices are foundational to providing effective adult education services. As defined in Title 34 of the Code of Federal Regulations, evidence-based practices in education can be divided into those that have: evidence of promise, moderate evidence of effectiveness, and strong evidence of effectiveness. Per 34 CFR § 70.1, these different categories are defined as follows:

Evidence of promise means there is empirical evidence to support the theoretical linkage(s) between at least one critical component and at least one relevant outcome presented in the logic model for the proposed process, product, strategy, or practice. Specifically, evidence of promise means the conditions in both paragraphs (i) and (ii) of this definition are met:

(i) There is at least one study that is a—

(A) Correlational study with statistical controls for selection bias;

(B) Quasi-experimental design study that meets the What Works Clearinghouse Evidence Standards with reservations; or

(C) Randomized controlled trial that meets the What Works Clearinghouse Evidence Standards with or without reservations.

(ii) The study referenced in paragraph (i) of this definition found a statistically significant or substantively important (defined as a difference of 0.25 standard deviations or larger) favorable association between at least one critical component and one relevant outcome presented in the logic model for the proposed process, product, strategy, or practice.

Moderate evidence of effectiveness means one of the following conditions is met:

(i) There is at least one study of the effectiveness of the process, product, strategy, or practice being proposed that meets the What Works Clearinghouse Evidence Standards without reservations, found a statistically significant favorable impact on a relevant outcome (with no statistically significant and overriding unfavorable impacts on that outcome for relevant populations in the study or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), and includes a sample that overlaps with the populations or settings proposed to receive the process, product, strategy, or practice.

(ii) There is at least one study of the effectiveness of the process, product, strategy, or practice being proposed that meets the What Works Clearinghouse Evidence Standards with reservations, found a statistically significant favorable impact on a relevant outcome (with no statistically significant and overriding unfavorable impacts on that outcome for relevant populations in the study or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), includes a sample that overlaps with the populations or settings proposed to receive the process, product, strategy, or practice, and includes a large sample and a multi-site sample.

Note: Multiple studies can cumulatively meet the large and multi-site sample requirements as long as each study meets the other requirements in this paragraph.

Strong evidence of effectiveness means one of the following conditions is met:

(i) There is at least one study of the effectiveness of the process, product, strategy, or practice being proposed that meets the What Works Clearinghouse Evidence Standards without reservations, found a statistically significant favorable impact on a relevant outcome (with no statistically significant and overriding unfavorable impacts on that outcome for relevant populations in the study or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), includes a sample that overlaps with the populations and settings proposed to receive the process, product, strategy, or practice, and includes a large sample and a multi-site sample.

Note: Multiple studies can cumulatively meet the large and multi-site sample requirements as long as each study meets the other requirements in this paragraph.

(ii) There are at least two studies of the effectiveness of the process, product, strategy, or practice being proposed, each of which: Meets the What Works Clearinghouse Evidence Standards with reservations, found a statistically significant favorable impact on a relevant outcome (with no statistically significant and overriding unfavorable impacts on that outcome for relevant populations in the studies or in other studies of the intervention reviewed by and reported on by the What Works Clearinghouse), includes a sample that overlaps with the populations and settings proposed to receive the process, product, strategy, or practice, and includes a large sample and a multi-site sample.

Because research and evidence-based practices are integral to providing effective services, grantees are expected to engage in the implementation and improvement of these practices at the local program level. This includes, but is not limited to: student support and persistence strategies; comprehensive and additional services; the College and Career Readiness Standards; and English Language Proficiency standards. Information regarding some research and evidence-based practices can be found at the What Works Clearinghouse which contains information pertaining to education generally, as well as the LINCS Resource Collection which contains information specific to practices in adult education.