Additional Technical Documentation

Document

Description

Smarter Balanced cognitive labs, conducted in collaboration with the American Institutes for Research (AIR) in fall 2013, consisted of 14 small think-aloud studies that addressed topics pertaining to an automated test delivery system. The studies were designed to determine how effective various technology enhanced item types are in assessing the cognitive processes indicated within the Smarter Balanced Content Specifications.

Prior to test administration in 2014-2015, the American Institutes for Research (AIR) conducted simulations to evaluate and ensure the implementation and quality of the adaptive item-selection algorithm and the scoring algorithm.

This report describes a study simulating the adaptive administration of the Smarter Balanced summative assessments. The study was conducted in order to examine properties of the simulated tests (such as blueprint fulfillment and item exposure) and the quality of the examinee score estimates (including bias and precision). The simulated tests included both the computerized adaptive test (CAT) and performance task (PT) components, thus mimicking the operational summative tests.

This report describes the procedures used in obtaining parameter estimates for items appearing on the 2014-2015 Smarter Balanced Assessment Consortium summative paper-pencil forms.

The goal of this study was to gather comprehensive evidence about the alignment of the Smarter Balanced summative assessments to the Common Core State Standards (CCSS). The alignment analysis included the range of content, the balance of content, and the cognitive complexity. To determine these facets of alignment, HumRRO conducted a series of workshops during which participants reviewed the alignment among the Smarter Balanced content and item specifications, the Smarter Balanced blueprint, and the Common Core State Standards.

Achievement Level Setting Final Report

2015

Achievement level setting for Smarter Balanced assessments in Mathematics and English/Language Arts and Literacy occurred in three phases: online panel, in-person workshop, and cross-grade review. This report documents each of the three phases and provides results and recommendations for cut scores for Smarter Balanced Assessments to be given in the spring of 2015.

The Smarter Balanced Assessment Consortium held an Achievement Level Descriptor (ALD) Writing Workshop in October 2012 to draft an initial set of ALDs and to review and comment on a College Content-Readiness policy. The panel developed a set of Policy ALDs, Range ALDs, and Threshold ALDs for English language arts and mathematics and provided valuable feedback on the Smarter Balanced College Content-Readiness Policy.

This report informs Smarter Balanced of research that should be done to evaluate the degree to which the Consortium is accomplishing its goals and to demonstrate that the assessment system adheres to professional and federal guidelines for fair and high-quality assessment.

Smarter Balanced Assessment Consortium application for the Race to the Top Assessment program. The US Department of Education awarded a grant to the Consortium on September 28, 2010.

This report describes a study simulating the adaptive administration of the Smarter Balanced summative assessments using the accommodated item pools utilized during the 2014–15 school year.

This report provides a summary regarding the interruptions to online testing that occurred during the spring 2015 administration of the Smarter Balanced assessments in Montana, Nevada, and North Dakota.

This report describes a study by CRESST, simulating the adaptive administration of the Smarter Balanced summative assessments using the general and accommodated item pools utilized during the 2016-2017 school year. The study was conducted to examine properties of the simulated tests (such as blueprint fulfillment and item exposure) and the quality of the resulting examinee score estimates (including bias and precision).

This report summarizes AIR’s simulation results of the 2016-2017 adaptive administrations in grades 3–8, and 11 for ELA/L in English and Braille, and mathematics in English, Braille, and Spanish.