This research study will determine to what degree the AP Physics and AP Calculus assessment frameworks are aligned with the TIMSS Advanced Physics and Mathematics frameworks to expose any differences in content coverage and levels of complexity in order to set the stage for a future performance report comparing AP student performance on TIMSS Advanced. The 2015 administration of TIMSS Advanced provides an opportunity to recognize AP and non-AP students within the TIMSS Advanced sample and investigate the differences in performance.

Objective

This study presents the degree the TIMSS Advanced and AP frameworks align.  This report is also the foundation for a 2016 performance report comparing performance of AP Physics and Calculus students on TIMSS Advanced.  This research will explore how appropriate, from a content and skill alignment perspective, this comparison of AP students is as well as determine the claims that can be made regarding AP student performance on TIMSS Advanced.

Method

External alignment specialists were engaged to rate the alignment of the AP Physics and AP Calculus assessment frameworks to the TIMSS Advanced Assessment Framework. The alignment rating process includes three rating criteria:

1. Categorical concurrence
2. Depth-of-knowledge
3. Range-of-knowledge

Discussion

The alignment study identifies gaps in the content covered by one assessment and highlights differences in the cognitive complexity required to correctly answer items. With this knowledge, we can better understand the functionality of international assessment data, and these findings will provide the foundation for a future performance report which will investigate student performance on TIMSS Advanced and AP assessments.

Aggregate data such as country-level achievement scores are often used to inform decision-making in education reform. Given this, policymakers must be aware of the disconnect between international assessments and the U.S. curriculum. With more information on AP student performance on TIMSS Advanced and the degree of consistency among frameworks, this study allows for greater insight to more informed decisions and curriculum modifications.