Open Conference Systems, ITC 2016 Conference

Font Size: 
POSTER: More Bang for Your Buck: Repurposing Retired Exam Forms to Promote Familiarity with Multiple Choice Assessment
Valerie S Haig, Robert T Furter

Building: Pinnacle
Room: 2F-Harbourside Ballroom
Date: 2016-07-02 11:00 AM – 12:30 PM
Last modified: 2016-05-22

Abstract


The American Board of Pediatrics (ABP) International In-Training Examination (I-ITE) is offered to pediatric residents internationally via the internet. The exam is meant to identify strengths and weaknesses at the trainee and the program level. This multiple choice examination was originally designed for US residents and certificate candidates, and international residents have anecdotally reported less comfort with the multiple choice format. In an effort to minimize the impact of discomfort with the testing modality on international residents’ scores, the ABP will offer a practice test to training programs who have registered for the I-ITE in 2016.

The objective of this project is to offer an avenue by which international students may become more familiar with multiple choice assessment, and attempt to minimize the variance introduced by unfamiliarity with the assessment modality.

Using retired examinations, the ABP constructed a 50 item practice test to be delivered using an online assessment tool (NoviSurvey). Residents will self-report their level of comfort with multiple choice items before and after the practice test, and again following the administration of the I-ITE.

Results for this study will be collected in January, 2016.  Results of interest will be the self-reported level of preparedness for the I-ITE by residents in regard to content and test format, differences in comfort between those who participated in the practice test versus those who did not, and potential performance differences between the two groups.

Based on the findings, recommendations will be made for how organizations administering international assessments can provide better service to test-takers by preparing them for the testing experience. This study fits with the theme of the conference, in that it focuses on a specific challenge faced when domestic assessments transition to international use, and an opportunity by which this challenge may be mitigated at minimal expense to the organization.


An account with this site is required in order to view papers. Click here to create an account.