Development of an APPE Readiness Assessment Plan: Initial Evaluation and Next Steps

Abstract

Objective: Describe the composition of an advanced pharmacy practice experience readiness assessment plan (APPE-RAP) along with initial findings following retrospective application to a cohort of students.

Methods: The APPE-RAP utilizes existing summative assessment data within the ExamSoft platform on six skills and 12 ability-based outcomes from the pre-APPE curriculum. Thresholds were created to sort students into three readiness categories for skills and knowledge, determine overall readiness, and identify need for curricular review. Students that completed the third professional year in Spring 2021 served as the pilot cohort. The APPE-RAP was applied after the cohort progressed to APPEs to analyze appropriateness of categorization and revise the plan before full implementation.

Results: The APPE-RAP was applied to 131 students that progressed to APPEs in Spring 2021. Overall, 87.9% were APPE ready for all skills and aggregate knowledge. Two skills met criteria for curricular review. Seven students (5.3%) were categorized as red on at least one skill after one remediation attempt. Nine students (7%) were categorized as red on aggregate knowledge-based ABO evaluation. Four students (3.1%) did not pass one of their first two experiential rotations. Using a red categorization on aggregate knowledge as a risk indicator identified APPE failure with 94% specificity with a 98% negative predictive value.

Conclusion: Existing assessment data may be leveraged to identify assessment targets to help quantify APPE readiness. Further research is warranted to identify additional assessment thresholds that enhance quantification of APPE readiness as well as the impact of focused remediation on attainment of APPE readiness.