Abstract
Objective. To evaluate whether the score on the Pre-Multistate Pharmacy Jurisprudence Examination (Pre-MPJE) predicts pharmacy students’ performance on the MPJE, and to determine whether demographics, pre-pharmacy school factors, or pharmacy school factors affect MPJE outcomes.
Methods. We performed a retrospective review of pharmacy school graduates’ (N = 156) MPJE scores, Pre-MPJE scores, demographics, pre-pharmacy school academic performance factors, and pharmacy school academic performance factors. Bivariate and correlational analyses were conducted along with multiple linear regression models to determine the influence of variables on the MPJE total scaled score.
Results. A total of 136 pharmacy school graduates were included, with most being female (59%) and non-Hispanic White students (75%). The score on the Pre-MPJE was not significantly correlated with students’ first-attempt MPJE pass-fail outcome or total scaled score. Factors that were correlated with passing the MPJE were a younger age at graduation, a higher pharmacy law course grade, Pharmacy Curriculum Outcomes Assessment (PCOA) examination scores, specifically scaled total scores and scaled scores for content areas 1-4 and final pharmacy school grade point average (GPA). The MPJE total scaled score was correlated with a higher pre–pharmacy school GPA, pharmacy law course grade, PCOA total and content area 1-4 scaled scores, and final pharmacy school GPA. However, regression models found that the greatest variance in MPJE total scaled score was contributed by the pharmacy law course grade. The total scaled score on the PCOA contributed to some variance for all MPJE takers, but only the pharmacy law course grade significantly influenced the in-state MPJE total scaled score.
Conclusion. The findings did not show that the Pre-MPJE score was a predictor for passing the MPJE or for the MPJE total scaled score. The most important determinant of the MPJE total scaled score was a student’s performance in the pharmacy law course.
INTRODUCTION
First-time pass rates for board examinations are key quality metrics for Doctor of Pharmacy (PharmD) programs in the United States. The Accreditation Council for Pharmacy Education (ACPE) requires accredited programs to publish pass rates on the North American Pharmacist Licensure Examination (NAPLEX) for the recent graduating class. 1 However, becoming a licensed pharmacist often also requires passing the Multistate Pharmacy Jurisprudence Examination (MPJE) specific to the jurisdiction the graduate plans to practice in.
In 2020, the National Association of Boards of Pharmacy (NABP), which administers the MPJE with state boards of pharmacy, offered a Pre-MPJE for the first time. The Pre-MPJE is a state-specific practice exam for a candidate to become familiar with the MPJE question format and testing process. The Pre-MPJE consists of 40 questions from prior MPJE exams to be completed within 50 minutes. The candidate receives a scaled score ranging from zero to 100. 2 Comparatively, the MPJE is a 2.5-hour adaptive exam with 120 questions, of which 100 questions are used to calculate the graduate’s results. Before 2021, the minimum passing scaled score was 75 for the MPJE, with a range from zero to 100. 3
The NABP similarly offers the Pre-NAPLEX for self-assessment and familiarization with the NAPLEX exam format. In 2006, Peak and colleagues surveyed graduates regarding tools they used to prepare for the NAPLEX and MPJE. The authors found the Pre-NAPLEX was the most recommended and representative preparatory tool, used by 26.7% of graduates. 4 Chisholm-Burns and colleagues examined the relationship between the Pre-NAPLEX and NAPLEX. Results indicated Pre-NAPLEX scores along with a student’s final pharmacy GPA predicted a positive correlation with NAPLEX total scaled scores. 5 No prior studies have evaluated whether the Pre-MPJE predicts MPJE total scaled scores. Therefore, we aimed to evaluate whether Pre-MPJE scores were correlated with Tennessee MPJE or out-of-state MPJE scores or pass rates and whether certain factors, such as demographics, pre-pharmacy school factors, and pharmacy school factors, influenced MPJE outcomes.
METHODS
This was a retrospective study of the graduating PharmD class of 2020 (N=156) at the University of Tennessee Health Science Center College of Pharmacy. The Pre-MPJE was administered within a licensure preparatory course, whereby the College of Pharmacy provided all graduates a voucher code to take the Tennessee Pre-MPJE during April 17-21, 2020. No Pre-MPJE minimum score was established to pass the preparatory course, and graduates submitted a screenshot of their score. This Pre-MPJE testing period occurred approximately one week before the required half-day College of Pharmacy-sponsored Tennessee law review and was intended as a self-assessment for the MPJE.
Students were asked to sign a release allowing the NABP to provide the College of Pharmacy with their MPJE score. First-time pass rates and total scaled scores for the MPJE were collected for students who took the MPJE between May and December 2020. Data retrieved from student records included demographics (age at graduation, gender, race/ethnicity); composite score on the Pharmacy College Admission Test (PCAT); pre-pharmacy school GPA; pharmacy law course final grade (presented on a grade point average [GPA]-based scale: A=4.0, A−=3.67, B+=3.33, B=3.0, B−=2.67, C+=2.33, C=2.0, C−=1.67, D=1.0 and F=0); final GPA at graduation (final pharmacy GPA); Pharmacy Curriculum Outcomes Assessment (PCOA) total scaled score and scaled scores of its four content areas (area 1: basic biomedical sciences; area 2: pharmaceutical sciences; area 3: social/behavioral/administrative sciences; and area 4: clinical sciences) 6 and history of academic difficulty during the PharmD program. Academic difficulty was defined as earning at least one grade below a C− or a “no pass” in any course. Students who did not take the MPJE during the study period or did not consent to release their MPJE scores to the College of Pharmacy were excluded. The University of Tennessee Health Science Center Institutional Review Board approved this study.
Data analyses were conducted using SPSS Statistics version 26.0 (IBM Corp). Descriptive statistics and frequency counts were performed for demographic variables. The independent samples t test (or Mann-Whitney test, when data were not normally distributed) and chi-square analyses were conducted to compare class of 2020 graduates who took the MPJE to those who did not take the MPJE or were excluded. Comparisons included the following variables: age, gender, race/ethnicity, PCAT composite score, pre-pharmacy school GPA, final pharmacy law grade, PCOA total scaled score, PCOA content area scaled scores, history of academic difficulty, final pharmacy GPA, and Pre-MPJE score.
Among graduates who took the MPJE, a chi-square analysis was conducted to determine differences in the proportion of students passing the MPJE on their first attempt based on gender, race/ethnicity, and history of academic difficulty. An independent samples t test was conducted to assess differences in Pre-MPJE score based on whether students passed the MPJE. Chi-square analysis was conducted to determine differences in the proportion of students passing the MPJE on their first attempt based on subgroups of those who took the Tennessee MPJE compared to those who took an out-of-state MPJE. Correlational analyses (Spearman rho and point biserial) were conducted to assess relationships among the PCAT composite score, pre-pharmacy school GPA, final pharmacy law grade, final pharmacy GPA, PCOA total scaled score, PCOA content area scaled scores, Pre-MPJE score, MPJE total scaled score, and MPJE pass-fail outcome. Cohen conventions were used to interpret the strength of correlations, with .1 indicating a small effect, at least .3 suggesting a medium effect, and at least .5 implying a large effect. 7
In the primary analysis, a multiple linear regression was conducted to determine the influence of the following 10 variables on MPJE scaled score in the total sample: age, gender, race/ethnicity, PCAT composite score, pre–pharmacy school GPA, final pharmacy law grade, PCOA total scaled score, history of academic difficulty, final pharmacy GPA, and Pre-MPJE score. Multiple logistic regression analysis was likewise conducted to determine the influence of the same aforementioned 10 variables on first-attempt MPJE pass-fail outcome in the total sample. Variables were entered in one block simultaneously in the linear regression and logistic regression analyses. To determine the final model (regression equation), nonsignificant variables were removed from the model, and the analysis was repeated. An a priori alpha level of .05 was set for the regression model.
In a secondary analysis, the multiple linear regression described above was replicated, with the exception that the PCOA total scaled score was replaced in the model by the PCOA content area scaled scores. In the secondary analyses, separate multiple linear regression models were tested for two subgroups: those who took the Tennessee MPJE and those who took an out-of-state MPJE. The same variables were included in each model as in the primary analysis. Variables were entered in the model in one block simultaneously. An a priori alpha level was set at .05. A sample size calculation was conducted for the primary analysis, namely the multiple linear regression with 10 predictor variables. Power was set at 80% and significance at .05, with a medium effect type. The sample size needed to achieve power of 80% was 117.
RESULTS
Student characteristics are presented in Table 1. Most were female (59%) and non-Hispanic White (75%) students. Of 156 graduates, 136 (87.2%) took the MPJE during the study period; of the remaining 20 graduates, 13 did not take the MPJE and seven did not consent to release their scores. Among those 136 graduates, 124 (91.2%) passed the MPJE on the first attempt. Additionally, 101 of the 136 took the Tennessee MPJE, while the remaining 35 took an out-of-state MPJE. In comparing the study population of those who took the MPJE and those excluded, the latter group had a significantly lower pharmacy law course final grade (p = .002) and final pharmacy GPA (p=.001).
Demographics and Performance Indicators for Pharmacy Schools Graduates Who Had or Had Not Taken the Multistate Pharmacy Jurisprudence Examinationa
In the chi-square analysis, there were no significant differences in the proportion of students who passed the MPJE on the first attempt based on gender (p=.99), race/ethnicity (p=.12), or history of academic difficulty (p=.11). There was also no difference in the pass rates between those who took the Tennessee MPJE (90.1%) and the out-of-state MPJE (94.3%; p=.45). In the correlational analysis (Table 2), passing the MPJE was significantly associated (p<.05) with age at graduation, pharmacy law course grade, PCOA total scaled score, PCOA content area 1-4 scaled scores, final pharmacy GPA, and MPJE score. The MPJE total scaled score was significantly associated (p<.05) with pre-pharmacy school GPA, pharmacy law course grade, PCOA total scaled score, PCOA content area 1-4 scaled scores, and final pharmacy GPA. The Pre-MPJE score was not significantly correlated with the MPJE total scaled score or passing the MPJE, nor did the Pre-MPJE score significantly differ in an independent sample t test based on whether students passed the MPJE (M=73.99, SD=4.74 vs M=72.33, SD=5.47, respectively; p=.26).
Pre-Pharmacy School Performance Indicators, Pharmacy School Performance Indicators, and First-Attempt Multistate Pharmacy Jurisprudence Examination Outcome (N=136)
In the primary multiple linear regression analysis, pharmacy law course grade and PCOA total scaled score were significantly associated with MPJE score (Table 3). The final model, which included only pharmacy law course grade and PCOA total scaled score, explained 30.3% (adjusted R2=0.303) of the total variance in MPJE total scaled score; specifically, the pharmacy law course grade explained 27.3% (adjusted R2=0.273) of the variance, and PCOA total scaled score explained the remaining 2.5% (adjusted R2=0.025). The final linear regression equation was as follows:
Multiple Linear Regression Model to Determine Value of Demographics, Pre-Pharmacy School Performance Indicators, and Pharmacy School Performance Indicators (Including PCOA Total Scaled Score) as Predictors of MPJE Total Scaled Score in the Class of 2020 (N=136)
In the multiple logistic regression analysis, none of the variables entered into the model was a significant predictor of first-attempt passing or failing of the MPJE.
In the secondary multiple linear regression analysis in which PCOA total scaled score was replaced by PCOA content area scaled scores as independent variables, the pharmacy law course grade and PCOA content area 4 scaled score were significantly associated with MPJE score (Table 4). The final model, which included only pharmacy law course grade and PCOA content area 4 scaled score, explained 31.3% (adjusted R2=0.313) of the total variance in MPJE total scaled score; specifically, the pharmacy law course grade explained 27.3% (adjusted R2=0.273) of the variance, and PCOA content area 4 scaled score explained the remaining 4% (adjusted R2=0.04). The final linear regression equation was as follows:
Multiple Linear Regression Model to Determine the Value of Demographics, Pre-Pharmacy School Performance Indicators, and Pharmacy School Performance Indicators (Including PCOA Content Area Scores) as Predictors of MPJE Total Scaled Score in the Class of 2020 (N=136)
In the secondary multiple linear regression analysis of the Tennessee MPJE subgroup (n=136), only pharmacy law course grade was significantly associated with MPJE total scaled score (Table 5). The final model, which included only pharmacy law course grade, explained 33.4% (adjusted R2=0.334) of the total variance in MPJE score. The final linear regression equation for the Tennessee MPJE subgroup was as follows:
Value of Predictors of Total Scaled Score in Two Subgroups of Pharmacy Students From the Class of 2020 Who Took Either the Tennessee Multistate Pharmacy Jurisprudence Examination (N=101) or an Out-of-State Multistate Pharmacy Jurisprudence Examination (n=35)
In the secondary multiple linear regression analysis of the out-of-state MPJE subgroup, pharmacy law course grade and PCOA total scaled score were significantly associated with MPJE total scaled score (Table 5). The final model, which included pharmacy law course grade and PCOA total scaled score, explained 30.9% (adjusted R2=0.309) of the total variance in MPJE total scaled score; specifically, the pharmacy law course grade explained 24% (adjusted R2=0.24) of the variance, and PCOA total scaled score explained the remaining 6.9% (adjusted R2=0.069). The final linear regression equation for the out-of-state MPJE subgroup was as follows:
DISCUSSION
This is the first study to examine the relationship between the Pre-MPJE score and MPJE performance. Previous research found the Pre-NAPLEX score was a predictor of NAPLEX score, but our analysis did not observe this relationship between the Pre-MPJE and MPJE performance. 5 The factors that had a significant correlation to passing the MPJE and to the MPJE total scaled score were higher final pharmacy GPA, PCOA total scaled scores and scaled scores for content areas 1-4, and pharmacy law course grade; having a younger age at graduation was also significantly correlated with passing the MPJE. In regression models, pharmacy law course grade accounted for much of the variance of the MPJE total scaled score, signaling it was the most important determinant of MPJE score. The PCOA total and content area 4 scaled scores were also found to influence MPJE outcomes, but not as much as the pharmacy law course grade.
The MPJE assesses pharmacy law core competencies involving both federal and state laws and regulations. 8 In contrast to the NAPLEX, few courses in PharmD curricula comprehensively prepare graduates for the MPJE beyond the program’s pharmacy law course. The Pre-MPJE is state specific and includes questions from previous MPJE exams. 2 Theoretically, it could become a popular preparatory tool for the MPJE, similar to the Pre-NAPLEX. 4 A significant relationship was not found between Pre-MPJE score and MPJE total scaled score or the first-attempt MPJE pass-fail outcome in our analysis. An explanation for the lack of a significant relationship between the Pre-MPJE and MPJE may be the sampling and number of questions on the Pre-MPJE. The Pre-MPJE contains 40 questions, or 33% of the questions on the MPJE, whereas the Pre-NAPLEX contains 100 questions. 2, 3, 9 More questions may be needed on the Pre-MPJE for a better preassessment. Additionally, some students may not have taken the self-assessment as intended without incentives nor a specific score requirement. Finally, there is a lack of transparency regarding how questions are chosen for the Pre-MPJE. Using prior questions or testing new questions may not represent current MPJE content. Further analysis of the relationship, or lack thereof, between the Pre-MPJE and MPJE is needed given the cost of taking the Pre-MPJE.
Research remains limited on predictors of MPJE performance. This study found that the pharmacy law course grade was the best indicator of passing the MPJE and the MPJE score. When we examined the impact of the pharmacy law grade on the Tennessee MPJE compared to out-of-state MPJE total scaled scores, the course grade remained significantly associated. Similarly, Mospan and colleagues identified significant correlations between the North Carolina MPJE scores and undergraduate GPA, academic performance (including the pharmacy law course grade), and PCOA performance. 10 However, overall GPA was the strongest correlate, whereas we found that the pharmacy law course grade was a better predictor. While final pharmacy GPA was associated with MPJE score, final pharmacy GPA was not a significant factor in regression models when controlling for other independent factors. Additionally, three published conference abstracts found an association between final pharmacy GPA and MPJE score; however, pharmacy law course performance was not evaluated. 11-13 Mospan and colleagues noted that their two-credit-hour pharmacy law course was delivered in fall of the second professional year and predominantly taught by a practicing pharmacist. 10, 14 At the University of Tennessee Health Science Center College of Pharmacy, the pharmacy law course is three credit hours, delivered in fall of the third professional year, and taught by an attorney. The course covers federal and state law and aligns with the MPJE Core Competencies. 8 It is unknown whether the timing, content, delivery, or instructor of the pharmacy law course impacts MPJE pass rates. A recent review by Rosenberg and colleagues found heterogeneity in law content of 49 PharmD programs, including timing within the curriculum, credit hours, and type of instructor, but they did not evaluate MPJE pass rates. 15 Differences in pharmacy law courses may account for variations between the studies.
The PCOA overall scaled score contributed to some of the variance for the overall MPJE scaled score and out-of-state MPJE scaled score but not for the MPJE Tennessee score. Mospan and colleagues found a positive correlation between MPJE score and PCOA overall score, but they did not examine differences between their state versus out-of-state MPJE performance. 10 Various studies have found PCOA total scores and content area scores to be correlated with the NAPLEX total scaled score, but this is the first study to discover their association with the MPJE total scaled score in regression models. 16-19 A positive correlation was found for MPJE total scaled score and pass-fail outcome with the PCOA content area 1-4 scaled scores; however, only the content area 4 (clinical sciences) score was found to significantly contribute to the variance in the overall MPJE score in the regression model. Mospan and colleagues found significant correlations for the North Carolina MPJE score with PCOA content area 3 and the PCOA law score. 10 We did not examine the PCOA law score because it comprises only five questions of the exam. The PCOA content area 4 comprises 35% of the exam and includes the application of clinical sciences, which may be more similar to the MPJE question format. 6
In our regression analysis, PCOA total scaled score did not significantly influence Tennessee MPJE scores, but it was significant in the out-of-state MPJE scores model. The lack of significance for the PCOA total scaled score on the Tennessee MPJE score highlights the importance of the pharmacy law course in the PharmD curriculum, particularly for students planning to be licensed in the same state. For students testing outside of the state of their PharmD program, both their pharmacy law course and overall PCOA performance influenced MPJE performance, demonstrating the effects of a specialized law course and the ability of students to apply and recall material taught throughout the curriculum.
Unlike past evaluations that assessed predictors of MPJE scores, we also examined predictors of passing the MPJE. In January 2021, the NABP announced that NAPLEX and MPJE results would be reported as pass or fail only, with total scaled score no longer being provided. 20 As a result, schools and colleges of pharmacy will no longer be able to evaluate program-specific predictors related to scaled scores and will need to focus on pass-fail outcomes. Our study found a correlation with passing the MPJE to final pharmacy GPA, pharmacy law course grade, and PCOA total and content area 1-4 scaled scores. However, no significant findings were found in logistic regression analysis.
This study is not without limitations. First, generalizability may be limited, as only students at one state public college of pharmacy were included. Most students took the Tennessee MPJE. Given that the MPJE varies per jurisdiction, programs should examine benefits of the Pre-MPJE for their state. Second, only one year of data was available to evaluate the Pre-MPJE, which limits the sample size. However, the Pre-MPJE was first available in 2020, and MPJE total scaled scores will not be available to programs beginning January 2021. Third, MPJE results were not available for 20 graduates. Lastly, the Pre-MPJE and MPJE were taken during a pandemic, and it is unclear how that may have influenced the findings.
Future directions for research include analyzing factors that predict MPJE pass-fail outcomes, given the change in how MPJE results are reported, and investigating how the timing and instructor credentials of pharmacy law courses affect MPJE outcomes.
CONCLUSION
Based on the experience at one public college of pharmacy, the Pre-MPJE score does not predict performance or passing of the MPJE. Pharmacy law course performance was the most significant contributor to predicting MPJE performance, both for the in-state and out-of-state MPJEs. Given the impact of the pharmacy law course grade on MPJE total scaled score, targeting students who had academic difficulty in the pharmacy law course for MPJE preparation may improve student performance.
ACKNOWLEDGEMENTS
Marie Chisholm-Burns serves on the board of directors for the Accreditation Council of Pharmacy Education (ACPE). This manuscript does not represent ACPE or the boards’ opinions or views.
- Received June 15, 2021.
- Accepted October 15, 2021.
- © 2022 American Association of Colleges of Pharmacy