Abstract
Objective. To develop a framework of the effects of select noncognitive factors (grit, perceived stress, internal locus of control, and select Big Five personality traits) on pharmacy students’ academic performance.
Methods. A survey measuring select noncognitive factors was administered to two cohorts of first professional year (P1) pharmacy students (entering classes of 2019 and 2020, n=374) during fall orientation. Demographics, pre-pharmacy GPA, and P1 fall semester GPA were collected from student records. Structural equation modeling was conducted to assess the proposed framework.
Results. Academic performance was directly influenced by students’ (n=367; 98.1%) perceived stress and neuroticism and indirectly influenced by internal locus of control and neuroticism (via perceived stress as mediator). Neuroticism has a complex relationship in the models as it was directly and positively associated with academic performance, and indirectly contributed to decreased academic performance via a positive association with perceived stress. Squared multiple correlations indicated 13% and 9% of the variance in academic performance in the first final model (academic performance measured by pre-pharmacy GPA and P1 fall GPA) and second final model (academic performance measured by P1 fall GPA), respectively, were explained by the predictor variables.
Conclusion. Evidence provided by structural equation modeling supports the conclusion that select noncognitive factors, namely perceived stress, neuroticism, and internal locus of control, have direct and indirect effects on the academic success of P1 students. The model variances of 9% and 13% represent 36% to 52% of the predictive value of the most accepted cognitive measures used to determine students’ potential for academic success.
INTRODUCTION
Academic success is a major concern for pharmacy students and their families as well as educational institutions. Improved understanding of factors predictive of academic performance is vital to developing strategies and interventions to promote student success. Meagher and colleagues1 noted the cognitive measures of pre-pharmacy grade point average (GPA) and Pharmacy College Admission Test (PCAT) combined explained approximately 25% of the variance in first-year pharmacy (P1) GPA. As Novovic and colleagues2 summarized, although cognitive measures such as GPA and PCAT are “somewhat predictive of success during pharmacy school, they still do not explain the majority of variance observed in student achievement.”
A range of noncognitive attributes, described by Stoffel and Cain3 as “those skills associated with motivation, attitude, and temperament rather than intellect,” exist and may play a role in student performance. Such attributes include (but are not limited to) self-perceptions or constructs, self-control, work and social behaviors (eg, perseverance), attitude or emotion toward a task, and personality traits.4-8 Given this broad scope, a focus on select factors reflective of the diversity of noncognitive attributes is appropriate. Previous studies indicate the select noncognitive factors of grit, locus of control, the Big Five personality traits, and perceived stress may be associated with learning and academic success among health professions students.9-20 For example, studies conducted by Munro,19 Ofori and Charlton,14 and Webb and colleagues20 found higher internal locus of control (or perceptions of control over one’s life) was associated with better academic performance among nursing and medical students. Among 16 studies specifically involving pharmacy students, inconsistent relationships between these noncognitive factors and academic performance were generally noted (Appendix 1).15,17,21-34 For example, Gruenberg and colleagues26 found grit (ie, persistence in and passion for a task/goal) was not associated with either GPA or matching to a postgraduate pharmacy residency program, while other studies found significant associations between increased grit, residency matching, and higher GPA.15,28 Studies of the Big Five personality traits (dimensions of personality defined as agreeableness, conscientiousness, extraversion, neuroticism, and openness) were likewise inconsistent, although inverse associations were noted between academic outcomes and the traits of agreeableness, extraversion, and neuroticism.22,29,33,34 Although less well-studied than in medical students, studies examining perceived or self-reported stress (ie, emotional strain) among pharmacy students were typically consistent with all but two of eight studies reporting increased stress was associated with poorer academic performance.17,21,24,25,27,30-32
Because of the high cost of pharmacy school, risk of attrition and emerging emphasis placed on inclusion of noncognitive skills in the Doctor of Pharmacy (PharmD) curricula, academic leaders must develop a better understanding of these noncognitive factors, their relationship with academic success, and potential strategies to use noncognitive factors to limit student attrition.35 While several studies examined the association between academic success and individual factors, a literature search failed to produce a framework of the relationships among grit, perceived stress, locus of control, select Big Five personality traits, and pharmacy students’ academic performance. Therefore, the purpose of this study was to develop such a framework, as confirmed through structural equation modeling.
METHODS
As most attrition and poor academic performance occur early in the didactic portion of the PharmD curriculum, this study focused on academic success in the fall semester of the first year of pharmacy school.36-39 A survey composed of instruments measuring the noncognitive factors of interest was administered to two cohorts of first professional year (P1) pharmacy students at the University of Tennessee Health Science Center (UTHSC) College of Pharmacy. All P1 students entering in fall 2019 (n=204) and fall 2020 (n=177) were eligible to participate. Survey administration was conducted during first-year fall orientation in 2019 and 2020. The study was approved by the UTHSC Institutional Review Board.
Figure 1 depicts the proposed framework (model) being tested, derived from knowledge gained from previously described studies of the select noncognitive factors influencing academic performance of health professions students. Noncognitive factors included in the proposed model are defined in Table 1.9,40-45 P1 fall GPA and pre-pharmacy GPA were selected as indicators for academic performance for two reasons: pre-pharmacy GPA, based on prerequisite undergraduate coursework primarily comprised of science and math courses, has been demonstrated to play a role in academic success in pharmacy school; and P1 fall GPA, resulting from grades earned for the courses in Appendix 2, is a measure of early pharmacy school performance.1,38,46-49 Based on the pervasive underlying influence of perceived stress on individuals’ daily lives, in the proposed model we hypothesize perceived stress mediates the effects of grit, locus of control, and the select Big Five personality traits on academic performance (mediation is defined by Hopwood50 as “a case in which a third variable is a pathway for the effect of a predictor on an outcome”).51
Proposed model of the relationships among select noncognitive factors and academic performance. The figure displays the proposed model of relationships among academic performance (as indicated by pre-pharmacy grade point average [GPA] and first-year fall GPA) and the noncognitive factors of grit, internal locus of control (LOC), and select Big Five Personality Traits (agreeableness, extraversion, and neuroticism), as mediated by perceived stress. Hypothesized associations (relationships) among the independent variables are represented by bidirectional arrows, and relationships among the independent variables (noncognitive factors) and dependent variable (academic performance) are represented by unidirectional arrows.
To test the proposed model, valid and reliable instruments previously used in pharmacy and other health professions student populations were selected to measure the select noncognitive factors.15,17,25,31,52 Cronbach alphas were calculated to determine the internal consistency (reliability) of the instruments. Cronbach alpha of .7 or greater is considered acceptable, with at least .5 considered “minimally adequate.”53,54 Other data were collected from student records, including demographics (gender and race/ethnicity), pre-pharmacy GPA, and P1 fall GPA, and entered in a study database. A cross-check for accuracy was conducted of a random sample of data entered into the database as a quality control measure.
The eight-item Short Grit Scale (Grit-S) uses a five-point Likert scale to assess level of response to each item, ranging from 1=“not like me at all” to 5=“very much like me” (note: the total Grit-S, rather than its two subscales, was the focus of this study).55 The Grit-S includes reverse-scored items in which the wording of these four items was in the opposite direction of the wording of the remaining four items (ie, negatively worded [less grit] vs positively worded [more grit], respectively). Scores of these four items are “reversed” to be consistent with the directionality of the remaining four items, for example, a score of 1 is changed to 5. The eight item scores are averaged and total scores range from 1 to 5, with higher scores indicating greater grit. Prior studies reported Cronbach alpha values for the Grit-S of .73 to .83 in student populations, including pharmacy students.15,55,56
The Perceived Stress Scale-10 (PSS-10) is a shortened, validated version of the original Perceived Stress Scale and includes 10 items scored using a Likert scale ranging from 0=never to 4=very often.57,58 Four items are reverse-scored. Total scores range from 0 to 40, with higher scores indicating greater perceived stress. Spivey and colleagues reported Cronbach alpha values of .83, .87, and .89 in administrations of the PSS-10 to P1 students.31
The Big Five Inventory (BFI) is a measure of five personality traits: extroversion, agreeableness, conscientiousness, neuroticism, and openness (note, conscientiousness and openness subscale scores were not used in this analysis to be parsimonious as there is a lack of evidence concerning their relationships to academic performance among pharmacy students).9,59,60 The BFI includes 44 items scored on a 5-point Likert scale ranging from 1=disagree strongly to 5=agree strongly. Scores were calculated for each subscale/personality trait, with multiple reverse-scored items. Total scores range from 1 to 5, with higher scores indicating greater preference for a given trait. The agreeableness subscale is comprised of nine items, and the extraversion and neuroticism subscales are each comprised of eight items. John and colleagues60 reported Cronbach alpha values of these three subscales ranging from .79 to .87.
The brief version of Levenson’s Locus of Control Scale was used because it attempted to address shortcomings in other versions of commonly used locus of control scales.54 Although this scale includes three subscales, this study focused on the Internal Locus of Control subscale based on existing literature among health professions students, suggesting an association between greater internal locus of control and better academic performance.14,19,20 Items were scored using a Likert scale ranging from 1=disagree strongly to 5=agree strongly. Total scores range from 3 to 15. Higher scores indicate the individual strongly believes he or she is in control of their own experiences, while lower scores indicate the individual does not tend to believe he or she is in control of their own experiences. Sapp and Harrod54 reported a Cronbach alpha value of .59 for Internal Locus of Control.
Statistical Analysis
Data analysis was performed using IBM SPSS Statistics 26.0 and IBM SPSS AMOS 26. Descriptive statistics were calculated to summarize student characteristics, noncognitive factor scores, and GPAs. Mann-Whitney U tests were performed to determine if significant differences exist between demographic groups (eg, female vs male, non-Hispanic White vs minority) based on noncognitive factor scores, pre-pharmacy GPA, and P1 fall GPA. As a total of 16 Mann-Whitney U tests were performed, the Bonferroni adjustment was used (.05 divided by 16), resulting in an alpha level of .003.
Structural equation modeling (SEM) was conducted to test and confirm the findings of the proposed model (Figure 1). A power analysis (sample size calculation) was conducted using the following parameters: anticipated effect size of .5, desired power level of .8, probability (alpha) level of .05, seven latent variables (noncognitive factors and academic performance), and 48 observed variables (including items which compose the various noncognitive scales, pre-pharmacy GPA, and P1 fall GPA).61,62 Minimum sample size required was 366. In the first step of the SEM, bias-corrected bootstrapping was used to test for mediation, as a full mediation model (Figure 1) was hypothesized by investigators.63-65 The number of bootstrap samples was set at 5000 and the bias-corrected confidence interval was set at 95%.65 Bias-corrected bootstrapping assesses the statistical significance of both the direct effect of the relationship between the given noncognitive factor (grit, internal locus of control, agreeableness, extraversion, neuroticism) and academic performance, as well as the indirect effect of the relationship between the given noncognitive factor and academic performance as mediated by perceived stress. Following mediation testing, a model generating scenario was used in step two of the SEM in which the proposed model (referred to as Model One) was tested for goodness of fit.66,67 As needed, the model was modified and re-estimated “to determine a model that better describes the sample data.”66 A second model (referred to as Model Two) in which P1 fall GPA was the sole indicator of academic performance was also tested to determine consistency and fit of the model when pharmacy school performance alone was considered. To address missing data, the regression imputation method within AMOS was used. The following model fit indices are indicative of good fit: chi square to degrees of freedom ratio (CMIN/DF) less than 2 (between 2 and 3 is considered adequate); comparative fit index (CFI) greater than 0.95; standardized root mean square residual (SRMR) less than .05; and root mean square error of approximation (RMSEA) less than .05.66,68,69 An alpha level of .05 was used to determine statistical significance.
RESULTS
Among 381 students in the entering classes of 2019 and 2020, seven withdrew prior to the end of the P1 fall semester and were excluded from the study (students remaining in the 2019 class, n=200, and in the 2020 class, n=174). Of note, 43% of the seven students who withdrew were male, with mean age of 22 years (SD=3.73 years). Six of the seven students completed the survey instruments and did not significantly differ from study participants on pre-pharmacy GPA or noncognitive scale scores. Of the 200 remaining students in the entering class of 2019, 193 (96.5%) participated in the study, while all 174 (100%) remaining students in the entering class of 2020 participated, for a total of 367 participants (resulting in a 98.1% overall response rate). The majority of participants were female (n=238 [64.9%]) and non-Hispanic White (n=214 [58.3%]). Mean and median GPAs and noncognitive factor scale scores as well as Cronbach alpha values for each scale are presented in Table 2.
Summary of Data in a Study to Determine Effects of Select Noncognitive Factors on Pharmacy Students’ Academic Performance
Significant differences (p=.001) in pre-pharmacy GPA were found between non-Hispanic White students (M=3.42, SD=0.39, Median=3.46) and minority students (M=3.29, SD=0.36, Median=3.29). Significant differences (p<.001) in P1 fall GPA were also found between non-Hispanic White students (M=3.37, SD=0.52, Median=3.46) and minority students (M=3.12, SD=0.57, Median=3.18). No significant differences in noncognitive scale scores were found based on race/ethnicity. Female students had significantly (p<.001) higher scores than male students on the following BFI subscales: agreeableness (female students, M=4.36, SD=0.48, median=4.44; male students, M=4.12, SD=0.6, Median=4.24); and neuroticism (female students, M=2.9, SD=0.69, Median=2.88; male students, M=2.55, SD=0.8, Median=2.5). No other significant differences were found based on gender.
Mediation testing of the proposed model (Figure 1) supported that relationships between academic performance and grit, internal locus of control, agreeableness, and extraversion were fully mediated by perceived stress. However, the relationship between neuroticism and academic performance was partially mediated, meaning there was evidence of a direct relationship between the two variables and an indirect relationship mediated by perceived stress. The proposed model was revised to reflect this.
Goodness of fit testing of the full Model One, in which academic performance was indicated by pre-pharmacy GPA and P1 fall GPA, found that model fit was less than acceptable, with CFI of .75 and SRMR of .08 (although RMSEA and CMIN/DF were acceptable at .06 and 2.34, respectively). To improve fit, the model was modified as follows: grit, agreeableness, and extraversion were removed because they were not significantly associated with perceived stress in the full model (p>.05). Goodness of fit indices of the modified Model 1 (Figure 2) indicated acceptable to good fit: CMIN/DF of 1.82, CFI of .93, SRMR of .05, and RMSEA of .05. Squared multiple correlation of .13 indicated 13.4% of the variance in academic performance was explained by the predictor variables in the model. The standardized regression weight estimates are displayed in Figure 2, and unstandardized regression weight estimates are presented in Table 3.
Modified Model 1 and Model 2 of the relationships among select noncognitive factors and academic performance. Modified Model 1, in which academic performance was indicated by pre-pharmacy GPA and P1 fall GPA, illustrates the standardized regression weight estimates as well as the correlation between internal locus of control (LOC) and neuroticism. Modified Model 2, in which academic performance was indicated by P1 fall GPA only, illustrates the standardized regression weight estimates, as well as the correlation between internal LOC and neuroticism. GPA, grade point average. *p<.05
Findings of Structural Equation Modeling Analyses of Modified Models One and Two Performed to Assess the Relationships Among Noncognitive Factors and Academic Performancea
In Model 2, in which academic performance was indicated by P1 fall GPA only, fit of the full model was less than acceptable, with CFI of .75 and SRMR of .08 (although RMSEA and CMIN/DF were acceptable at .06 and 2.39, respectively). Similar to Model 1, to improve fit, Model 2 was modified as follows: grit, agreeableness, and extraversion were removed because they were not significantly associated with perceived stress in the full model (p>.05). Goodness of fit indices of the modified Model 2 (Figure 2) indicated acceptable to good fit: CMIN/DF of 1.97, CFI of .92, SRMR of .05, and RMSEA of .05. Squared multiple correlation of .09 indicated 9% of the variance in academic performance was explained by the predictor variables in Model 2. The standardized regression weight estimates are displayed in Figure 2, and unstandardized regression weights are presented in Table 3.
DISCUSSION
The current study is the first to examine a structural equation model of the associations among the selected noncognitive factors and P1 students’ academic performance. The final models reveal interesting relationships among the variables. First, the models demonstrate the influence of perceived stress on academic performance, indicating higher perceived stress contributes to poorer performance or vice versa (Figure 2), which is consistent with prior studies.17,24,25,27,31,32 Perceived stress is therefore a critical target for intervention to support student success. In a systematic review of interventions to decrease perceived stress among graduate students, Stillwell and colleagues70 found evidence that several strategies (often used in combination) were effective in reducing perceived stress, including training on relaxation skills, breathing and body awareness techniques, time management, mindfulness, meditation, yoga, mindful eating, and controlling negative or irrational thoughts. Such interventions may be of benefit to pharmacy students, and future studies should consider implementation and evaluation of stress management strategies, including effects on academic performance, in this population.
The second interesting finding was that students’ internal locus of control indirectly influenced their academic performance via a mediated relationship with perceived stress. Internal locus of control decreased as perceived stress increased (or vice versa); in turn, as perceived stress increased, academic performance decreased (or vice versa). Thus, lower internal locus of control indirectly contributed to poorer academic performance, and likewise higher internal locus of control indirectly contributed to better academic performance. This is consistent with previous studies of the association between internal locus of control and academic performance.14,19,20 Prior studies suggest several strategies that may be used among pharmacy students to improve internal locus of control, which may ultimately reduce stress and/or benefit academic performance.71-73 These strategies include problem-based education to encourage problem-solving and self-directed learning; online videos discussing locus of control and growth mindset and how they may be utilized by students during their education; and mentoring programs to build supportive and nurturing connections.71-73 For example, Demir and colleagues71 found that a peer mentoring program in which fourth-year nursing students served as mentors for first-year nursing students contributed to increased internal locus of control and improved ability to cope with stress among the first-year students.
The third interesting finding was that neuroticism both directly and indirectly effected students’ academic performance in the final models. Pertaining to the direct effect, neuroticism was positively associated with academic performance, meaning as neuroticism increased, academic performance increased (or vice versa). Neuroticism also indirectly influenced academic performance via perceived stress as the mediator. To explain further, neuroticism and perceived stress were positively associated, and perceived stress and academic performance were inversely associated. This means higher neuroticism indirectly contributed to decreased academic performance via increased perceived stress (or vice versa). Prior studies of neuroticism in pharmacy students are limited and do not shed much light on the complex relationship with academic performance suggested in this study.22,34 In their study of personality traits and academic performance among medical students, Lourinho and colleagues74 found that neuroticism was positively associated (p=.014) with achievement, and suggested, “the anxiety component of neuroticism due to its anticipatory ability can have facilitated performance in … individuals who may have strategically channeled the negative affect to promote high levels of preparation, competitiveness, and striving to attain a better position.” However, Lourinho and colleagues74 also caution that high levels of neuroticism may cause greater stress and burnout among health professions students. Therefore, we postulate a certain amount of anxiety (neuroticism) may be motivating for students, but if that neuroticism becomes overwhelmingly stressful, then academic performance can be negatively impacted. This phenomenon may suggest a healthy and delicate balance of neuroticism and stress is needed for optimal academic performance. To assist in achieving this healthy balance, previous studies suggest mindfulness training may have protective effects for students who score highly on neuroticism.75,76 Mentioned earlier as a possible intervention to reduce perceived stress, mindfulness training focuses on improving emotional awareness and developing skills related to emotional regulation and therefore may assist students in managing anxiety and emotional distress during pharmacy school. Future studies should thus consider the potential role of mindfulness training as a support strategy for pharmacy students.
Among the current study’s additional findings, no significant differences in noncognitive factor scores were found based on race/ethnicity, although non-Hispanic White students had significantly higher pre-pharmacy GPA and P1 fall GPA. Previous studies are not consistent regarding the relationship between race/ethnicity, pre-pharmacy GPA, and pharmacy school GPA.77,78Additionally, female compared to male students had significantly higher scores on agreeableness and neuroticism, which is consistent with prior studies of gender differences on the Big Five personality traits.79,80 Given these findings, future studies should consider how the final models function when race/ethnicity and gender are introduced.
Like all studies, this study has both strengths and limitations. Strengths include a high response rate (greater than 98%) and the desired sample size indicated in the power analysis, supporting the robustness of the data and analysis, as well as a sample generally representative of the national PharmD student population in terms of gender and race and ethnicity.81 However, as noncognitive data were self-reported, response bias may have occurred in which participants provided answers they believed were preferred by investigators, selected the neutral answer option for all or most scale items, or “agreed” or “disagreed” with all or most scale items.82 To minimize response bias, participants were assured of confidentiality and provided ample time to read and complete the survey instrument. Additionally, the noncognitive instruments included reverse-scored items that might facilitate greater consideration of the item (because of differences from other items) and disrupt any biased patterns in responses. Another limitation includes the timing of the survey. Survey data were collected during orientation, prior to the start of classes. It is unknown if noncognitive factors may have changed throughout the semester. However, a better understanding of these factors, as measured at a baseline point such as pharmacy school orientation, may be helpful in developing early targeted programming to support student success.
At first glance, the variances reported in the final models may not seem impressive or impactful. However, prior studies have found that standard cognitive measures, such as prior GPA and standardized tests, only predict approximately 25% of the variance in pharmacy school GPA.1 In that context, these model variances of 9% and 13% represent 36% to 52% of the predictive value of the most accepted cognitive measures used to assess potential future academic performance. Although a notable portion of the variance in academic performance was explained by the final models, a large percentage remains unexplained, suggesting there are other factors at play in determining student success. Nevertheless, this study represents a critical first step in exploring the effects of perceived stress, grit, internal locus of control, agreeableness, extraversion, and neuroticism on academic performance.
CONCLUSION
The evidence supports how a framework (structural model) of select noncognitive factors, namely perceived stress, neuroticism, and internal locus of control, affects the academic performance of first-year pharmacy students. Application of this knowledge may be beneficial to pharmacy schools during the admissions process, in monitoring academic performance, and when developing and implementing programming to support pharmacy student success.
ACKNOWLEDGMENTS
Marie Chisholm-Burns serves on the board of directors for the Accreditation Council of Pharmacy Education (ACPE). This manuscript does not represent ACPE or the boards’ opinions or views.
Appendix
Studies of the Relationships Between Select Noncognitive Factors and Academic Outcomes in Pharmacy Students (N=16)a
Appendix
First-year Fall Semester Courses of the Doctor of Pharmacy Program
- Received February 19, 2021.
- Accepted May 21, 2021.
- © 2021 American Association of Colleges of Pharmacy
REFERENCES
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.↵
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.↵
- 15.↵
- 16.↵
- 17.↵
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.↵
- 38.↵
- 39.↵
- 40.↵
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.↵
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.↵
- 61.↵
- 62.↵
- 63.↵
- 64.
- 65.↵
- 66.↵
- 67.↵
- 68.↵
- 69.↵
- 70.↵
- 71.↵
- 72.
- 73.↵
- 74.↵
- 75.↵
- 76.↵
- 77.↵
- 78.↵
- 79.↵
- 80.↵
- 81.↵
- 82.↵