Abstract
Objective. To evaluate student pharmacists’ knowledge of diabetes and self-perceptions of aptitude and confidence before and after teaching a diabetes self-management education and support (DSMES) class.
Methods. Students enrolled in an advanced pharmacy practice experience (APPE) in ambulatory care were randomly assigned to the intervention group (taught a DSMES class) or control group (did not teach a DSMES class) between June 2016 to April 2018. Students self-assessed their aptitude and confidence using a 14-item pre- and post-intervention survey instrument. Additionally, participants completed a 10-item diabetes knowledge evaluation at baseline and during week three or four of the APPE.
Results. Forty-six students participated in the study (26 students in the intervention group and 20 in the control group). Students in the intervention cohort demonstrated a significant improvement in their knowledge score (81.8% post-intervention vs 68.4% pre-intervention). Students in the control cohort did not experience a significant change in knowledge scores from pre- to post-intervention evaluation (70.0% vs 74.1%). The intervention cohort achieved a significantly greater improvement in confidence scores compared to the control group (11.8 vs 6.7 increase in scores, respectively).
Conclusion. A student pharmacist team-taught DSMES class resulted in significant improvement in diabetes knowledge, aptitude, and confidence. Student pharmacist participation in a DSMES class may improve knowledge and enhance confidence, while offering an opportunity to advance the pharmacy practice model in ambulatory care.
INTRODUCTION
Pharmacy as a profession today is striving towards attainment of provider status, as the services that pharmacists can provide have expanded well beyond the role of dispensing medications.1 Therefore, there is a clear need within schools and colleges of pharmacy to train confident and competent future practitioners to take the lead in providing novel patient care services. Such services often involve direct interaction with patients as well as providing consultative and educational services to patients as part of the interdisciplinary team.2 Furthermore, the Accreditation Council for Pharmacy Education (ACPE) Standards 2016 supports the development of clinical knowledge and incorporation of experiences with a “patient care emphasis” within advanced pharmacy practice experiences (APPEs).3
There are 30.3 million people living with diabetes in the United States.4 Patients with diabetes benefit from pharmacy-provided information to improve their disease state control and health outcomes. The American Diabetes Association’s (ADA’s) Standards of Medical Care in Diabetes 2019 guidelines cites diabetes self-management education and support (DSMES) as a key element of diabetes management. The guideline recommends that health care professionals be involved in providing patient-centered DSMES to all patients living with diabetes.5 Additionally, the ADA guidelines endorse pharmacists as an integral provider of DSMES.
Students within Mercer University College of Pharmacy traditionally complete their diabetes coursework within the Endocrinology module during their third professional year, as well as in the first-year Clinical Skills and Simulation Laboratory. Additionally, students have the opportunity to participate in a diabetes elective during their third-professional year. Fourth-year students completing a traditional five-week faculty-precepted ambulatory care APPE receive a diabetes topic discussion during week one of the APPE block and are heavily engaged in patient/provider interactions involving patients with diabetes throughout the remainder of the rotation. Although there are ample opportunities for students to provide education in a one-on-one setting during the APPEs for the study site, no experiences are currently provided that are focused on educational teaching and facilitation in the small group format. On average, students are involved in the care of 15-30 patients with diabetes per month, during which they deliver direct patient education. Teaching the DSMES class (intervention in this study) allowed student pharmacists to actively apply their knowledge of diabetes and communication skills previously gained within the classroom and introductory experiential settings in a small-group classroom setting with actual patients. Additional practice providing patient education potentially enhances student ability and confidence in providing DSMES.
To successfully teach a patient, a health care provider must first become knowledgeable and proficient in the topic themselves.6 There is evidence that a variety of educational experiences (eg, certificate programs, elective courses, APPE “patient navigator” training, diabetes-focused APPEs) can positively impact a student pharmacist’s knowledge, attitudes, and/or skills associated with diabetes or other chronic conditions.6-16 However, we found only one study that evaluated students confidence with diabetes knowledge and education after teaching a DSMES class.6 While that study, which was conducted by Shrader and colleagues, was similar in design to ours, it involved third-year pharmacy students within an elective service-learning course rather than fourth-year APPE students. Additionally, the study did not include a control group or a comprehensive measure of change in student knowledge (only one question involving perceived confidence in knowledge was assessed). Therefore, we concluded that additional investigation was warranted involving hard measures of student knowledge as a result of facilitating a DSMES class.
This study involved the implementation of a DSMES class taught by fourth-year student pharmacists to provide education to patients of Wellstar Atlanta Medical Center outpatient clinics living with diabetes. The purpose of this study was to implement a student-led DSMES class and assess: student knowledge of diabetes before and after teaching the class, and student self-perceptions of aptitude and confidence before and after teaching the class. The researchers hypothesized that students who had the additional experience of teaching a DSMES class during their APPE would gain greater knowledge, abilities, and confidence compared to students completing traditional rotation activities.
METHODS
Students assigned to the ambulatory care APPE between June 2016 to April 2018 at the Wellstar Atlanta Medical Center outpatient clinic where the investigators served as clinical faculty members were included in this study. The student pharmacists were randomized to a control group (traditional APPE activities) or intervention group (traditional APPE activities plus student-led DSMES class) according to their assigned rotation block. The assignment to the control or intervention group was done in an alternating fashion to ensure equal distribution of groups throughout the year. One to two APPE students taught a single DSMES class during their APPE, with a total of 15 classes taught from August 2016 through April 2018. Classes were held during weeks three or four of the APPE. Approximately three to five patients were invited to attend each DSMES class. Patients were referred to the class by the student(s) who saw them during a scheduled visit or by other clinicians. Diabetes self-management education and support classes were taught at a large metropolitan academic medical center within an internal medicine clinic.
The DSMES class was conducted in-person and lasted approximately two hours. Each class used the US Diabetes Conversations Map Kit (Healthy Interactions), which is endorsed by the ADA.7 The US Diabetes Conversations Map is an interactive educational program with tools (ie, a large colorful map board, patient question cards, conversation cards, and action plan/goal setting worksheets) that are used to direct patient-practitioner conversations in small groups of three to 10 participants. This map had been successfully used by other student pharmacists to deliver a DSMES class for patients.6 Prior to the study, the investigators completed the training required to be approved facilitators for the course. For the purposes of this study, the “On the Road to Better Managing Your Diabetes” map, which provides a general overview of diabetes, was used in the student-led DSMES class.
Students in the intervention group of the study were introduced to the US Diabetes Conversations Map Kit following their traditional diabetes topic discussion. Students were provided with the relevant class materials (ie, the Conversations Map) as well as information on the benefits of DSMES. Students were asked to prepare for the teaching of the class on their own time. Approximately one to two hours were required for group preparation among the students. One hour prior to the scheduled class, the clinical faculty members hosted an “on-time training” session for the students in which student questions were answered, the delivery process was outlined, and final instructions were provided. Class set-up also took place during that time. The class then began, and for the next two hours, students led discussion and answered patient questions in accordance with the US Diabetes Conversations Map Program. During the class, clinical faculty study investigators were available to clarify points of student uncertainty or omission. After each class, surveys were completed as described below.
Demographic data (ie, age, gender, race, history of taking a diabetes elective, and pharmacy work experience including practice setting) were collected for all students in the study. Students in both groups completed a 10-question assessment to evaluate their knowledge of diabetes (Table 2). The knowledge assessment was developed to cover the main learning objectives of the DSMES class, including the pathophysiology of diabetes, dietary restrictions around diabetes, ADA guidelines for blood glucose levels, signs and symptoms of hyperglycemia and hypoglycemia, and nutrition support and physical activity guidelines for persons with diabetes. The questions were graded using a rubric on which the correct answers and the number of points assigned to each question were specified. Each question was worth 10 points: three questions had a single correct/incorrect response, five questions had a two-part response (each part was worth five points), and two questions had a three-part response (each part was worth three and one-third points). To ensure grading consistency, the same investigator graded all assessments, with a second lead investigator reviewing the grading for quality assurance.
Along with the knowledge assessment, a 14-item aptitude/confidence questionnaire was administered. Respondents were asked to self-rank their perceived aptitude/confidence using a four-point scale that ranged from 4=strongly agree to 1=strongly disagree. Aptitude/confidence questions were created based on concepts emphasized in the “On the Road to Better Managing Your Diabetes” map and literature review.6,7,12,13 Each question addressed a learning objective and also correlated with a knowledge survey question. For example, one knowledge question asked students about the amount of physical activity recommended for patients with type 2 diabetes, while the matching aptitude/confidence question asked respondents about their “confidence in [their] ability to counsel a patient with type 2 diabetes on physical activity.”
The pre-intervention surveys (knowledge and aptitude/confidence) were administered to both the control and intervention groups during the first week of the APPE, prior to patient care experience and before completing a diabetes topic discussion. Both post-intervention surveys were administered during week three or four of the five-week rotation. Students in the intervention cohort completed post-intervention surveys immediately after teaching the group education class; students in the control group completed the post-intervention surveys at a similar time as students in the intervention group. Students were provided with an anonymous code to enter on the survey instrument so that the responses collected before and after the class could be paired for analysis. Student responses were captured and stored electronically using SurveyMonkey (SurveyMonkey, San Mateo, CA).
Total knowledge scores were compared between the intervention and control groups using t tests. Comparisons were made between the total knowledge score and for each question individually. Changes in students’ aptitude and confidence were analyzed using Wilcoxon signed rank tests. An a priori alpha level of .05 was used to determine significance. This study was reviewed and approved by the university’s institutional review board.
RESULTS
Forty-six students completed the questionnaires: 26 (56.5%) in the intervention group and 20 (43.5%) in the control group (100% response rate). Table 1 describes participant demographics. There were no significant differences in demographic characteristics between the groups, with the exception of race (p=.005). The majority of participants in both groups were female (72%), aged 26-30 years (54.3%), and self-identified as Caucasian (39%). Most (84.7%) of the participants in both groups had not taken the diabetes elective offered to third-year student pharmacists) nor had a previous teaching experience within a patient education class (93.4%). For previous pharmacy experience, over half of the participants in both groups had 3-5 years’ experience and 64% (n=29) had previous community/retail work experience.
Demographics of Student Pharmacists Participating in the Study
The intervention group experienced a significant improvement in their overall knowledge score from the pre- to post-intervention assessment (68.4% to 81.8%, respectively, p<.001), whereas there was no significant change in the overall knowledge score of the control group from pre- to post-intervention (70.0% to 74.1%, respectively, p=.48) (Table 2). When looking at specific questions, there were significant improvements in scores for 4.5 questions (4 whole questions and a part of an additional question) for the intervention group and only 1 question for the control group. The only question on which both groups experienced a significant knowledge gain was question 5, parts a and b, which asked students to “List the recommended fasting (part a) and the post-prandial (part b) glucose goals for a patient with type 2 diabetes per the American Diabetes Association (ADA).”
Comparison of the Average Pre- and Post-knowledge Scores Between the Intervention and Control Groups
There was a significant improvement in perceived aptitude/confidence for all students (Table 3). The intervention and control groups had similar pre-intervention perceived aptitude/confidence scores (total perceived confidence score= 38.7 for intervention [out of 56] and 41.3 for control [out of 56], p=.36). Students mostly agreed or disagreed with each aptitude/confidence statement on the pre-questionnaire, but did not strongly agree or strongly disagree. Additionally, both groups had a similar post-intervention perceived aptitude/confidence score (total post-score=50.6 out of 56 for intervention and 48.0 out of 56 for control, p=.18). This means that most of the students either agreed or strongly agreed with each perceived aptitude/confidence statement on the post-intervention questionnaire. However, the mean perceived aptitude/confidence scores (11.9 points) of those in the intervention group improved significantly more compared to the mean score of those in the control group (6.7 points, p=.0026). The aptitude/confidence question that students ranked themselves the highest on was confidence in their ability to counsel patients with type 2 diabetes on self-monitoring blood glucose goals.
Comparison of the Groups’ Confidence/Aptitude Scores After Teaching a Diabetes Self-Management Education and Support Class
DISCUSSION
While evidence exists that demonstrates the benefit of incorporating student pharmacists into the teaching of a DSMES class, our study was the first conducted with APPE students that included a knowledge assessment in addition to a confidence evaluation and established a control group for comparison.6,16,19 This study also used the US Diabetes Conversation Map Program to teach the class and offers evidence that this resource can be used successfully by student pharmacist facilitators to enhance their confidence in and perception of diabetes knowledge and skills. Following the student-led DSMES class in this study, students in the intervention cohort exhibited a significant improvement in knowledge scores compared to scores on the pre-intervention assessment. Furthermore, this improvement in knowledge scores was not seen among students in the control group. Additionally, the intervention group demonstrated a gain in aptitude and confidence related to teaching a DSMES class.
With regard to the knowledge assessment, students in the control group demonstrated a significant improvement in only one content area, that relating to the ADA goals for fasting and postprandial glucose levels. However, students in the intervention group demonstrated a significant increase in knowledge on multiple items, with the majority improving their overall score and the score on only one item decreasing. This suggests that the act of teaching a DSMES class led to an improvement in knowledge among students in the intervention group. The DSMES class curriculum was intentionally designed to incorporate essential elements that patients with diabetes should be familiar with to adequately self-manage their diabetes. The unique design of this patient care learning activity allowed for students to prepare together and to team-teach patients and provided an environment for students to learn from each other. This may have led to an enhanced learning process, as opposed to the traditional counseling model with an individual patient in which there is limited, if any, interaction with other learners. In addition, the repetition associated with group preparation, faculty orientation, and team-teaching allowed for multiple opportunities to reinforce content in addition to standard exposure to diabetes experiences (ie, patient cases and topic discussion) throughout the APPE.
Regarding the differences in individual questions used in the knowledge assessment for students in the intervention cohort, students were able to better identify which statements were correct or incorrect (fact or myth); however, students were unable to justify why a statement would be labeled as a ‘myth.’ Background pathophysiologic content that students may have previously learned but forgotten was refreshed by preparing for and teaching the class. Additionally, constant repetition of factual information related to guideline-driven goals led to improved recall of content. Furthermore, knowledge associated with lifestyle-related aspects of diabetes care revealed an improvement in understanding of what constitutes medical nutrition therapy. However, because the focus of the other experiences included as part of the APPE was mostly on pharmacotherapy, students may not have retained information about the lifestyle modification interventions discussed as part of the class. Finally, a dietician may also be present on the health care team, so students may be less inclined to take ownership of this role in diabetes care.
Overall aptitude and confidence significantly improved for both groups, with a larger increase in confidence seen in the intervention group. The ability questions mirrored the knowledge questions in content, which allowed for correlation and matching between the surveys. Students in the intervention cohort displayed an improved perceived confidence in counseling with patients about different aspects of diabetes management including medication knowledge, nutritional support, and physical activity. The control cohort may have experienced improvements in their perceived abilities related to the traditional APPE experiences previously mentioned.
As with any study, there are limitations to this research. The intervention was developed and implemented by two ambulatory care faculty members for their APPE at one private college of pharmacy. These faculty members only precept a maximum of two students per APPE block, which resulted in a small sample size for the study. However, the number of students included was greater than that in a previously published study of similar design.6 Nevertheless, it is unclear whether other pharmacy schools with different faculty members and different students would achieve results similar to ours if they implemented a similar study. Also, administering the knowledge assessment immediately after the DSMES class may have heightened students’ knowledge scores due to the recency effect. A natural limitation of this study is that students in the intervention group were responsible for teaching a DSMES class to patients, which resulted in students spending more time studying the content. This may have caused students in the intervention group to demonstrate improved knowledge and confidence on the post-intervention assessment, outside of teaching the class itself. The aptitude/confidence results were based on students’ self-perceptions. It is unclear whether the students’ self-perception was as accurate a measure of their actual ability as a pharmacist or faculty member would have given them. However, because the knowledge questions mirrored the ability questions, the knowledge assessment provided a more objective measurement of the students’ abilities. Finally, an unintended significant difference in race represented in the intervention group vs in the control groups was found, but we do not know how, if at all, this influenced the results of this study.
This study aimed to train student pharmacists to be more successful in providing patient education in a small group setting. This teaching ability and confidence can be carried with the students to various practice settings encountered in their future careers in which they would be providing direct patient care. This study allowed for an added pharmacy-specific role for students within the faculty members’ ambulatory care clinic so that the APPE students could gain a sense of ownership of and autonomy in their role as future pharmacists. The students can later use these feelings to advocate for their patients and the growth of the profession. It also provided patients with the opportunity to enhance their knowledge and practice of critical diabetes self-management strategies. Additionally, this study allowed for the identification of the strengths and weaknesses of student pharmacists with regards to their diabetes knowledge as well as their aptitude and confidence in providing patient education within a group class model. This information will allow for the development of other experiences in the pharmacy curriculum that improve student pharmacist’s confidence and ability to educate patients in a group educational setting. Furthermore, trends in student strengths and weaknesses can become targets for the development of further novel teaching models, both within the didactic and experiential curriculum. Future research can focus on how students’ perceived aptitude and confidence relates to the ratings provided by pharmacist faculty members and/or the patients who interacted with them. Additionally, the long-term impact of teaching a DSMES class on knowledge retention and application should be explored.
CONCLUSION
A student pharmacist team-taught DSMES class fostered and promoted diabetes knowledge growth as well as enhanced their perceived clinical teaching abilities. This may lead to students becoming better educators of patients with diabetes in their future careers.
ACKNOWLEDGMENTS
The authors would like to acknowledge the contribution of Adam Gates, Class of 2019 Doctor of Pharmacy candidate, for his assistance with data collection and data analysis. This research was supported by two separate grants from Mercer University College of Pharmacy and Mercer University Health Sciences Center.
- Received April 16, 2019.
- Accepted August 9, 2019.
- © 2020 American Association of Colleges of Pharmacy