Abstract
Objective. To compare second- and third-year pharmacy students’ competence, attitudes, and self-confidence in providing diabetes care before and after completing a hand-on diabetes training program and to determine if the program had an impact on students’ attitude and self-confidence based on their year in the curriculum.
Design. The program included classroom lectures and hands-on learning sessions in 5 facets of diabetes care. Pre- and post-test instruments measured students’ competence, attitudes, and confidence in diabetes care.
Assessment. Students’ competence and the mean overall confidence score significantly improved after completing the program, while mean overall attitude score did not. Third-year students had significantly higher confidence scores than did second-year students on both pre- and post-program tests. No significant difference was found for attitude scores between second- and third-year students.
Conclusion. The hands-on learning program was an effective approach to training pharmacy students in diabetes care, improving both their competence and confidence.
INTRODUCTION
Studies in the United States and abroad have found that improved glycemic control benefits people with diabetes and can result in a reduced risk of microvascular complications (retinopathy, nephropathy, neuropathy).1 Pharmacists play a pivotal role in the healthcare team for managing diabetes and have the skills to become diabetes educators.2,3 However, despite that pharmacists are most often the last line of contact between the patient and the medication, they remain an underused resource in the management of chronic diseases. Pharmacists have the knowledge, attitudes, skills, and capacity to improve glycemic control, increase medication effectiveness, improve patient adherence, and minimize adverse drug effects.3-7
Providing diabetes education workshops to pharmacy students before their clinical practice experiences allows students to integrate knowledge obtained in the classroom with practice skills. If pharmacists have the knowledge base but little or no self-confidence, predictably, they will be poor practitioners because they will not transmit and/or use their knowledge and skills for the good of the patient.8 Alternatively, practitioners with little knowledge but much confidence may pose a definite threat to those they attempt to serve. The result would be a stagnation of professional performance that never achieves the profession’s ultimate goal of delivering patient care. Maximizing the profession’s contribution to society in its mission to deliver pharmaceutical care requires developing and balancing practitioners’ knowledge, skills, and self-confidence.
Colleges and schools of pharmacy recognize the importance of preparing pharmacy students to master the knowledge and skills necessary to provide diabetes care and education. This goal fits into Standards 11 and 12 of the Accreditation Council for Pharmacy Education,9 which are in alignment with the educational outcomes promulgated by the Center for the Advancement of Pharmacy Education.10 These standards emphasize that the curriculum must foster active-learning strategies to enable students to transition from dependent to active, self-directed, lifelong learners in providing patient-centered care and promoting health improvement, wellness, and disease prevention. A few studies have examined the impact of diabetes education modules on pharmacists’ confidence, attitudes, and competence. Practicing pharmacists who responded to the Diabetes Attitude Scale showed positive attitudes toward team care, special training, and control/complications factors.2 In pre- and post-intervention assessments of the efficacy of diabetes continuing education programs for licensed pharmacists, participants’ knowledge of the disease state and positive attitude toward diabetes care increased significantly after completion of the program.11,12
Colleges and schools of pharmacy have developed unique instructional methods to provide enhanced learning experiences to students about diabetes mellitus. These have included a diabetes certificate program integrated into a 2-year elective course for third- and fourth-year students13; a multistation, skills-based laboratory for second-year students14; a 2-week lecture, Web-based case evaluation, and role-play for third-year students15; a 1-credit semester-long elective including a 1-week simulation for second- and third-year students16; a week-long living-with-diabetes simulation during a clinical assessment course for third-year students17; and an American Pharmacists Association/American Association of Diabetes Educators diabetes certificate program integrated longitudinally into the third-year pharmacy curriculum.18 These instructional methods improved knowledge, competence, attitudes, and/or confidence in providing diabetes.
The instruments used in these studies were either faculty-developed instruments or existing published instruments, such as the Diabetes Attitude Survey (DAS). However, few studies have reported the internal consistency reliabilities of the instruments used in collecting data, which may influence the power of the study to detect any significance, the outcome data collected, and the ability to draw rational conclusions from the data. While several instructional methods have displayed positive results on students’ outcomes, they may not be feasible and practical to implement in the programs of newly established colleges and schools because of significant limitations in time and resources. Thus, a simple, practical, and effective instructional method is needed.
The objectives of this study were to: (1) compare the competence, attitudes, and self-confidence scores of pharmacy students in providing diabetes care before and after completing the diabetes training program, and (2) to determine if there was a difference between second- and third-year pharmacy students’ attitudes towards diabetes and their self-confidence in providing diabetes care. No study has explored whether the effect of the program on students’ scores relating to their attitudes toward diabetes and to their self-confidence in providing diabetes care vary at different points/stages in the doctor of pharmacy (PharmD) curriculum. This information is important in determining where in the curriculum the diabetes training best fits. Such tangible evidence could be used to guide how colleges and schools of pharmacy develop and foster students’ attitudes toward diabetes and their self-confidence in providing diabetes care during their education, thereby increasing the likelihood that they will provide patient-centered care as professionals.
DESIGN
At the Daniel K. Inouye College of Pharmacy University of Hawaii at Hilo, second- and third-year pharmacy students participated in the diabetes training program as a component of their Integrated Therapeutics course. The program consisted of 10-hour classroom lectures on diabetes (ie, pedagogy for formal knowledge and conceptual understanding), after which students participated in a hands-on, 4-hour workshop consisting of stations directed toward certain aspects of diabetes management (ie, pedagogy of practice, performance, and improvement). The second- and third-year pharmacy students received diabetes lectures during the same semester (ie, fall semester) of their respective curriculum years. For the third-year students, it was a part of the Integrated Therapeutics III course, according to the original plan of the curriculum, and for the second-year students, the Integrated Therapeutics I course. The curriculum had been revised to offer diabetes lectures to the second-year students and future cohorts instead of the third-year students. This revision was made to better prepare the second-year students for ambulatory introduction to pharmacy practice experiences (IPPEs), where the predominant conditions they encountered were hypertension, diabetes, and dyslipidemia. Students in the 2 classes did not attend the diabetes lectures and the diabetes training program at the same time; instead, they were scheduled 1 week apart for the respective courses. Following the lecture portion, students in each year participated in a diabetes training workshop that consisted of rotating through stations, as described in Table 1.
Station Activities Performed by Second- and Third-Year Pharmacy Students in a Diabetes Training Program
Two faculty members in the department of pharmacy practice, including a certified diabetes educator (CDE), designed and implemented the diabetes training program. Three faculty members in the department, 2 volunteer certified nurse diabetes educators from Hilo Medical Center and 1 drug representative, acted as instructors for stations during the workshop (ie, 1 faculty member each for the blood glucose station, administration insulin station, and A1C screening station; 2 nurse CDEs for the diabetic foot examination station; and 1 drug representative for the insulin delivery education station). The training would help foster early clinical immersion in the IPPEs as well as a continuous connection of formal classroom knowledge and conceptual understanding from the first through third years to the advanced pharmacy practice experiences (APPEs) in the fourth year. At the workshop for each class, students were randomly divided into 5 groups of approximately 18 students. Each group spent approximately 20 to 30 minutes at each station before rotating to the next assigned station. Instructional and active-learning methods used in the delivery of the training program for each station were combinations of instructor-led modeling, role-playing, self-performed/practiced skills, small-group discussion, and station instructor observation of students’ performance.
At the blood glucose station, the instructor reviewed the basic glucose checking technique with students. Students were also shown how to calibrate a glucometer as well as the specific steps in taking an accurate blood glucose reading. The instructor then reviewed blood glucose goal levels for diabetics, and students were given time to conduct their own blood glucose check. Students were either paired up with a classmate or assigned to perform the glucose check on their own finger using the proper technique. Based on their glucose reading, students were asked to interpret the levels and were provided with feedback from the station instructor. At the end of the station, the instructor signed off on the students’ worksheets if they showed that they could independently check someone’s blood glucose using proper technique and if they demonstrated a basic understanding of glucose values.
Prior to attending the workshop, students were told that they would be either self-injecting or injecting another student with normal saline. The goal was for students to experience what it is like to be injected with a needle or to inject someone else with a needle. At this station, students were given a short review on how to properly inject insulin as well as selecting appropriate needle sizes. The station instructor also reviewed proper injection sites, technique, and how to draw insulin and monitoring for signs and symptoms of hypoglycemia. Students chose whether they wanted to self-inject with saline or take turns with another student injecting each other. Each student independently performed the task of injecting insulin and demonstrated proper technique. If the students’ performance was satisfactory, the instructor would sign the students’ worksheet.
At the foot examination station, nurse CDEs from Hilo Medical Center instructed the class on how to properly perform a foot examination. The nurses gave instructions on how to use a monofilament sensory testing device and record the readings. Students in this station were paired off for role-playing as patients and pharmacists conducting a foot examination and the roles were then reversed. Each pair was observed by a nurse and given immediate feedback on proper technique. Students in the role of a pharmacist had to provide proper foot care education to the patient.
The goal of the insulin delivery device education station was to familiarize students with the different types of insulin pens and syringes available to patients with diabetes. The instructor at this station provided students with an assortment of insulin pens, and students used injection pads to mimic injecting someone with an insulin device. They also reviewed how to properly use an insulin pen and the correct storage, preparation, administration, and mixing of insulin.
At the next station, an instructor reviewed the importance of A1c, how to interpret A1c readings, and the correlation of A1c to average glucose based on the International Expert Committee Report on the importance of the A1c.19 Students were verbally quizzed on target A1c levels for diabetic individuals and what level should be used to properly identify someone with diabetes. At the conclusion of the station, the instructor signed the students’ worksheets if they had demonstrated satisfactory understanding and interpreting of A1c. The American Diabetes Association 2010 clinical update, which now recommends using A1c levels for the diagnosis of diabetes,20,21 was released after this study concluded.
EVALUATION AND ASSESSMENT
Assessment of the diabetes training program included 3 areas: competence, attitudes, and self-confidence in providing diabetes care. Student competence was assessed before and after students’ completion of the training program. Preintervention competence was assessed by student self-evaluation. Students were asked to respond yes or no regarding their ability to perform each task at each station independently and correctly. Postintervention competence was measured after each task at each station using performance-based assessment. An instructor at each station observed how students performed skills, either in pairs or on an individual basis, and then signed the students’ worksheets if they had adequately demonstrated competence in the skill assessed at that particular station. In this study, competence was defined as a student’s ability to perform skills and interpretations well, independently, and rarely with assistance or guidance from the instructor. The station instructor observed, provided feedback, and suggested changes to improve the students’ competence and performance. Students were required to repeat the station exercises until they achieved proficiency before rotating to the next assigned station.
Students completed questionnaires related to self-confidence in diabetes care and attitudes about diabetes before and after completing the diabetes training program. Each instrument contained 15 items assessing students’ confidence as well as their attitudes toward providing diabetes care. Students were also assessed as being competent or not competent as they completed each station. Prior to starting the survey, students were asked to create a 4-digit code that would enable the instructors to match their pre- and post-intervention test scores and ensure that student responses remained anonymous.
For the self-confidence instrument, students ranked their self-confidence on a 5-point scale on which 1=not at all confident, 3=moderately confident, and 5=completely confident. A pre- and post-intervention test design allowed for a comparison of each student’s level of confidence before and after the diabetes training program. The self-confidence instrument used in this study was based on an existing instrument12 and literature review.2,3,7-15 Four clinical faculty members from the Pharmacy Practice Department were asked to constitute an internal expert content panel to review for content, grammatical correctness, organization, readability, and clarity. They were also asked to share/suggest any additional items that were germane to self-confidence in providing diabetes care. The instrument was then pretested with 5 pharmacy students for clarity and understandability. This process resulted in a 15-item instrument.
The attitude instrument included 14 items from the 33-item DAS,22 which covered 5 subscales: need for special training, seriousness of type 2 diabetes, psychosocial impact of diabetes, value of tight glucose control, and patient autonomy. One item relating to pharmacists’ beliefs was added to the instrument, resulting in a 15-item attitude instrument. In response to each instrument item, students were asked to choose 1 of the 5 response options: 1=strongly agree, 2=agree, 3=neutral, 4=disagree, and 5=strongly disagree. We selected a subset of 14 items instead of using all 33 items of the DAS because of concerns about the feasibility of the instrument in terms of the students’ accuracy in reporting their attitudes. The DAS had too many questions to assess, took a long time to complete, and some items were not applicable to tasks performed in the diabetes training program or to pharmacy students (eg, some items related to nurses and dietitians).
The 15-item attitude instrument was reviewed by 4 clinical faculty members of the Pharmacy Practice Department and went through the same review process as used for the self-confidence instrument to reflect the attitudes students were expected to gain from the diabetes training program. Students were asked to rate their level of satisfaction with the program on a 5-point scale on which 1=poor, 2=fair, 3=good, 4=very good, and 5=excellent. The preintervention assessment of student satisfaction was based on the program briefing. Students were told they would be participating in a hands-on training workshop to develop each of the skills taught at the diabetes stations. Post-intervention test for satisfaction was assessed at the conclusion of the program.
Descriptive statistics were calculated for all relevant variables, including students’ demographic data. A paired t test was performed to compare each item and overall pre- and post-intervention test scores for self-confidence and attitudes before and after the diabetes training program. An internal consistency reliability coefficient (ie, Cronbach coefficient alpha) was calculated for the instruments assessing attitudes toward diabetes and self-confidence in providing diabetes care. Two-way ANOVA with repeated measures on one factor (2-way mixed ANOVA) was used to analyze whether the effect of the diabetes training program on students’ scores for attitudes toward diabetes and for self-confidence in providing diabetes care varied for students in different curriculum years. All statistical analyses were performed using the SPSS for Windows (version 17.0). Level of significance for all analyses was set at an alpha equal to 0.05.
Table 2 shows student demographic data. While most of the 175 participants (85 in the third year and 90 in the second year) completed both the self-confidence and diabetes attitude instruments, only 87 students provided valid 4-digit codes on their pre- and post-intervention tests. Class demographic statistics for the second- and third-year students showed that approximately 41% and 39% were male, and 59% and 61% were female, respectively. The mean (SD) ages of second- and third-year students were 26.5 years (4.6) and 28 years (4.7), respectively. Percentages of students with a prior college degree were 74% and 71%, respectively. Nonresponse bias was checked for these variables and the results showed no significant difference between the students who provided valid responses and the statistics for each class (p>0.05), except for the second-year students’ gender variable. Thus, students who provided valid responses were relatively similar to and representative of all second- and third-year students.
Demographic Characteristics of Second- and Third-Year Pharmacy Students Participating in a Diabetes Training Program
Of the 87 students who provided valid 4-digit codes on their pre- and post-intervention tests, 38 were third-year students and 49 were second-year students. Fifty-six (64%) of the students were female and 31 (35.6%) were male. The majority were Asian-American or Caucasian. Thirty-eight (100%) of the third-year students were doing a hospital IPPE and had already completed an ambulatory care clinic IPPE in the previous year. Half of second-year students were doing a long-term care IPPE and the other half were doing an ambulatory care clinic IPPE. The time since the last practice experience varied. Twenty-six (68%) of third-year students and 37 (76%) of second-year students had a prior college degree. In both classes, approximately two-thirds of students reported having friends or family members with diabetes. Twenty-four (63%) third-year students had prior diabetes training compared with 26 (53%) second-year students.
The results of the students’ competence tests are reported in Table 3. Students passed if they could competently demonstrate the skill addressed by each station. Appointed instructors evaluated every student who participated. Upon completion of the diabetes training program, 100% of the students were considered to have the necessary skills to competently perform each task. Table 4 shows the results of the self-confidence pre- and post-intervention tests. Cronbach alpha reliability for the pre- and post-intervention self-confidence instruments was above 0.9 for both classes. Overall, students were more confident on all items measured on the pre-intervention test. For third-year students, the mean total self-confidence scores were 2.7 ± 0.8 on the pre-intervention test and 4.2 ± 0.7 on the post-intervention (p<0.0001). For the second-year students, the total self-confidence mean score was 1.9 ± 0.9 and the mean score on the post-intervention test was 4.0 ± 0.7, (p<0.001). Compared with third-year students, second-year students showed a greater increase in confidence after completing the diabetes training program.
Comparison of Pharmacy Student Competence in Diabetes Care Management Before and After Completing a Diabetes Training Program (N = 175)
Pharmacy Students' Self-Confidence Assessed Before and After Completing a Diabetes Training Programa
Scores for self-confidence in providing diabetes care for the second and third-year students were compared to see whether there was significant difference between classes. The overall mean self-confidence score (Table 4) significantly improved after the training program for both classes (p<0.001), but students in the third-year scored significantly higher (p<0.001) than did those in the second-year on both the pre- and post-intervention tests for self-confidence. The effect of the pre- and post-intervention diabetes training program on students’ self-confidence scores was significantly different between the 2 classes (p=0.001).
The scores for attitude in providing diabetes care for the second- and third-year students were compared between class years (Table 5). The overall mean attitude score (Table 5) did not change significantly for either class (third-year students p=0.166, second-year students p=0.124). Two-way mixed ANOVA revealed no significant interaction effect (p=0.965) and main effect for class (p=0.342). However, there was a significant main effect of the scores for the pre- and post-intervention attitude tests (p=0.039). Cronbach alpha reliability for the pre- and post-intervention attitude instruments was above 0.7 for both classes.
Pharmacy Students' Diabetes Attitude Assessed Before and After Completing a Diabetes Training Programa
The level of pharmacy students’ satisfaction was also measured using a rating scale on which 1=poor, 2=fair, 3=good, 4=very good, and 5=excellent. Overall, students were satisfied with the diabetes training program (Table 6).
Pharmacy Students’ Level of Satisfaction with the Diabetes Training Program (N = 87)
DISCUSSION
This study assessed the competence, self-confidence, and attitude of pharmacy students regarding providing diabetes care. A hands-on training program was added to the students’ classroom lecture in diabetes. Previous studies have examined the benefit of active-learning in increasing the understanding of classroom material and providing students a way to apply it to real-life situations.14-18,23 These results, which were similar to ours, showed that providing supplementary courses and practice increases students’ overall knowledge and confidence in performing practical skills. To our knowledge, this is the first study to determine that the effect of the diabetes training program on pharmacy students’ self-confidence and attitudes toward diabetes care was different among students depending on their year in the curriculum.
Our study found that students in the third year had higher scores than those in the second-year on both the pre-and post-intervention tests of self-confidence (p<0.001). This difference in self-confidence scores may have been attributable to third-year pharmacy students having had more experience in clinical practice experiences (ie, IPPEs) than second-year students. Third-year students also had completed more of the curriculum’s classroom courses and thus, may have gained knowledge and experience in other disease states, which may have been an additional benefit. Results (Table 2) also show that more of the third-year students had prior diabetes training compared with the second-year students (63% vs 53%, respectively). Other research has identified age, grade-point average, and community service/volunteerism as variables that affect pharmacy student self-confidence levels. These variables are significant predictors of self-confidence (p<0.05).8 Although no significant interaction effect and main effect for class year were found for attitudes toward diabetes, there was a significant main effect of the pre- and post-intervention test of diabetes attitude scores for class year.
Our study showed that the diabetes training program, which included lectures and hands-on activities, can be used to significantly improve the competence and self-confidence of pharmacy students in diabetes care. Students were more confident in all items measured. Third-year students showed more of an increase in confidence than did second-year students, a difference that could be attributed to the third-year students having learned and gained more knowledge and experiences from the diabetes training program, classroom curriculum, and IPPEs compared with second-year students. The results support the theory that self-confidence can be easily developed in a short timeframe but that developing and instilling a positive attitude may require more time, effort, and determination. 24-27 It is crucial not to have unrealistic expectations for rapid change because attitudes are formed over a lifetime through the process of socialization.24,25 This socialization process affects not only attitude toward work but also related behavior. We believe that this process can be developed and fostered in academic programs through hands-on training, classroom and experiential programs, and extracurricular activities (eg, professional organization, community services, health fairs).
A college or school of pharmacy can design and/or adopt specific instructional methods (eg, Bandura’s sources of self-confidence/efficacy,26 the Attention, Relevance, Confidence, and Satisfaction [ARCS] model,27 cultivating intellectual confidence28) to assist students in developing or balancing their level of confidence. Bandura proposed that a person’s perception of self-confidence is dynamic and developed in response to cognitive processing of information from 4 sources that influence how an individual judges his/her capability26: (1) performance accomplishment; (2) vicarious observation (ie, observing another person’s performance of a behavior); (3) verbal/social persuasion; and (4) physiological/psychological states (ie, emotional arousal such as anxiety, stress, fatigue). Of these, performance accomplishment is the most influential source of confidence and efficacy information because it is based on actual mastery experiences. This information corresponds with the primary goal of the diabetes training program, which provided hands-on learning sessions to students. Additionally, confidence in the ARCS model refers to how the student perceives his/her likelihood of achieving success through personal efforts and control.27 The 3 confidence subcategories are: (1) learning requirements (ie, developing a positive expectation for success); (2) success opportunities (ie, supporting or enhancing student’s belief in his/her competence); and (3) personal responsibility (ie, establishing student’s effort and ability as his/her basis for success). Many motivational strategies are available to develop the student’s confidence for each subcategory.27
There are potential limitations to our study. With respect to student competence, our assessment did not use score rubrics to evaluate student performance. We believe that rubrics can restrict students’ learning and imagination in that they will feel that they need to complete station exercises strictly according to the rubric rather than taking the initiative to explore their learning with the station instructor. Additionally, because of the limited number of faculty members available and the amount of time required to use rubrics, we instead had each station instructor provide feedback and suggest changes to improve the students’ performance. As a result, student competence ratings may have been more subjective and dependent on individual station instructors’ expertise and skills.
The difference in direction of the ranking scores on the self-confidence and attitude survey instruments may have confused some students and impacted the accuracy of student responses, however, the investigators emphasized this difference in scales to the whole class before the students responded to the survey instrument. The diabetes workshop was resource-intensive and time-consuming for both faculty members and students. Students had to complete not only the pre- and post-intervention instruments for assessment of self-confidence and attitude but also the demographic data and satisfaction survey instruments. With so many instruments to complete, students can become frustrated and disengaged, potentially resulting in superficial and haphazard answers.
Additionally, the reliability coefficient (Cronbach alpha) was high and indicated reliable data/scores obtained from these instruments.29 Results indicated strong support and good internal consistency reliabilities for the self-confidence and attitude instruments. Another explanation is that attitudes toward diabetes care may require more time to develop and instill in pharmacy students.17,25 We also believe the methods used to assess the students’ self-confidence and attitudes were effective. The pre- and post-intervention survey allowed students to evaluate their skills before and after taking part in the diabetes training program and post-intervention scores showed significant improvement in students’ self-confidence. Overall, the students seemed to enjoy taking part in the training program and their self-confidence and competence increased. The diabetes training program which included hands-on learning sessions that helped in developing and fostering physical/psychomotor skills, allowed students to gain experience in areas that cannot be covered in classroom lectures because of time constraints.
SUMMARY
A hands-on diabetes training program as an adjunct to the classroom course is an effective means of instilling self-confidence and competence in pharmacy students in both the second and third years of their pharmacy education. Students’ scores in competence and self-confidence in diabetes care improved. Third-year students scored higher than second-year students in both the pre- and post-intervention tests for self-confidence and attitude. This diabetes training program emphasizing hands-on learning was an effective approach to improving pharmacy students’ competence and self-confidence in providing diabetes care.
- Received January 2, 2013.
- Accepted March 22, 2013.
- © 2013 American Association of Colleges of Pharmacy