Abstract
Objective. To assess pharmacy faculty’s knowledge of prominent and prevalent teaching and learning myths and misconceptions and evidence-based strategies prior to training.
Methods. Participants completed a baseline assessment containing 16 true-false knowledge questions about teaching and learning misconceptions (10) and myths (six), one open-ended application question, and four participant demographic questions including years of experience in pharmacy academia, the focus of their institution (teaching or research), the number of education meetings attended, and whether they had formal training in education. After completing the baseline assessment of the top 16 misconceptions and myths, faculty were trained on the top 10 evidence-based teaching and learning strategies. At session completion, faculty were provided the assessment answers and scored their original responses.
Results. Results from the survey revealed that most responders (56%) had been in academics between one and 10 years and attended two to 10 education meetings (62%). The majority of participants worked at teaching-intensive universities (56%), and most had no formal training in teaching (65%). The average score on the assessment was 43% for the myths section versus 70% for the misconceptions section. Faculty participants were overconfident in their predictions (predicted=74%, actual=60%). Faculty demographics did not influence the assessment scores.
Conclusion. Pharmacy faculty may not know which teaching and learning strategies are evidence based and which are myths or misconceptions. In addition, they are likely to be overconfident in their knowledge of this evidence. This provides opportunity for faculty development in these areas.
INTRODUCTION
Educational misconceptions and myths can be inadvertently embedded into the teaching practices of Doctor of Pharmacy (PharmD) faculty.1 These myths and misconceptions originate from sources such as opinions, observations of other teachers, personal experience, and the media. They can be grounded in ideas like, “it worked for me as a student,” “don’t fix what isn’t broken,” or “that’s how it has always been done.” Regardless of the source or justification, educational myths and misconceptions can be damaging to teaching and learning.1 Take the common teaching aphorism, “those who can, do; those who can’t, teach.”2 This century-old saying is grounded in opinion but has perpetuated as a myth that disparages teachers and can underlie policies and practices related to teaching.1 Yet, as research has shown, the best way to learn something is to teach it, “to teach is to learn”; “those who understand, teach.”1,3 Believing the above myth may cause one to reject the use of peer teaching as a strategy for helping students become self-aware and self-directed learners and reflective practitioners, which are important pharmacy education outcomes.3,4 Unfortunately, not all faculty are aware of teaching myths and misconceptions, especially if they have not been specifically addressed and debunked during resident or graduate student teaching certificate programs or professional development workshops.
To date, no studies have evaluated pharmacy faculty members’ beliefs of common teaching myths and misconceptions or their knowledge of conventional evidence-based teaching and learning strategies. Evaluating faculty members’ teaching knowledge and beliefs can help them more intentionally select their future professional development to address their knowledge deficits and weaknesses. This study was designed to assess pharmacy faculty members’ knowledge of 10 misconceptions about evidence-based teaching and learning strategies and six teaching myths prior to training on these topics. The top 10 evidence-based teaching and learning strategies (activating prior knowledge, feedback, elaboration, scaffolding, testing, personalization, spacing, metacognition, distinctiveness, and peer teaching) were selected from the educational literature.5-10
METHODS
This study was conducted with a convenience sample in a session at the 2019 annual meeting of the American Association of Colleges of Pharmacy. Two hundred copies of a handout and survey were provided to attendees. The exact number of participants at the session was unable to be captured. The first page of the handout asked attendees to complete a 16-item baseline assessment and provide some demographic information (Appendix 1 and 2). This baseline assessment contained 10 true-false questions pertaining to misconceptions and the related content of the presentation and six true-false questions on myths about teaching and learning (see Appendix 2). Participants were also asked to predict their scores before starting the baseline assessment. After completion, participants engaged in one hour of instruction and activities delivered by the investigators related to the top 10 teaching and learning strategies. The length of the session did not allow for instruction related to the six teaching myths. The assessment was collected at the end of the session. The study received institutional review board approval.
Data were summarized using descriptive statistics. A one-way analysis of variance (ANOVA) with a post hoc Tukey test was used to analyze data based on baseline differences in demographics. Two metacognitive measures were calculated. The first was bias, which is the difference between a participant’s predicted score and their actual score, and it measures degree of over- or underconfidence.11 The second measure is absolute bias, or the absolute value of the bias score; this measures accuracy, or how close the predicted score was to the actual score. Statistical significance was set at p<.05.
RESULTS
A total of 80 participants completed the survey. Demographics of the responders can be found in Appendix 1. Most responders had been in academics between one and 10 years (56%) and had attended two to 10 AACP annual meetings (62%). The majority came from teaching-intensive universities (56%), and most had no formal training in teaching (65%). When comparing performance on the knowledge portion, there were no differences based on length in academia, number of AACP meetings attended, type of university they were currently working in, or whether they had formal educational training.
The assessment included 10 misconception questions related to knowledge of the top 10 evidence-based teaching strategies in addition to six questions about learning myths. The average score on the assessment was 43% for the myths section versus 70% for the misconceptions section (p<.001). See Appendix 2 for individual item results.
We also examined the bias, which compares the predicted score to the actual score and indicates over- or underconfidence. In general, responders were overconfident in their predictions of their overall score (predicted=74%, actual=60%; range: 19%-51%). There were no significant differences within years in academia, number of AACP meetings attended, institution type, or whether participants had formal training. We next examined the absolute bias, which assesses metacognitive accuracy. Here, participants were relatively inaccurate, showing on average a 16-point difference between predicted scores and actual scores (range: 0%-51%).
DISCUSSION
The purpose of this study was to capture participants’ knowledge about evidence-based teaching and learning misconceptions and myths in a population of faculty attending a national conference on teaching. We found that session attendees had moderately high knowledge about evidence-based strategies but poor knowledge about learning myths. Knowledge of these topics was not influenced by time in academia, the number of AACP meetings attended, the type of institution participants were from, or whether they had some degree of teacher training.
Six of the 10 misconceptions about evidence-based teaching strategies had average scores greater than 80%, indicating participants had common knowledge around these topics (scaffolding, 98%; personalization, 96%; retrieval, 91%; feedback, 90%; prior knowledge, 89%; and collaborative learning, 81%). Faculty members’ knowledge about these areas may be the result of training since these are common areas of emphasis in teaching certificate programs and at the annual AACP meeting. Items with the lowest average scores were contrast (61%), metacognition (36%), elaboration (35%), and spacing (25%), indicating that participants would benefit from more development in these teaching and learning topics.
In addition to the questions about knowledge of the top 10 teaching and learning strategies, the assessment included six questions about learning myths. Scores on these items were significantly lower than those on the knowledge items (43% vs 70%, p<.001). Myth questions included topics of the learning pyramid, learning styles, inquiry-based learning fits all, attention span, lecture is best, and hemispheric dominance. It is possible that participants answered these questions incorrectly because they had seen other faculty in their institution using these strategies or they had experienced the strategy in their own teaching. Relatedly, another reason could be that these myths are passed down from mentors to mentees during training, much like folklore. There is plenty of evidence that even teachers with formal training believe some of these myths.12 Despite the evidence suggesting otherwise, learning myths are also still present in research articles and presentations. Sometimes myths persist because people have difficulty judging what is true or false. We make these true-false judgments in several ways, such as accepting new information by default, accepting new information when it aligns with what we believe to be true, and accepting new information when it is repeated more often.13 As a result of such experiences, observations, mentoring, and training, people often mistake common practice for best practice.1 Furthermore, sometimes faculty reject new ideas because they contradict the status quo.1 Because of these reasons, changing teaching practice is challenging. If instructors hold on to these teaching myths, it may be difficult to design the most effective instruction.
Another finding of this study revealed that all respondents were overconfident in their understanding of these topics, as indicated by their predictive scores being greater than their actual scores. This could be due to the pervasive nature of teaching and learning myths, limited faculty development in these areas, reliance on past experience and previous practice, and/or personal biases.14 This could indicate that development is needed on these topics to ensure that evidence-based teaching and learning strategies are being used in our classrooms, laboratories, and experiential learning sites.
The strengths of this study are that the sample comprised active pharmacy educators and the questionnaire entailed a simplified assessment of knowledge. Some limitations are that the sample was a convenience sample of those that attended a specific conference session and that out of the over 200 attendees, not all participants completed the assessment. Those who attended the conference, and this session specifically, may have had a special interest in teaching since they pursued this development related to teaching and learning. Therefore, results may not be applicable for all pharmacy faculty, as the sample did not fully represent the Academy as a whole. The exact number of participants at the session was unknown, so the actual response rate is uncertain. However, the study did capture participants’ demographics, and this sample included faculty from different levels, programs, and years of experience. Additionally, a limited number of items was used to assess each strategy (one per item), and only certain strategies were sampled. Finally, the study was only designed to measure baseline misconceptions, myths, and knowledge, not long-term retention and/or application of what participants learned or remembered.
As with any training situation, assessing prior knowledge is useful in tailoring instruction, and, thus, this approach may be useful as a screening tool for faculty development efforts at the local or national level. The results of this study suggest that faculty may need more educational opportunities around certain topics such as learning myths.
CONCLUSION
Pharmacy faculty may not know which teaching and learning strategies are evidence based and which are myths. With limited time, they may not be able to develop their understanding of these topics efficiently. In addition, they are likely to be overconfident in their knowledge of this evidence. Providing specific and concise faculty development in these areas, especially related to debunking educational myths, is warranted to promote evidence-based teaching practices to advance pharmacy education. In the Academy overall, there can be better screening of conference proposals or manuscripts to prevent the spread of misinformation. Individuals have the responsibility to use evidence-based literature to inform their teaching practices. Instructors may use popular press books as justification of their evidence-based teaching, but these books are not peer reviewed and, as such, may be subject to misinformation. We encourage everyone to use the strongest evidence possible to support their instructional decisions, such as data from meta-analyses and systematic reviews, just as they would in clinical practice.
Appendix
Summary of Teaching and Learning Misconceptions and Myths Assessment Scores by Demographics
Appendix
List of Teaching and Learning Misconceptions and Myths Question Topics With Performance, Respective Category, and References
- Received June 1, 2021.
- Accepted December 7, 2021.
- © 2022 American Association of Colleges of Pharmacy