Skip to main content

Main menu

  • Articles
    • Current
    • Early Release
    • Archive
    • Rufus A. Lyman Award
    • Theme Issues
    • Special Collections
  • Authors
    • Author Instructions
    • Submission Process
    • Submit a Manuscript
    • Call for Papers - Intersectionality of Pharmacists’ Professional and Personal Identity
  • Reviewers
    • Reviewer Instructions
    • Call for Mentees
    • Reviewer Recognition
    • Frequently Asked Questions (FAQ)
  • About
    • About AJPE
    • Editorial Team
    • Editorial Board
    • History
  • More
    • Meet the Editors
    • Webinars
    • Contact AJPE
  • Other Publications

User menu

Search

  • Advanced search
American Journal of Pharmaceutical Education
  • Other Publications
American Journal of Pharmaceutical Education

Advanced Search

  • Articles
    • Current
    • Early Release
    • Archive
    • Rufus A. Lyman Award
    • Theme Issues
    • Special Collections
  • Authors
    • Author Instructions
    • Submission Process
    • Submit a Manuscript
    • Call for Papers - Intersectionality of Pharmacists’ Professional and Personal Identity
  • Reviewers
    • Reviewer Instructions
    • Call for Mentees
    • Reviewer Recognition
    • Frequently Asked Questions (FAQ)
  • About
    • About AJPE
    • Editorial Team
    • Editorial Board
    • History
  • More
    • Meet the Editors
    • Webinars
    • Contact AJPE
  • Follow AJPE on Twitter
  • LinkedIn
Research ArticleTEACHERS’ TOPICS

A Novel Teaching Tool Combined With Active-Learning to Teach Antimicrobial Spectrum Activity

Conan MacDougall
American Journal of Pharmaceutical Education March 2017, 81 (2) 25; DOI: https://doi.org/10.5688/ajpe81225
Conan MacDougall
University of California – San Francisco School of Pharmacy, San Francisco, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Objective. To design instructional methods that would promote long-term retention of knowledge of antimicrobial pharmacology, particularly the spectrum of activity for antimicrobial agents, in pharmacy students.

Design. An active-learning approach was used to teach selected sessions in a required antimicrobial pharmacology course. Students were expected to review key concepts from the course reader prior to the in-class sessions. During class, brief concept reviews were followed by active-learning exercises, including a novel schematic method for learning antimicrobial spectrum of activity (“flower diagrams”).

Assessment. At the beginning of the next quarter (approximately 10 weeks after the in-class sessions), 360 students (three yearly cohorts) completed a low-stakes multiple-choice examination on the concepts in antimicrobial spectrum of activity. When data for students was pooled across years, the mean number of correct items was 75.3% for the items that tested content delivered with the active-learning method vs 70.4% for items that tested content delivered via traditional lecture (mean difference 4.9%). Instructor ratings on student evaluations of the active-learning approach were high (mean scores 4.5-4.8 on a 5-point scale) and student comments were positive about the active-learning approach and flower diagrams.

Conclusion. An active-learning approach led to modestly higher scores in a test of long-term retention of pharmacology knowledge and was well-received by students.

Keywords
  • active learning
  • antimicrobial agents
  • instructional design

INTRODUCTION

Health professions students are expected to command a tremendous volume of facts and concepts, but long-term retention of this information is a substantial challenge.1 Studies suggest retrieval practice, connection to prior knowledge, self-explanation, and organization into schema are associated with improved long-term retention.2 These strategies require active engagement from learners as opposed to passive receipt of information. Incorporating these strategies into scheduled class sessions creates an active-learning environment that is associated with improved student performance in science courses generally and pharmacy courses specifically.3,4

Learning antimicrobial spectrum of activity is particularly challenging because it is difficult to predict activity based on knowledge of drug mechanism and organism physiology (because one would have to know the physiology of hundreds of target organisms). For this reason, rote memorization is frequently employed. Such methods are associated with poor long-term recall and poor performance on transfer-type questions.5 A robust knowledge of antimicrobial spectrum of activity is important for pharmacy practice, as the role of pharmacists in antimicrobial stewardship has expanded dramatically in the last decade.6,7

The educational innovation in this study was the introduction of an active-learning approach and incorporation of a novel cognitive schematic into a portion of an antimicrobial pharmacology course (about 50% of the antimicrobial-related content), with the goal of increasing the likelihood of students’ long-term retention of antimicrobial pharmacology knowledge, especially with regards to antimicrobial spectrum of activity.

DESIGN

At the University of California San Francisco School of Pharmacy, Antimicrobial and Oncologic Pharmacology is a two-unit course taught over 10 weeks in the fall quarter of the third professional year and followed by Therapeutics of Infectious Diseases and Oncology, a six-unit course taught over 10 weeks in winter quarter of the same year. This stepped approach requires students to retain foundational knowledge learned in the pharmacology course for months in order to apply the knowledge in the therapeutics course. The active-learning instructional method was used to teach two of the topics in the pharmacology course (Beta-lactam Antibacterials, Antifungals) in-class sessions across all three years. In 2015, a third session (Glycopeptides and Lipopeptides) was also delivered using the active-learning method. Other topics in the course were taught primarily using traditional-lecture approaches. The sessions relevant to this study are listed in Table 1 by year of delivery and in-class contact time. Of note, the amount of in-class time was not increased when sessions were transitioned from a traditional lecture method to an active-learning approach, both for the period under study and for the course historically.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1.

Assessed Pharmacology Course Content by Delivery Method

Prior to the active-learning in-class sessions, students were provided with a course reader that discussed key characteristics of each drug or closely related class of drugs in a standard format. In 2015, self-assessment questions (with answers at the end of the relevant course reader section) were added to promote immediate concept review. Students were advised that they would be expected to review this in advance of the corresponding class sessions, but there were no graded preparatory assessments and attendance was voluntary. During the in-class session, brief summaries of key concepts were followed by student exercises and then a review of the correct answers. Students were encouraged to collaborate with nearby classmates on the exercises, but forming groups was not specified or required. In particular, students practiced learning spectrum of activity using specially designed worksheets. These worksheets (Figure 1) arranged the key organisms to be learned in specific patterns that incorporated both the general organism characteristics (Gram-positive vs Gram-negative) as well as their relative resistance to therapy in a radial approach. During the activity, students circle the organisms that are “covered” by the drug in question (Figures 2a, 2b). This can lead to a flower-like appearance; hence the student-coined term “flower diagrams.” In addition to providing an opportunity for practice, the flower diagrams allow for comparison across drugs to see how spectrum of activity builds, for example, across generations of cephalosporins, or the effect of adding a beta-lactamase inhibitor to an aminopenicillin. Correct answers with explanations for all in-class exercises were posted after the end of the class sessions.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Spectrum of Activity Worksheet Schema for Bacterial Infections.

Figures 2a, 2b.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figures 2a, 2b.

Examples of Completed Spectrum of Activity Worksheets (“Flower Diagrams”).

EVALUATION AND ASSESSMENT

The following quarter in the therapeutics course, approximately 10 weeks after the final active-learning session, students completed a low-stakes multiple-choice examination on key knowledge from antimicrobial pharmacology (the assessment took place in the next calendar year; dates listed are from when the content was delivered in the pharmacology course). This was administered in class via an individual online survey link using the Qualtrics platform (Qualtrics, Inc, Provo, UT). The examination consisted of 15 multiple-choice questions; 12 of which related to antimicrobial spectrum of activity. Each question had five possible responses from which all acceptable responses were to be selected (ie, no answers were mutually exclusive). This approach resulted in essentially 60 true-false items on the examination. The total score on this baseline assessment was strongly associated with the score on the subsequent therapeutics examination that covered bacterial infections, even after controlling for student overall grade point average (GPA) (adjusted coefficient .42, p=.003).

Each examination item was classified as being related to information taught in active-learning or traditional lecture sessions. Questions regarding glycopeptides and lipopeptides were classified as traditional-learning related in 2013 and 2014 and active-learning related in 2015. For 2013 and 2014, 44 of 60 items were related to active-learning sessions; in 2015, 50 of 60 items were related to active-learning sessions. The mean percentage of items answered correctly for each question type was compared using paired t tests to account for intra-subject correlation for normally distributed data or Wilcoxon tests for nonnormally distributed data. The standardized effect size and associated 95% confidence interval was calculated using Cohen’s d. Student evaluations of the instructor providing the active-learning sessions were reviewed and compared to those of all instructors in the course.

Across all years and students (n=360), the mean percentage of correct items was 74.2%. For items related to content taught using the active-learning approach, the mean percentage of correct answers was 75.3% vs 70.4% for the items testing content taught using traditional lecture methods (difference 4.9%, p<.0001) (Table 2). Differences between the content areas were significant for all three study years and ranged from 2.9% to 5.2%. The effect size across all years was 0.34 (95% confidence interval 0.19-0.49); effect sizes ranged from .24 to.45 across the three study years. For the content related to the glycopeptide lecture that changed from traditional to active-learning in 2016, the number of correct items increased from a mean of 4.4 out of 6 to 5 out of 6 after incorporation of the active-learning approach (p<.001).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2.

Scores on Delayed Assessment by Relation to Content Delivery Method

Instructor ratings were high for the active-learning approach (mean scores for active learning instruction 4.5-4.8 out of 5, mean scores for traditional lecture instruction 4.1-4.4) and student comments about the active-learning approach and flower diagrams were overwhelmingly positive (representative comments noted in Table 3).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3.

Representative Student Comments on Active-Learning Sessions

DISCUSSION

Incorporating an active-learning approach into an antimicrobial pharmacology course led to a significant improvement in long-term performance on an assessment related to antimicrobial spectrum of activity compared to content delivered in a traditional lecture format. Performance on this assessment was subsequently predictive of performance on related therapeutics assessments independent of student overall GPA, emphasizing that mastery of this foundational knowledge is important preparation for clinical coursework.

Although the mean absolute percentage difference in assessment scores between groups was a modest 4.9%, the mean effect size of .34 is comparable to the effect of active learning interventions in the meta-analysis by Freeman and colleagues, as well as other well-established interventions in educational research, including reduced class size and test-taking practice.3,8,9 The costs of this approach were primarily the up-front investment of instructor time; the active-learning sessions required no more classroom time than that allotted for traditional lecture sessions. Compared to traditional lecture approaches, the active-learning approach requires more effort from students in terms of both prior preparation and active engagement in the classroom. Some studies have found student dissatisfaction with active-learning approaches, especially with the length of preparatory activities, lack of distinction between key and supplemental information, and insufficient instructor review of material prior to engagement in learning activities.4,10,11 In this study, student evaluations of the active-learning sessions were highly favorable. The preparatory activity consisted of a course reader, with essential points highlighted and embedded concept review questions. These features may have allowed students to prepare more efficiently for the session. During the in-class sessions, activities were preceded by brief mini-lectures (approximately 5 minutes). Because students were not required to review the material in advance, this approach may have helped less-prepared students orient to the material that formed the basis of the active-learning activities.

Besides promoting engagement with the material, students may have benefitted from the use of the flower diagrams as a cognitive schema in which to embed their knowledge. The flower diagrams incorporate two key dimensions that divide the spectrum of activity of antibacterials: cellular envelope characteristics (Gram-positive and Gram-negative) and prevalence of resistance mechanisms to the drug. Organizing knowledge into schema, as opposed to rote memorization, is characteristic of experts versus novices.12,13 The flower diagrams may also act as a cognitive scaffold and reduce the intrinsic cognitive load, by providing a fixed relationship of organisms to each other, allowing students to concentrate on the relationship between the drug and the organisms, and by sequencing of the drugs discussed, allowing students to focus on the differentiating characteristics between drugs rather than learning each in isolation.

Pharmacists play key roles in promoting the appropriate use of antimicrobial agents.14,15 Justo and colleagues surveyed graduating pharmacy students at 12 US schools of pharmacy and found that while 84% overall considered their education in antimicrobial use beneficial, there was wide variability among students at the schools in perceived value to their education of performing antimicrobial stewardship-related activities.16 Further, the mean score on an 11-item knowledge assessment related to antimicrobial use was only 5.8 (52.7% correct). This was numerically similar to that of a cohort of medical students completing the same instrument (5.6 items correct), despite that the medical students viewed their education regarding antimicrobial use as much less valuable (58% viewed it favorably).17 Thus, there may be a disconnect between pharmacy students’ views of their education regarding antimicrobials and their ability to recall and apply that information. Greater incorporation of active-learning activities such as the one described in this study into the antimicrobial curriculum in pharmacy schools may be one avenue for improving the ability of pharmacy students to retain and apply this knowledge in practice.

This study has several limitations. The number of items on the assessment was skewed toward active learning-related content out of proportion to the number of contact hours for active-learning versus traditional lecture content. This is primarily related to the large number of agents and significant clinical importance of beta-lactam antimicrobials, which represented the majority of items. The assessment only tested spectrum-related antimicrobial content, not content related to pharmacokinetics or adverse effects. Whether the active-learning approach would lead to similar gains in these domains is not known. The assessment tested knowledge approximately 10 weeks from the last course session; whether a similar effect would be noted at even longer-term follow up (eg, by graduation) is not known. Although students were required to complete the assessment, no stakes were attached to the outcome, which raises questions regarding performance and motivation. However, there is no reason to suspect this would lead to a difference in performance on the items regarding active-learning and traditional lecture.

The spectrum tool was developed over several years by the author and required approximately 40 hours of time in development and refinement. The tool is available to use for free and distribution under a Creative Commons license at the PharmAcademy website: http://pharmacademy.org/item/schematic-teaching-worksheet-learning-antimicrobial-spectrum-activity. An interactive Web-based version, also for open use, is under development. Instructors in antimicrobial pharmacology and therapeutics can use the tool to augment or replace their current methods for teaching antimicrobial spectrum of activity. The active-learning exercises required approximately four hours of development to integrate into the existing coursework, and were conducted during existing class time.

CONCLUSION

Teaching antimicrobial spectrum using an active-learning approach resulted in improved student performance on a delayed test of knowledge recall compared to a traditional lecture approach, and was associated with high levels of student satisfaction. Active-learning approaches may be a more effective means of ensuring students retain the increasing amount of pharmaceutical knowledge they are expected to master.

ACKNOWLEDGMENTS

The author thanks Tina Brock, EdD, MS, for her thoughtful review and commentary on the manuscript.

  • Received May 24, 2016.
  • Accepted September 18, 2016.
  • © 2017 American Association of Colleges of Pharmacy

REFERENCES

  1. 1.↵
    1. Custers EJ
    . Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ Theory Pract. 2010;15(1):109-128.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Benassi VA,
    2. Overson CE,
    3. Hakala CM
    . Applying Science of Learning in Education: Infusing Psychological Science Into the Curriculum. http://teachpsych.org/ebooks/asle2014/index.php. Accessed May 10, 2016.
  3. 3.↵
    1. Freeman S,
    2. Eddy SL,
    3. McDonough M,
    4. et al
    . Active learning increases student performance in science, engineering, and mathematics. Proc Natl Acad Sci. 2014;111(23):8410-8415.
    OpenUrlAbstract/FREE Full Text
  4. 4.↵
    1. Koo CL,
    2. Demps EL,
    3. Farris C,
    4. Bowman JD,
    5. Panahi L,
    6. Boyle P
    . Impact of flipped classroom design on student performance and perceptions in a pharmacotherapy course. Am J Pharm Educ. 2016;80(2):Article 33.
    OpenUrl
  5. 5.↵
    1. Mayer RE
    . Rote versus meaningful learning. Theory Pract. 2002;41(4):226-232.
    OpenUrl
  6. 6.↵
    1. Dellit TH,
    2. Owens RC,
    3. McGowan JE,
    4. et al
    . Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin Infect Dis. 2007;44(2):159-177.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Barlam TF,
    2. Cosgrove SE,
    3. Abbo LM,
    4. et al
    . Implementing an antibiotic stewardship program: guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. Clin Infect Dis. 2016;62(10):e51-e77.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Finn JD,
    2. Achilles CM
    . Answers and questions about class size: a statewide experiment. Am Educ Res J. 1990;27(3):557-577.
    OpenUrlCrossRef
  9. 9.↵
    1. Kulik JA,
    2. Kulik C-LC,
    3. Bangert RL
    . Effects of practice on aptitude and achievement test scores. Am Educ Res J. 1984;21(2):435-447.
    OpenUrlCrossRef
  10. 10.↵
    1. Khanova J,
    2. McLaughlin JE,
    3. Rhoney DH,
    4. Roth MT,
    5. Harris S
    . Student perceptions of a flipped pharmacotherapy course. Am J Pharm Educ. 2015;79(9):Article 140.
    OpenUrl
  11. 11.↵
    1. Rivkin A,
    2. Gim S
    . Student preferences regarding teaching methods in a drug-induced diseases and clinical toxicology course. Am J Pharm Educ. 2013;77(6):Article 123.
    OpenUrl
  12. 12.↵
    1. Ruiter DJ,
    2. van Kesteren MT,
    3. Fernandez G
    . How to achieve synergy between medical education and cognitive neuroscience? An exercise on prior knowledge in understanding. Adv Health Sci Educ Theory Pract. 2012;17(2):225-240.
    OpenUrlPubMed
  13. 13.↵
    1. Qiao YQ,
    2. Shen J,
    3. Liang X,
    4. et al
    . Using cognitive theory to facilitate medical education. BMC Med Educ. 2014;14:79.
    OpenUrlPubMed
  14. 14.↵
    ASHP statement on the pharmacist’s role in antimicrobial stewardship and infection prevention and control. Am J Health Syst Pharm. 2010;67(7):575-577.
    OpenUrlFREE Full Text
  15. 15.↵
    1. Ernst EJ,
    2. Klepser ME,
    3. Bosso JA,
    4. et al
    . Recommendations for training and certification for pharmacists practicing, mentoring, and educating in infectious diseases pharmacotherapy. Pharmacotherapy. 2009;29(4):482-488.
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Justo JA,
    2. Gauthier TP,
    3. Scheetz MH,
    4. et al
    . Knowledge and attitudes of doctor of pharmacy students regarding the appropriate use of antimicrobials. Clin Infect Dis. 2014;59(suppl 3):S162-S169.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Abbo LM,
    2. Cosgrove SE,
    3. Pottinger PS,
    4. et al
    . Medical students’ perceptions and knowledge about antimicrobial stewardship: how are we educating our future prescribers? Clin Infect Dis. 2013;57(5):631-638.
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

American Journal of Pharmaceutical Education
Vol. 81, Issue 2
25 Mar 2017
  • Table of Contents
  • Index by author
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Pharmaceutical Education.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
A Novel Teaching Tool Combined With Active-Learning to Teach Antimicrobial Spectrum Activity
(Your Name) has sent you a message from American Journal of Pharmaceutical Education
(Your Name) thought you would like to see the American Journal of Pharmaceutical Education web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
2 + 12 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
A Novel Teaching Tool Combined With Active-Learning to Teach Antimicrobial Spectrum Activity
Conan MacDougall
American Journal of Pharmaceutical Education Mar 2017, 81 (2) 25; DOI: 10.5688/ajpe81225

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
A Novel Teaching Tool Combined With Active-Learning to Teach Antimicrobial Spectrum Activity
Conan MacDougall
American Journal of Pharmaceutical Education Mar 2017, 81 (2) 25; DOI: 10.5688/ajpe81225
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • DESIGN
    • EVALUATION AND ASSESSMENT
    • DISCUSSION
    • CONCLUSION
    • ACKNOWLEDGMENTS
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

Similar AJPE Articles

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Investigating the Correlation Between Pharmacy Student Performance on the Health Science Reasoning Test and a Critical Thinking Assignment
  • Active-learning Strategies for Legal Topics and Substance Abuse in a Pharmacy Curriculum
Show more Teachers’ Topics

Related Articles

  • No related articles found.
  • Google Scholar

Keywords

  • active learning
  • antimicrobial agents
  • instructional design

Home

  • AACP
  • AJPE

Articles

  • Current Issue
  • Early Release
  • Archive

Instructions

  • Author Instructions
  • Submission Process
  • Submit a Manuscript
  • Reviewer Instructions

About

  • AJPE
  • Editorial Team
  • Editorial Board
  • History
  • Contact

© 2023 American Journal of Pharmaceutical Education

Powered by HighWire