Skip to main content

Main menu

  • Articles
    • Current
    • Early Release
    • Archive
    • Rufus A. Lyman Award
    • Theme Issues
    • Special Collections
  • Authors
    • Author Instructions
    • Submission Process
    • Submit a Manuscript
    • Call for Papers - Intersectionality of Pharmacists’ Professional and Personal Identity
  • Reviewers
    • Reviewer Instructions
    • Call for Mentees
    • Reviewer Recognition
    • Frequently Asked Questions (FAQ)
  • About
    • About AJPE
    • Editorial Team
    • Editorial Board
    • History
  • More
    • Meet the Editors
    • Webinars
    • Contact AJPE
  • Other Publications

User menu

Search

  • Advanced search
American Journal of Pharmaceutical Education
  • Other Publications
American Journal of Pharmaceutical Education

Advanced Search

  • Articles
    • Current
    • Early Release
    • Archive
    • Rufus A. Lyman Award
    • Theme Issues
    • Special Collections
  • Authors
    • Author Instructions
    • Submission Process
    • Submit a Manuscript
    • Call for Papers - Intersectionality of Pharmacists’ Professional and Personal Identity
  • Reviewers
    • Reviewer Instructions
    • Call for Mentees
    • Reviewer Recognition
    • Frequently Asked Questions (FAQ)
  • About
    • About AJPE
    • Editorial Team
    • Editorial Board
    • History
  • More
    • Meet the Editors
    • Webinars
    • Contact AJPE
  • Follow AJPE on Twitter
  • LinkedIn
Research ArticleINSTRUCTIONAL DESIGN AND ASSESSMENT

Using Radar Plots for Curricular Mapping to Visualize Assessment in a New Doctor of Pharmacy Program

Matthew R. Dintzner, Eric C. Nemec, Kim Tanzer and Beth Welch
American Journal of Pharmaceutical Education October 2015, 79 (8) 121; DOI: https://doi.org/10.5688/ajpe798121
Matthew R. Dintzner
Western New England University College of Pharmacy, Springfield, Massachusetts
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eric C. Nemec II
Western New England University College of Pharmacy, Springfield, Massachusetts
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kim Tanzer
Western New England University College of Pharmacy, Springfield, Massachusetts
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Beth Welch
Western New England University College of Pharmacy, Springfield, Massachusetts
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Objective. To initiate mapping of the curriculum to the core competencies of our program and to develop a novel and visually accessible method for communicating data to all stakeholders.

Design. An online survey was developed to gauge the extent to which instructors and students perceive that courses within the curriculum and assess students’ ability to achieve each of the 10 core competencies. Response data were collected and processed as radar plots in Microsoft Excel.

Assessment. Response rate for faculty members was 100% and 86%for students. Radar plots provided images of the relative extent to which each course surveyed was perceived to contribute to core competencies.

Conclusion. Using radar plots to present perception data is visually descriptive, makes patterns/trends readily apparent, and facilitates the development of an ongoing culture of assessment.

Keywords
  • assessment
  • curriculum
  • mapping

INTRODUCTION

Curricular mapping is the process of making connections between the curriculum and other components of a program, such as its mission and competencies.1 It is a way of making the curriculum more transparent to stakeholders and may be used to inform the development of a comprehensive assessment plan.2 Many innovative approaches to the process of curricular mapping are reported in the literature, including a graphical technique by Plaza and colleagues.3

As a new program, and in anticipation of the Accreditation Council for Pharmacy Education’s renewed emphasis on assessment (ACPE 2016 Standards) and in the wake of the launch of the Center for the Advancement of Pharmacy Education (CAPE) 2013 Learning Outcomes,4 we recognized an opportunity to identify and incorporate existing best practices of curricular mapping into the development of a comprehensive assessment plan, while putting our own spin on the mapping process.

The doctor of pharmacy (PharmD) program of Western New England University is built on a mission to prepare entry-level practitioners to provide pharmacy care to a diverse population in a variety of settings. The mission is supported by a set of institutionally defined core competencies that represent the knowledge, attitudes, and abilities graduates are expected to demonstrate upon completing the program. There are 10 core competencies, 5 of which are considered general, and 5 that are considered professional. Each competency is defined by learning outcomes (87 in all; see Appendix 1).5 The program is delivered, in part, through the curriculum (Appendix 2), and mapping the curriculum to the competencies through the learning outcomes is a way to assess alignment between the curriculum and the mission (Figure 1).6

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Concept map of program design and alignment between the mission and curriculum.

Assessment and mapping are important components of curricular validation. Arguably, all faculty members are stakeholders regarding content and delivery of a curriculum. However, functionally, not all faculty members are engaged in the idea and process. Radar plots provide clear visual maps of where faculty members’ materials lie within the curriculum, which allows for quick gap analyses. Thus, the primary objectives of this project were to initiate the process of mapping the curriculum to the core competencies of our new program and to develop a novel and visually accessible method for communicating the data to stakeholders by using radar plots.7

DESIGN

Inspired by the term “mapping,” which implies a graphical representation of information using spatial relationships to represent relationships within the data, we developed a visual approach to the curriculum mapping process through the use of radar plots.8 Radar plots are 2-dimensional graphs designed to plot one or more series of values over multiple common quantitative variables by providing an axis for each variable, arranged radially as equiangular spokes around a central point. Radar plots are circular rather than linear, and when the plotted variables are connected with a line, an enclosed shape results, making the data more visually accessible than when displayed in a tabular format. While not appropriate for displaying all types of quantitative data, radar plots are well-suited for efficiently displaying a wide variety of data (and patterns within the data) in a single image.9 With regard to curricular mapping, radar plots provide a convenient way to visualize how individual courses contribute to the programmatic “big picture.” For example, consider the radar plots shown in Figure 2 that map 3 hypothetical courses (A, B, and C) to 10 core competencies (I-X). The radial axes correspond to a 4-point Likert scale representing the average level at which the courses are perceived by instructors to assess learning outcomes associated with a given competency as follows: 0=outcome is not assessed; 1=outcome is assessed at an introductory/foundational level as part of a classroom session, assignment, or examination; 2=outcome is assessed at a higher level as part of a classroom session, assignment, or examination; 3=outcome is assessed in an experiential or simulated setting. The resulting enclosed shapes provide a convenient visual representation of how each course maps to the core competencies. One can see at a glance that course B is perceived to target fewer competencies than course A, and that course C appears to target all 10 competencies to the fullest extent. The same data displayed in a tabular format (Table 1) are not nearly as visually descriptive as the corresponding radar plots. Accordingly, as a way of initiating the curricular mapping process and determining where within the curriculum each of the 10 competencies are thought to be assessed, we surveyed the faculty members.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Sample rader plot of hypothetical courses A,B, and C mapped to the 10 Core Competencies.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1.

Mapping Data for Three Hypothetical Courses

EVALUATION AND ASSESSMENT

An online survey instrument was developed to gauge instructors’ perceptions of the extent to which all required courses within the curriculum assess the learners’ ability to perform the 87 learning outcomes associated with each of the program’s 10 core competencies.10 The survey instrument consisted of 87 learning outcome statements and a 4-point Likert scale indicating the extent to which each outcome was thought to be assessed in a given course. The 4-point Likert scale was developed simply to help us get a “lay of the land” at this phase of our assessment plan.

The survey was administered electronically to instructors of record for all required courses in the curriculum through SurveyMonkey (SurveyMonkey, Palo Alto, CA), and it had a 100% response rate (48 surveys administered with 48 responses). Response data were exported to Microsoft Excel, where they were condensed by averaging the results for the learning outcomes associated with each of the 10 competencies. The calculated average scores for each competency then were used to generate radar plots in Microsoft Excel for each course similar to those shown in Figure 3.

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

Rader plots of two representative courses (PHAR 510 and 612) mapped to the 10 Core Competencies.

The resulting plots were analyzed qualitatively to identify trends, gaps, and overlaps. We administered a similar survey to a sample of learners to ascertain alignment between instructors’ and students’ perceptions. Volunteers were solicited from the classes of 2016 and 2017. The first 10 respondents from each cohort were sent a link to the survey for 3 different courses and given one week to complete it. The data were worked up and analyzed as described above. We chose to survey only a sample of students for a few selected courses simply to gauge alignment. Administering an 87-question survey to all students for all courses would have been not only prohibitively demanding, but also beyond the scope of this project. This work received exempt status from the Western New England University Institutional Review Board.

DISCUSSION

While it is not the objective of this article to present a rigorous analysis of our curriculum, as perception data alone are not sufficient to directly assess achievement of competencies, what follows is a brief discussion of some of the trends that we were able to spot with our radar plots.

Sample radar plots are shown in Figure 3 for 2 representative courses based on instructors’ perceptions of the learning outcomes assessed in those courses. Different courses target different core competencies and, therefore, generate their own shapes on the radar plot. For example, Introduction to Pharmacy is perceived to most significantly assess the core competency Active Citizenship and Leadership, while Principles of Medicinal Chemistry targets core competencies Thinking and Learning and Knowledge Base.

We observed that similar courses, such as those in the physical sciences, target similar competencies and generate similar-looking shapes on the radar plot (Figure 4). The maps in Figure 5 show that core competencies Thinking and Learning and Knowledge Base are perceived to be emphasized in these courses and that the course Genetics and Genomics also is perceived to target the core competencies Social and Cultural Awareness, Ethical and Legal Judgment, and Communication, as might be expected.

Figure 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 4.

Radar plots of physical science courses mapped to the 10 Core Competencies.

Figure 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 5.

Radar plot of Core Competency I (Thinking and Learning) mapped to all courses (shown as course numbers around the perimeter of the plot).

In addition to mapping individual courses to all of the core competencies, we mapped all courses or groups of courses to a single competency. For example, in order to determine which courses within the curriculum are thought to emphasize Thinking and Learning, a radar plot such as the one shown in Figure 5 was generated. In this single image, we could pinpoint which courses were perceived to contribute most significantly to this competency.

Radar plots also are useful for assessing progression from year to year or for sequences of courses meant to build on one another, as we observed for first-year and second-year professional development courses. For these courses, 2 instructors completed the survey instrument separately, with results suggesting a perceived natural progression toward the same set of core competencies (I-V, Figure 6). Moreover, when a course series (eg, course 1 and subsequent course 2) is analyzed, an instructor can visualize the extent to which the continuation enhances learning outcomes in the second offering.

Figure 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 6.

Radar plot showing perceived progression in sequenced courses.

Although we were primarily interested in instructors’ perceptions at this stage of our assessment project, we also surveyed a sample of learners. For most courses for which the students completed the survey, including Practice Management I (Figure 7), we observed reasonably good alignment (defined as gross visual overlap in the radar plot) between instructor and student perceptions with regard to which core competencies were assessed. Generally, students perceived they were being assessed at a higher level relative to instructors’ perceptions (Figure 7). The observed gap between the perception of learners and that of instructors was significant (p<0.05), which we reasoned was likely because of the learners’ limited perspective of the big picture.11 However, the visual cue of overlap is the key message when analyzing the radar plot.

Figure 7.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 7.

Radar plot showing alignment of learner and instructor perception for the course Practice Management I.

Ultimately, this mapping process provided indirect evidence that all 87 learning outcomes were assessed in at least one course or practice experience within the curriculum. No gaps were detected, and no 2 courses were identically mapped to the learning outcomes and core competencies (ie, no unnecessary duplication was observed). Thus, the first 3 years of the curriculum (mainly didactic courses) provide learners with opportunities to establish a solid foundation in the core competencies, while the fourth-year curriculum (mainly experiential) is perceived to assess the learners at a higher level, especially for core competencies Patient-Centered Pharmaceutical Care, Populations-Based Pharmaceutical Care, Systems Management, and Public Health and Wellness, which more heavily involve the psychomotor domain of learning (“doing”). We will use this knowledge to guide the next phase of our assessment plan: direct assessment of student learning. For this, we also intend to use radar plots to assess alignment between what we perceive the students are learning and what they are actually learning.

CONCLUSION

Using radar plots to present perception data is visually descriptive and shows patterns/trends that may facilitate the development of an ongoing culture of assessment. As a result of using radar plots, we have a sense of where and to what extent the core competencies are being assessed within the curriculum.

Appendix

View this table:
  • View inline
  • View popup
  • Download powerpoint
Appendix 1.

Core Comps and Learning Outcomes

Appendix

View this table:
  • View inline
  • View popup
  • Download powerpoint
Appendix 2.

Western New England University College of Pharmacy Curriculum

  • Received September 2, 2014.
  • Accepted December 8, 2015.
  • © 2015 American Association of Colleges of Pharmacy

REFERENCES

  1. 1.↵
    1. Harden RM
    . AMEE Guide No. 21: Curriculum mapping: a tool for transparent and authentic teaching and learning. Med. Teach. 2001;23:123-137.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Kelley KA,
    2. McAuley JW,
    3. Wallace LJ,
    4. Frank SG
    . Curricular mapping: process and product. Am J Pharm Educ. 2008;72(5):Article 100.
  3. 3.↵
    1. Plaza CM,
    2. Draugalis JR,
    3. Slack MK,
    4. Skrepnek GH,
    5. Sauer KA
    . Am J Pharm Educ. 2007;71:Article 20 (and references therein).
  4. 4.↵
    https://www.acpe-accredit.org/deans/StandardsRevision.asp. Accessed September 2, 2014.
  5. 5.↵
    1. Mort JR,
    2. Houglum JE,
    3. Kaatz B
    . Use of outcomes in the development of an entry-level PharmD curriculum. J Pharm Educ. 1995;59:327-33.
    OpenUrl
  6. 6.↵
    1. Ried LD
    . A model for curricular quality assessment and improvement. Am J Pharm Educ. 2012;75:Article 196.
  7. 7.↵
    1. Dintzner MR,
    2. Nemec EC
    . Use of radar plots for curriculum mapping, (abstract). Am J Pharm Educ. 2014;78(5):Article 11.
  8. 8.↵
    1. Budsaba K,
    2. Smith CE,
    3. Riviere JE
    . Compass plots: a combination of star plot and analysis of means to visualize significant interactions in complex toxicology studies. Toxicol Mech Methods. 2000;10:313-32.
    OpenUrl
  9. 9.↵
    1. Saary MJ
    . Radar plots: a useful way for presenting multivariate health care data. J Clinical Epidemiology. 2008;60:311-317.
    OpenUrl
  10. 10.↵
    1. Draugalis JR,
    2. Coons SJ,
    3. Plaza CM
    . Best practices for survey research reports: a synopsis for authors and reviewers. Am J Pharm Educ. 2008;72(2):Article 43.
  11. 11.↵
    1. Naughton CA,
    2. Friesner DL
    . Comparison of pharmacy students’ perceived and actual knowledge using the pharmacy curricular outcomes assessment. Am J Pharm Educ. 2012;76(4):Article 63.
PreviousNext
Back to top

In this issue

American Journal of Pharmaceutical Education
Vol. 79, Issue 8
25 Oct 2015
  • Table of Contents
  • Index by author
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Pharmaceutical Education.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Using Radar Plots for Curricular Mapping to Visualize Assessment in a New Doctor of Pharmacy Program
(Your Name) has sent you a message from American Journal of Pharmaceutical Education
(Your Name) thought you would like to see the American Journal of Pharmaceutical Education web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
16 + 0 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Using Radar Plots for Curricular Mapping to Visualize Assessment in a New Doctor of Pharmacy Program
Matthew R. Dintzner, Eric C. Nemec, Kim Tanzer, Beth Welch
American Journal of Pharmaceutical Education Oct 2015, 79 (8) 121; DOI: 10.5688/ajpe798121

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Using Radar Plots for Curricular Mapping to Visualize Assessment in a New Doctor of Pharmacy Program
Matthew R. Dintzner, Eric C. Nemec, Kim Tanzer, Beth Welch
American Journal of Pharmaceutical Education Oct 2015, 79 (8) 121; DOI: 10.5688/ajpe798121
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • DESIGN
    • EVALUATION AND ASSESSMENT
    • DISCUSSION
    • CONCLUSION
    • Appendix
    • Appendix
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

Similar AJPE Articles

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Transformation of an Online Multidisciplinary Course into a Live Interprofessional Experience
  • Enhancing Student Communication Skills Through Arabic Language Competency and Simulated Patient Assessments
  • Using Patient Case Video Vignettes to Improve Students’ Understanding of Cross-cultural Communication
Show more Instructional Design and Assessment

Related Articles

  • No related articles found.
  • Google Scholar

Keywords

  • assessment
  • curriculum
  • mapping

Home

  • AACP
  • AJPE

Articles

  • Current Issue
  • Early Release
  • Archive

Instructions

  • Author Instructions
  • Submission Process
  • Submit a Manuscript
  • Reviewer Instructions

About

  • AJPE
  • Editorial Team
  • Editorial Board
  • History
  • Contact

© 2022 American Journal of Pharmaceutical Education

Powered by HighWire