Abstract
Objective. To assess how curriculum committees at US schools and colleges of pharmacy have evolved since 2011 regarding their responsibilities, structures, functions, charges, and activities.
Methods. A total of 133 fully accredited schools and colleges of pharmacy were included in the survey. Data collection occurred between March and September 2020, and survey questions pertained to academic year 2019-2020. Data were collected on committee membership, leadership, functions, and charges. New questions explored ties to assessments and Standards 2016. Analysis included descriptive statistics and comparisons to the 2011 survey results.
Results. The response rate was 80%; one partial response was excluded from analysis. Most schools and colleges (93%) rely on a curriculum committee to provide curriculum oversight. Faculty and students remain the most frequent types of members, but increases have occurred in the number of committees with members from other areas, including experiential programs, staff, directors, librarians, and pharmacy residents. Committee charges have increased beyond the traditional activities of curriculum planning, mapping, and review to include newer tasks. In one-third of the institutions, the primary responsibility for various assessment activities is shared by both committees.
Conclusion. Curriculum committees remain a key part of pharmacy education but continue to evolve to meet their responsibilities related to new and increasing numbers of charges and to find ways to communicate and share duties with their assessment counterparts. Based on these findings, recommendations include having clear guidance for curriculum committees and reducing the frequency of their scheduled work to ensure they will be able to address new challenges as they emerge.
INTRODUCTION
Pharmacy education is constantly evolving to incorporate new standards and innovations. Within schools and colleges of pharmacy, these changes are primarily implemented by curriculum committees. 1, 2 An initial survey of curriculum committees was conducted in 1995, followed by one in 2011. 1, 2 Since 2011, many changes to pharmacy education have occurred; for instance, in 2013 the Center for the Advancement of Pharmacy Education (CAPE) outcomes were expanded to include the affective domain. 3 These CAPE outcomes were then integrated into the Accreditation Council for Pharmacy Education (ACPE) revised accreditation standards (Standards 2016) as Standards 1 through 4. 3, 4 Standards 2016 and its guidance document also increased emphasis on interprofessional education, the Pharmacists’ Patient Care Process (PPCP), and cocurricular activities. 4, 5 The pharmacy Academy has promoted additional curricular considerations such as entrustable professional activities. Standards 2016 also made the Pharmacy Curriculum Outcomes Assessment (PCOA) a mandatory standardized assessment for students to complete prior to advanced pharmacy practice experiences (APPEs). In addition, the role of assessing curricula has been slowly migrating to assessment committees, with some curriculum committees still actively involved in curricular assessment. 6, 7
This survey is the third in a series of studies used to describe curriculum committees at schools and colleges of pharmacy. In 1995, curriculum committees focused on implementing the PharmD program, and efforts shifted to integrating and adding courses. 1 In 2011, curriculum committees responded to new ACPE standards by adding experiential content, developing curriculum competencies, and assessing student outcomes. 2 Recommendations based on the 2011 results involved optimizing the diversity of curriculum committee membership and length of service. The goal of this third study is to assess how the responsibilities, structure, functions, charges, and activities of curriculum committees have evolved since 2011.
METHODS
The study used survey methods to gather information from US schools and colleges of pharmacy regarding their curriculum oversight practices. The sampling frame consisted of 133 programs that were fully accredited during the data collection period. At each of the colleges, individuals most familiar with curriculum committees were identified through websites, AACP rosters, or by administrators at their institutions. Each potential respondent received an invitation email with an attached cover letter and copy of the questionnaire; this was followed by up to three reminders. The data collection period was March through August 2020. Respondents could use either an online Qualtrics (Qualtrics International Inc) questionnaire or a Word file they could return via email. The study design was approved by both campus’s institutional review boards.
The questionnaire was based on the instrument used in the 1995 and 2011 surveys of curriculum committees. 1, 2 The items were reviewed and updated by changing or deleting some response options and adding several new items related to Standards 2016. 4, 5 The questionnaire contained 32 items, where most were close-ended questions and several were open-ended questions. Response options included selecting one or more choices, using a rating scale with five levels (where one was the lowest rating), and completing open-ended fill-in responses; most questions also included an “other” option. The questionnaire explored the structure and membership of the committee, its charges and functions, curriculum oversight responsibilities, and the curriculum committee’s association with an assessment committee. Respondents were asked to recall and describe their institution’s curriculum committee during the 2019-2020 academic year.
Responses were compiled into an Excel spreadsheet. Descriptive statistics produced frequencies, ranges, and means. Chi-square tests were used to compare the proportions and means of the pharmacy schools’ status (public or private), number of years since they were established, and differences between 2011 and 2020 data. 8 Significance for statistical tests was set a priori at p<.05 per test.
RESULTS
The survey response rate was 80% but was adjusted to 79% after removing one partially completed questionnaire from analysis. Responders and nonresponders had similar institutional characteristics regarding the proportions of public institutions (51% and 48%, p=.79), private institutions (49% and 52%, p=.79), and the mean (SD) years since they were established, 70.6 (56.3) and 70.58 (61), p>.99, respectively.
Most programs (58%) were organized in traditional quarter- or semester-long courses, 29% offered a combination of traditional and shorter block-style courses, and 12% used only block courses, which is a significant increase from the 4% that used block courses in 2011 (p=.049). Almost all programs (93%) charged their curriculum committee with curricular oversight, sometimes in collaboration with an assessment committee, academic affairs office, or an academic dean (3%). Rarely was oversight the sole responsibility of an academic affairs committee (3%) or a curriculum office (1%).
The curriculum committee was the only entity to address curricular topics in 43% of programs, down from 70% in 2011 (p<.001). Less frequently, the curriculum committee shared responsibility for curricular matters with the administration (34%) or assessment committees or directors (13%). For a small fraction of programs, some curricular topics were addressed by committees that focused on specific courses or course sequences (6%), ad hoc curriculum review or revision committees (4%), interprofessional education committees (5%), cocurricular committees (4%), the experiential education office (3%), and the full faculty (2%). Individual programs listed other entities that address curricular topics: student services, university curriculum committees, continuing professional development coordinators, and committees focused on cultural diversity, teaching, or student well-being.
Regarding the structure of curriculum committees, they tended to be led by a single chair (80%), two cochairs or vice chairs (14%, which represents a significant increase from 1% in 2011, p=.001), or a single vice chair (1%). Faculty most frequently served in the leadership position (91%), but to a lesser degree than in 2011 (99%, p=.016), followed by assistant and associate deans (7%) or combinations of a chair and an academic affairs administrator (2%). Some of the faculty chairs (9%) also had additional administrative roles, usually in academic affairs (no significant decrease from 2011).
Appointments to curriculum committee chair were made by either the dean (57%), members of the curriculum committee (32%), or by assistant/associate deans (9%). The deans’ appointments were often guided by input from executive committees or department heads. Two percent of the committee chairs were elected by faculty. The chairs served a mean (SD) of 2.5 (2.9) years, with terms ranging from less than one year to 13 years; this did not significantly differ from 2011 (p=.27).
The curriculum committee size ranged from seven to 27 members with a mean (SD) of 14.5 (4.2) members, which is a significant increase from the 2011 mean (SD) of 10.6 (3.8) (p<.001). Most committees’ members included faculty (100%), students (94%), and assistant or associate deans (92%), which was not significantly different from 2011. There was a significant increase in other types of members, from 39% in 2011 to 54% in 2020 (p = .041). Voting status varied by member type, with faculty and students having the highest percentages of voting members, and these percentages have not changed from 2011. Department chairs with voting status did decrease from 80% to 53% (p=.026). Table 1 lists committee members by type and voting status. The length of service for committee members ranged from one to six years, with some colleges allowing a second term or an indefinite appointment. Reappointments occurred annually (31%), every two years (24%), every three years (29%), or every six years (14%). In some programs, the curriculum committee members and chairs served different term lengths.
Curriculum Committees at US Schools and Colleges of Pharmacy With One or More Members in Each Category by Total and Voting Status Subsets in 2011 and 2020
Like curriculum committee chairs, faculty members were most frequently appointed to the curriculum committee by their dean (87%), usually upon being recommended by executive committees, assessment deans, or department chairs (76%). For some programs, faculty members were selected by their peers as a whole or as a department (16%) or through self-nomination, input by a “committee on committees,” or a recommendation by the curriculum committee chair (12%). Faculty members were selected based on department affiliation (91%), willingness to serve (75%), workload (74%), area of expertise (41%), years of service (38%), and rank or tenure status (22%). Three programs also considered selections based on core course coordination, campus location, and current or prior service on the committee.
Student members were selected based on their response to a call to participate (53%), appointment by the dean (34%), nomination by classmates (25%), and invitation by committee members (18%) or faculty members (3%). In a few programs, student members were also elected by their classmates or selected by their student council, class officers, class advisor, or student affairs director.
Preferred qualities in committee members were commitment to the program’s mission (68%), objectivity (46%), educational experience (33%), and vision (18%); these four were the top qualities selected in both prior surveys. Other qualities identified were interest in teaching (17%), leadership (12%), willingness to be engaged and actively participate (6%), dependability (1%), teamwork skills (1%), and an understanding of educational theory (1%).
Most committees met monthly (72%) or every two weeks (19%). The use of monthly meetings significantly increased from 33% in 2011 (p<.001), while the use of meetings every two weeks was unchanged. Some committees met at least once a semester (5%) or weekly (3%). Six percent of the committees with regularly scheduled meetings indicated that they also had additional meetings as needed. The use of as-needed meetings only instead of scheduled meetings dropped from 27% in 2011 to 2% in 2020 (p<.001).
Regarding the functions of curriculum committees, annual charges were assigned to 89% of curriculum committees during the 2019-2020 academic year. Charges were received from the dean or associate dean (75%), the curriculum committee itself (39%), via standing charges (38%), or an executive committee (5%). Curriculum committees often received charges from multiple sources (44%).
Current charges for the curriculum committees included reviewing or mapping the curriculum (55%), adding or revising courses (51%), evaluating courses (51%), and reviewing or restructuring committee policies and practices (36%). Rates were similar to 2011 levels for curriculum review and course evaluation, but higher in 2011 for adding/revising courses (70%, p=.009) and restructuring policies (2%, p<.001). Table 2 lists the top charges for the 2019-2020 academic year and the next academic year (2020-2021).
Percentage of Curriculum Committees with Charges in Academic Year 2019-2020 and in the Subsequent Academic Year 2020-2021 Grouped by Category
While the charges indicated specific foci for the year, curriculum committees generally have the following responsibilities: reviewing proposals for new courses (96%), ensuring the curriculum meets ACPE standards (95%), reviewing and revising the entire curriculum (91%), performing systematic reviews of didactic courses (87%), reviewing the timing/placement of courses within the curriculum (82%), ensuring new information is added to the curriculum (74%), ensuring integration of topics across courses (64%), conducting systematic reviews of the experiential courses (63%), reviewing credit hours (57%), and changing content (53%). These frequencies are similar to the 2011 list of functions. Some curriculum committees were also responsible for promoting innovative teaching (37%), organizing the co-curriculum (29%), handling student and faculty curriculum grievances (27% and 25%, respectively), and monitoring the use of examinations (8%); these functions were not measured in 2011. Very few curriculum committees were also involved in approving and reviewing certificate or dual degree programs, updating and reviewing the curriculum map, and reviewing course policies such as remediation or attendance.
Course changes that would prompt curriculum committee involvement were credit hour adjustments (96%), elective course proposals (92%), changes to prerequisites (77%), and addition (61%) or deletion (64%) of curricular content. In some programs, a 10%-25% change in course content required the curriculum committee’s involvement. Committees were also involved when changes affected instructional methods (34%), assessment methods (12%), course objectives (12%), course coordinator assignment (12%), or when the change would impact other courses or mapped content (11%). A few curriculum committees were responsible for reviewing and approving changes to a course name, focus, and catalog information.
In academic year 2019-2020, curriculum committees implemented curriculum revisions (42%), conducted full curriculum reviews (21%), planned revisions (14%), planned to do a major review in the next five years (14%), or had no plans to review their curriculum within the next five years (7%).
Curriculum committees performed systematic and scheduled reviews of individual pharmacy courses every three years (21%), every four years (19%), annually (16%), every five years (5%), every two years (4%) or using a variable schedule depending on type of course (10%). The rest did their individual course reviews on an as-needed basis (25%). There were significant increases from 2011 to 2020 in the systematic reviews of required lecture-based courses (63% to 100%, p<.001); required laboratory courses (57% to 99%, p<.001), and required experiential IPPE/APPE courses (35% to 66%, p<.001). Review of elective courses by 38% of curriculum committees was not significantly different from 2011. Two curriculum committees were reviewing all courses as part of implementing a new curriculum, while another was monitoring tracks within their program.
Data used for course reviews came from syllabi (88%), student evaluations (68%), student examination scores (55%), contributions to student outcomes (46%), formative, high-stakes assessments (40%), assignments (36%), feedback from IPPE/APPE preceptors (34%), standardized assessments (31%), and faculty peer course evaluations (18%). Some curriculum committees also used faculty self-evaluations and reflections (8%), overall course grades (6%), and reviews of lecture and assessment materials (5%). Two programs had faculty review their own course evaluations from peers and students instead of asking the curriculum committee to do it. Individual curriculum committees reported using published sources such as white papers, 9 survey results from pharmacy organizations, 10 and accreditation standards. 4
On a five-point scale, mean (SD) faculty conservatism and reluctance to change was 2.8 (1.2), which was rated, once again, as the greatest barrier to curriculum committee effectiveness. The next greatest barrier was a reliance on “quick fixes” and not long-term change, which received a mean (SD) rating of 2.2 (1.2). In 2011, the mean (SD) for faculty conservatism was 3.0 (1.2), whereas the next barrier was departmental autonomy, rated with a mean (SD) of 2.8 (1.3). Table 3 compares the average (SD) ratings for barriers to curriculum committee effectiveness in 2011 and 2020, and it shows significant reductions in barriers related to departmental autonomy, lack of interdisciplinary collaboration, and lack of authority of the curriculum committee.
Pharmacy Curriculum Committee Ratingsa of Barriers to Committee Effectiveness on Surveys in 2011 and 2020
Regarding CAPE outcomes, most respondents (97%) linked their student outcomes to the CAPE domains through mapping to (39%), adoption of (31%), or integration with (25%) the CAPE domains. Two respondents (2%) used multiple methods to align student outcomes with CAPE domains. The process of mapping student outcomes to Standards 2016 domains was an ongoing process for many curriculum committees with varying degrees of completion, as shown in Table 4. Of all committees, 40% had a nearly completed mapping their curriculum to the 15 domains in Standards 1, 2, 3, and 4 plus the PPCP, teamwork, and co-curriculum elements, while another 16% were more than halfway done mapping to all categories. Twenty-eight percent of committees were close to done mapping most but not all the domains and elements (ie, 12-15 domains completed), and 23% had fully mapped to fewer than four of the domains. Two curriculum committees indicated no intention of mapping their curriculum to any of the domains.
Committees Reporting Near Completion of Mapping These Standards in 2020
Regarding how curriculum committees worked with assessment committees, the most common mode of communication between the curriculum committee and those responsible for assessment was to have a member of one committee attend the meetings of the other group (86%). Of these, 57% of the programs sent a representative to each other’s committee meetings, 39% sent an assessment member to the curriculum meeting, and 3% sent a curriculum representative to assessment meeting. Other communication modes between curriculum and assessment were holding a separate meeting between designated members of the two oversight groups, usually the chairs (46%), exchanging meeting minutes (13%), using an administrator that linked both groups (8%), or holding joint meetings between the full membership of the two groups (7%). No mechanism of communication was reported when a single group was responsible for both curriculum and assessment matters (3%) or when the assessment oversight group did not exist or was newly formed (2%).
The curriculum committees continued to be involved in many curriculum assessment activities, although this was most often done in collaboration with the assessment committee (Table 5). Assessment of interprofessional education was the only area for which more curriculum committees (42%) had primary responsibility rather than shared responsibility (38%). More than half of curriculum committees had responsibility for assessments related to content or structure of the program, such as the co-curriculum, entrusted professional activities, student course/instructor evaluations, and APPE readiness, but this responsibility was commonly shared with the assessment committee. Conversely, fewer than half of the curriculum committees were involved in outcomes-oriented assessments, such as high-stakes examinations, licensing examinations, graduating student surveys, AACP quality surveys, 10 or the Pharmacy Curriculum Outcomes Assessment (PCOA). 11 Here, the primary responsibility was more frequently assigned to the assessment committee (33%-66%) or shared (22%-39%). Other entities such as assessment or academic affairs deans or offices were frequently assigned primary responsibility for assessment activities.
Committees With Primary Responsibility for Assessment Activities (n=105)
DISCUSSION
Regarding the structure of curriculum committees, they have increase in size and diversity of membership compared to the 2011 study. 2 Reasons for this shift in membership may be due in part to the increasing need for the committee to work with other services and departments on campus to fulfill accreditation standards. The length of time members served was unchanged from 2011, although increasing this length was a recommendation. Faculty continue to be the most common choice for curriculum committee chairs, and methods for identifying and assigning curriculum committee chairs and members remain largely unchanged; however, the use of cochairs has increased. Reasons for this increase are not clear but may be related to efforts to share what appear to be increasing workloads or, perhaps, to help smooth transitions in leadership if such appointments are staggered.
In 2020 compared to 2011, more curriculum committees reported having regularly scheduled meetings with fewer meetings on an as-needed basis; the use of monthly meetings increased. Reasons for the shift to monthly meetings could be the increased number of functions curriculum committees have and the need to have scheduled meetings so the members of the larger, diverse curriculum committees can plan on set meeting dates and times.
It is evident from the lists of charges and functions that curriculum committees are addressing more curricular issues than in previous years. Some of this expanded workload can be tied to efforts to meet accreditation requirements; some is related to the increased attention on specific areas within the Academy, such as assessing competency achievement and incorporating EPAs. 12-14 Surprisingly, committees were not as focused on addressing interprofessional education or the co-curriculum, given their importance in the ACPE standards. It is possible that the co-curriculum is being addressed by other entities, since it is technically not part of the curriculum, and interprofessional education may be organized at a higher level on campus.
Faculty reluctance to change has remained the largest barrier to curriculum committees’ effectiveness across all three survey studies. 1, 2 Of the nine new barriers identified in the current study, lack of member engagement and lack of curriculum guidelines stood out. The lack of member engagement is a surprising barrier given the sizable workload required to systematically review courses. Perhaps not all curriculum committee members are making equitable contributions, which could be one explanation. A lack of curriculum guidelines is concerning given the importance of promoting consistency in curricular delivery and assessment, but this may be changing, as updating curriculum committee guidelines was one of the charges listed by respondents.
The finding that half of the curriculum committees have not yet completely mapped their curriculum to all of the domains is surprising, considering that the ACPE standards were published five years ago and the CAPE outcomes were published eight years ago. 3, 4 Of note, a lack of progress in mapping certain domains or additional elements does not mean a program lacks coverage of them in its curriculum. Rather, the issue might be that the curriculum committee has too large a workload, leading to delays in completing such tasks, or that the curriculum committee needs better guidance on how to approach such tasks.
Consistent with the 2011 study, assessment committees remain separate from curriculum committees at many schools and colleges of pharmacy. As a result, identifying who is responsible for a given assessment and how the committees communicate are additional considerations for curriculum committees. A closer inspection reveals that curriculum committees still tended to take primary responsibility for internal assessments that most directly relate to the curriculum structure and processes, whereas responsibility for more outcomes-oriented, external assessments tended to be primarily with the assessment committees. These findings are consistent with a recent survey in which half of the pharmacy programs surveyed estimated that 20% or more of the curriculum committee’s time is devoted to assessment activities. 7
The CAPE outcomes and ACPE standards will be revised in the next few years, which will likely impact curriculum committees’ work. Based on this knowledge and the survey results presented here, it may be a good time to ensure that curriculum committees have clear guidance regarding their functions and charges to review membership and member involvement in their work and to find ways to reduce the frequency of scheduled reviews and other work to ensure there is time for addressing new curricular issues.
The potential limitations to this study are similar to those in the previous 2011 study. 2 First, this study involved survey research, and the curriculum committee chairs were the only responders to the survey. While the curriculum committee chairs likely answered the survey questions honestly and accurately and their answers were reflective of the entire committee, it is possible that their recollections may differ from their committee members. A second limitation is that some questions required the curriculum committee chair to recall information from the past year, which may have introduced recall bias. Relatedly, the study questionnaire was distributed to curriculum committee chairs during the early stages of the COVID-19 pandemic and the chairs may have been under stress, which may have also affected their recall. Finally, although the research team evaluated all study questions and options for clarity, some questions may have been misinterpreted by the curriculum committee chairs.
CONCLUSIONS
Curriculum committees remain a key part of pharmacy education but continue to evolve to meet their responsibilities for new and increasing numbers of charges and to find ways to communicate and share duties with their assessment counterparts. Recommendations include having clear guidance for curriculum committees and reducing the frequency of scheduled work to ensure curriculum committees will be able to address new challenges as they emerge.
- Received May 25, 2021.
- Accepted November 10, 2021.
- © 2022 American Association of Colleges of Pharmacy