Skip to main content

Main menu

  • Articles
    • Current
    • Early Release
    • Archive
    • Rufus A. Lyman Award
    • Theme Issues
    • Special Collections
  • Authors
    • Author Instructions
    • Submission Process
    • Submit a Manuscript
    • Call for Papers - Intersectionality of Pharmacists’ Professional and Personal Identity
  • Reviewers
    • Reviewer Instructions
    • Call for Mentees
    • Reviewer Recognition
    • Frequently Asked Questions (FAQ)
  • About
    • About AJPE
    • Editorial Team
    • Editorial Board
    • History
  • More
    • Meet the Editors
    • Webinars
    • Contact AJPE
  • Other Publications

User menu

Search

  • Advanced search
American Journal of Pharmaceutical Education
  • Other Publications
American Journal of Pharmaceutical Education

Advanced Search

  • Articles
    • Current
    • Early Release
    • Archive
    • Rufus A. Lyman Award
    • Theme Issues
    • Special Collections
  • Authors
    • Author Instructions
    • Submission Process
    • Submit a Manuscript
    • Call for Papers - Intersectionality of Pharmacists’ Professional and Personal Identity
  • Reviewers
    • Reviewer Instructions
    • Call for Mentees
    • Reviewer Recognition
    • Frequently Asked Questions (FAQ)
  • About
    • About AJPE
    • Editorial Team
    • Editorial Board
    • History
  • More
    • Meet the Editors
    • Webinars
    • Contact AJPE
  • Follow AJPE on Twitter
  • LinkedIn
Research ArticleRESEARCH

Pharmacy Students’ Perceptions of Reflective Portfolios and their Effect on Students’ Deep Information-Processing Skills

Hui Meng Er, Marcus Kuek Jia Ming, Pei Sin Keng and Vishna Devi Nadarajah
American Journal of Pharmaceutical Education August 2019, 83 (6) 6851; DOI: https://doi.org/10.5688/ajpe6851
Hui Meng Er
International Medical University, Kuala Lumpur, Malaysia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marcus Kuek Jia Ming
International Medical University, Kuala Lumpur, Malaysia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pei Sin Keng
International Medical University, Kuala Lumpur, Malaysia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vishna Devi Nadarajah
International Medical University, Kuala Lumpur, Malaysia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Objective. To evaluate pharmacy students’ perceptions of the educational value of reflective portfolio and to gain an understanding of the factors that might influence these perceptions.

Methods. Bachelor of Pharmacy (BPharm) students’ perceptions of using reflective portfolios were evaluated by administering the same questionnaire at the beginning of years 2, 3 and 4 of the curriculum. Statistical analysis was carried out to determine the differences among the perception scores of different academic years. Semi-structured interviews were completed with fourth-year students to further explore their experiences with the reflective portfolio. Students’ deep information processing (DIP) skills were compared with those of students from another pharmacy cohort whose curriculum did not include a reflective portfolio.

Results. The students’ perceptions of the reflective portfolio improved significantly as they progressed from year 2 to year 4 of the curriculum. The factors that contributed to a positive experience were a clear understanding of objectives and guidelines for the reflective portfolio, useful mentor feedback, a positive learning attitude and motivation, and having a user-friendly technology platform for submission of the portfolio. The students’ DIP skills after completing the reflective portfolio were higher than those of students who did not have a reflective portfolio assignment in their curriculum.

Conclusion. Pharmacy students’ appreciation of the educational value of a reflective portfolio increased as they progressed to their final year, and their DIP skills improved. These findings support the use of a reflective portfolio as a learning tool for BPharm students’ personal and professional development.

Keywords
  • pharmacy
  • reflective portfolio
  • deep information-processing

INTRODUCTION

Learning involves recalling prior knowledge and connecting it to existing cognitive or metacognitive networks of ideas.1 Three learning styles have been identified: surface, deep, and strategic.2 The deep-learning approach enables learners to actively engage with learning materials and relate new ideas to their previous knowledge and experience.2 It is preferred among the different learning styles as it promotes complete understanding and long-term knowledge retention and encourages the development of higher intellectual skills, such as reasoning and problem solving.3,4 For example, medical students who adopted a deep-learning approach performed better on their final examinations than surface learners did.5

One way to promote deep learning is through reflection.6,7 A positive correlation between a deep-learning approach and reflection has been reported.8-10 The concept of reflection has evolved from the early model of reflective thought by Dewey, to Schon’s theory of reflection-in-action and reflection-on-action, Kolb’s experiential learning theory, Boud’s seven elements of reflective processes, and Mezirow’s transformative learning.11-15 These form the basis for the reflective concepts framework, which includes three main processes; acquiring new knowledge through exposure to an experience, transformational learning that links academic knowledge with practice, and integrating new knowledge and understanding, which leads to new perspectives and solutions.6

According to Tsingos and colleagues,6 reflective practice helps pharmacy practitioners integrate theories with practice by promoting critical thinking, problem-solving, and self-directed and lifelong learning, and enhancing communication and collaboration. These outcomes lead to improved clinical decision-making capabilities.16,17 Also, these skills are essential for pharmacy graduates who need to be able to ask questions, critically appraise new information, identify their own knowledge and skill gaps, reflect on their learning process and outcomes, and work with other health professionals as part of a multi-disciplinary team.

Most adult learners are independent, self-directed, and motivated to learn to satisfy their needs and interest.18 In order to help students assume responsibility for their own professional development, the reflective portfolio has been used increasingly in health profession education, including in medical and nursing education.19-21 However, limited research has been conducting regarding the use of portfolios in pharmacy education.6 A reflective portfolio is a collection of assignments and self-reflective writings for personal and professional development purposes. It provides evidence of the insights and experiences that a student has gained during a course of study. Through reflection, students develop critical awareness of their strengths and weaknesses and make improvement plans for their skill development. The portfolio enables learners to bridge theory and practice based on real-life experience.22 The Accreditation Council for Pharmacy Education recommends the portfolio as a tool “to document self-assessment of, and reflection on, learning needs, plans and achievements, and professional growth and development.”23 Other benefits of the portfolio include improvement in knowledge and understanding, enhancement of self-awareness, engagement in reflection, and an improved student-mentor relationship.20

A systematic review of the literature revealed there were relatively few reports on the impact of reflective portfolios on student knowledge, skills, and attitudes.20 In view of the resource intensiveness of a portfolio program, especially in terms of the time commitment of both students and faculty members, identifying evidence regarding the effectiveness of different portfolio types and implementation methods, as well as the optimum academic level for their use, was important. The objectives of this study were to evaluate the perception of pharmacy students on the educational value of the reflective portfolio as they progressed through their academic years, and to gain an understanding of the factors that may influence their perceptions. In addition, the effect of the reflective portfolio on students’ deep information-processing (DIP) skills was investigated.

METHODS

Ethical approval for conducting the research study was obtained from the International Medical University’s Joint Committee of Research and Ethics. Informed consent was obtained from all participants.

The study was conducted with Bachelor of Pharmacy (Honours) (BPharm) students at the International Medical University (IMU), Malaysia. These students enrolled in the BPharm program after completing a pre-university program (ie, A-levels, which is a UK pre-university entrance qualification commonly undertaken by students for post-secondary education in Commonwealth countries that adopt the British education system, or equivalent). The four-year curriculum covered the disciplines of pharmacy practice, pharmaceutical technology, pharmaceutical chemistry, and life sciences, which integrated body system modules. The program prepares graduates to work in the pharmaceutical industry, hospitals, and community pharmacies. The program was fully accredited by the Malaysian Qualifications Agency and Malaysian Pharmacy Board. An outcome-based approach was adopted in the curriculum design, with an increasing expectation on student-centered learning activities as students progressed through the academic years. Besides classroom learning, students were required to participate in a range of formal experiential learning activities. These included practical work, community service, industrial visit, and internship.

The reflective portfolio was introduced for all pharmacy students beginning with year 1 in 2013. The students were briefed on the objectives and guidelines for the reflective portfolio at the beginning of the year. The briefing notes remained available in the e-learning portal for students’ reference. Implementation of the reflective portfolio was guided by the literature review findings of Plaza and colleagues,24 and took into consideration student and faculty buy-in, student-faculty participation, types of learning evidence, student workload, use for learning vs assessment, assessment methods (qualitative vs quantitative) and the availability of a suitable technology platform.

The reflective portfolio was an integrated component of the curriculum whereby, at the end of every semester, students were required to self-assess their competencies in the identified competency domains (including knowledge and skills of the profession, social responsibility/service orientation, communication skills, ethical practice, lifelong learning, and a commitment to self-improvement, evidence-based practice, and teamwork). They were required to submit reflective essays through the Mahara electronic platform (Catalyst IT Limited, New Zealand), an open source digital portfolio tool that allows students to record evidence of learning. The essays were based on their learning experience in the previous semester. These experiences had to be supported by photographs and other evidence of their participation in the activities. Students also had to include an improvement plan in the portfolio.

The portfolios were assessed formatively by mentors, who were faculty members that acted as the students’ personal tutors. The tutors used a grading rubric for reflective writing to assess the portfolio entries and also provided written feedback to each student. Prior to launching the portfolio requirement, the University’s education office trained faculty members on how to give feedback to students. Submission of the reflective portfolio was compulsory, and students were required to resubmit it if the quality was unsatisfactory.

The questionnaire for assessing students’ perceptions of the educational value of the reflective portfolio (Appendix 1) was adapted from that created by McMullan.25 A pilot test of the questionnaire was carried out with 127 third-year pharmacy students from the cohort that commenced the program as first-year students in 2013. Reliability analysis showed the questionnaire had acceptable internal consistency, with Cronbach alpha values lying in the range 0.6 to 0.9 for all domains. Students of the cohort entering the program in 2014 were invited to complete the questionnaire voluntarily at the beginning of years 2, 3, and 4 of the BPharm program.

The fourth-year students were also invited to participate in one-to-one, semi-structured interviews conducted by one of the researchers (MKJM) who was not a faculty member. The interview was based on a set of predetermined open-ended questions intended to explore the key factors associated with the interviewees’ experience with the reflective portfolio, including their expectations, perceptions about assessment, and mentor’s feedback and support. The interviews were recorded with the consent of the participants and transcribed verbatim. Interviews were conducted with 12 female and eight male students.

To evaluate the impact of the reflective portfolio on students’ DIP skills, fourth-year students who had entered the pharmacy program in 2012 (before the introduction of the reflective portfolio) and 2014 (after the introduction of reflective portfolio) were invited to complete the DIP questionnaire reported in Appendix 2 (adapted from Schouwenburg and colleagues26). This questionnaire had been pilot tested in a previous study with pharmacy students in the same institution.27 The academic admission requirements for the comparison cohort and study cohort of students were the same and both cohorts completed an identical curriculum apart from the implementation of the reflective portfolio for the study cohort. The study design is shown in Figure 1. Statistical package SPSS version 18.0 (SPSS Inc., Chicago, IL) was used for the data analysis. Non-parametric tests were used as the data were not normally distributed. The students’ perceptions scores were analyzed using the Kruskal-Wallis test (non-parametric ANOVA) to determine whether there were any significant differences between the scores of students in different academic years. The Mann-Whitney U test was used to determine differences between the scores of two academic years.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Study Design for Pharmacy Students’ Perceptions of Reflective Portfolios and the Effect of the Portfolio on Students’ DIP Skills

The DIP scores of fourth-year students before and after the implementation of the reflective portfolio were compared using the Mann-Whitney U test. The correlation between the DIP scores of the fourth-year students and their total perception scores on the reflective portfolios was determined using the Pearson correlation coefficient.

Based on the transcribed interview data, a thematic analysis approach was used to identify the factors associated with the positive and negative student experiences with the reflective portfolio. Two researchers thoroughly familiarized themselves with the data by going over it repeatedly. They then identified and coded important features of the data (keywords) that might be relevant to the positive and negative experiences of creating the reflective portfolio. Themes were identified by examining the codes and further refined to ensure reliability.

RESULTS

Students from the cohort who began the BPharm program in 2014 completed the perception questionnaire at the beginning of years 2, 3, and 4. Across the academic years of the study, students’ ages ranged from 20 to 24 years. There were between 81% and 84% females and between 16% and 19% males. The response rate for the questionnaire was 81% (157) for second-year students, 66% (119) for third-year students, and 75% (135) for fourth-year students. For the DIP skills, 100 fourth-year students from the cohort commencing the program in 2012 (response rate 56%; 76% female students and 24% male students; aged from 20 to 24 years) and 135 fourth-year students from the cohort commencing the program in 2014 (response rate 75%; 82% female students and 18% male students; aged from 20 to 24 years) completed the questionnaire at the beginning of year 4.

Internal reliability of the perception questionnaire was indicated by Cronbach’s alpha values in the range of 0.46 to 0.93 (Table 1). The domains on personal development (A), professional development (B), portfolio support and guidance received (D), and total perception showed good reliability scores, with an alpha greater than 0.7.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1.

Internal Reliability (α) for the Questionnaire for Assessing Students’ Perceptions of the Educational Value of Reflective Portfolio

The students’ perception questionnaire data are provided in Table 2. The Kruskal-Wallis test revealed a significant difference in the scores of all domains and total scores among the academic years (p<.01). Students’ perceptions of the educational value of the reflective portfolio increased in all domains from year 2 to 3, and from year 2 to 4. A significant difference (p<.01) with medium to large effect size was observed between the total perception scores between years 2 and 3 (Cohen d=0.95), and between years 2 and 4 (Cohen d=0.44). Nevertheless, the students’ perceptions decreased consistently in all domains from year 3 to 4, and the total perception score for year 4 was significant lower (p<.01) than that for year 3 (Cohen d=0.45).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2.

Mean Rank Scores for the Questionnaire for Assessing Students’ Perceptions of the Educational Value of Reflective Portfolio

The interviewees gave their perspectives and views on the reflective portfolio based on their personal experience. Five main themes were identified: understanding of objectives and guidelines for the reflective portfolio; development of personal and professional skills; mentor’s feedback; learning attitude and motivation; and technical accessibility. A summary of the themes and quotations from the interviewees is illustrated in Appendix 4.

Half of the interviewees could not remember the objectives and guidelines of the reflective portfolio. As a result, they prepared it without relating to the objectives and guidelines that were uploaded on the e-learning portal. Meanwhile, those who understood the objectives reflected on what they had done in the previous semester and prepared according to the guidelines. Twelve interviewees expressed that they had a better understanding of what they had learned in the past semester as a result of completing the reflection assignment and could use these insights to improve themselves. On the other hand, two of the interviewees reported that reflection was challenging for them as they had difficulty recalling the activities that they had carried out in the previous semester.

Twelve of the 20 interviewees conveyed that the reflective portfolio contributed to their development in personal and professional skills, such as communication, reflective skills, and self-improvement. Twelve of the interviewees did not think that their mentors’ written feedback was useful. Also, some felt that the effort they spent on preparing the reflective portfolio was not appreciated by their mentor. On the other hand, those who were satisfied with their mentor’s feedback appreciated the suggestions given on areas for improvement. Also, the students expressed a preference for face-to-face feedback sessions rather than written comments

The students’ learning attitude and motivation may have influenced their perceptions of the reflective portfolio. The interviewees who had positive perceptions appreciated its educational value and put effort into preparing their portfolio. However, some felt that it created an extra workload for them and was not beneficial. When the interviewees were asked about their views on changing the portfolio assessment to summative, all of them expressed that they would put more effort into preparing the portfolio if it was summatively assessed (ie, contributed to the cumulative grade point average score [cGPA]). Those who preferred that portfolios undergo a summative assessment felt that clearer instructions and guidelines should be provided. On the other hand, some students did not believe there should be a summative assessment of the reflective portfolio because students might not be honest in their reflective writing in an attempt to receive a higher score.

In addition to the factors discussed above, there was an association between students’ perception of the reflective portfolio and the technical accessibility of the electronic platform for portfolio submission. Four interviewees highlighted problems in the submission of their reflective portfolios using the Mahara electronic platform.

The internal reliability of the DIP scales indicated by the Cronbach alpha values are presented in Table 3. High internal reliability values (alpha greater than 0.8) were achieved for the total DIP scores and the domain scores for “broaden one’s context.” There was a significant difference between the total DIP scores of both groups, with mean rank scores of 106.9 and 126.2, respectively, for the cohorts who did and did not complete a reflective portfolio. The effect size was medium (Cohen d=0.28). In particular, the domain scores for “critical reading” and “broaden one’s context” were significantly higher among the cohort of students who completed the reflective portfolio (p<.05). A strong positive correlation was found for fourth-year students between the total perception score on the use of the reflective portfolio and the DIP scores (Pearson r=0.507, N=134, p=.01).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3.

Internal Reliability (α) for the Questionnaire for Evaluating Students’ Deep Information Processing Skills

DISCUSSION

Both the quantitative and qualitative findings from our study indicate the potential of the reflective portfolio to be a useful tool for promoting personal and professional development in pharmacy students. Overall, the percentage of students who agreed with the perception statements in the personal and professional development and support and guidance domains was higher than those who disagreed, and the trend increased from year 2 to year 4 of the curriculum. However, this study found no evidence of improvement in students’ self-esteem and confidence as a result of completing the reflective portfolio. While this finding was similar to findings among one group of nursing students,25 it was contrary to findings among another group of preregistration nursing students.28 The decrease in students’ total perception score from year 3 to year 4 was an unexpected finding and could be attributed to the general student perception that using the portfolio was time-consuming and stressful. In the current study setting, the learning activities in year 4 were mainly self-directed, and thus demanding on the students’ learning time, with the reflective portfolio possibly seen as additional work. Besides, as students’ progress through the later years of the program, they might have higher expectations of themselves as well as the learning environment.

The students’ responses on the general statements in the questionnaire were mostly neutral and consistent with the findings among nursing students reported by McMullan.25 The students felt that completion of the reflective portfolio occupied a large amount of time and caused a lot of anxiety, especially in year 2. The perception of using it as a learning tool became increasingly positive towards the final year, and when given a choice, the students generally preferred assessment of the portfolio to be formative rather than summative.

The students seemed to better understand the objectives of the reflective portfolio as they progressed through the course, although scores for the quality of the feedback they received remained low. This was further confirmed by the interviewees, whose opinions regarding the usefulness of their mentor’s feedback varied. Students perceived useful feedback as that which helped them to identify areas in which improvement was needed as well as strategies to achieve the changes. The concerns raised by students relating to feedback suggests that faculty training in how to assess reflective writing and give effective feedback should be continuous. For feedback processes to contribute to learning and professional development, the standard of performance required of students must be clearly communicated, so that they can work towards closing the gap.29 Moreover, the feedback must be provided in a timely manner and suggest alternative behaviors that will help them achieve their goals.30 A prognostic feedback model should be used which would provide information to students on how a task can be performed differently in the future in order to improve.31 Additionally, sufficient time must be allocated for effective student feedback and grading.16 The students’ self-assessment skills need to be strengthened as well.32,33 Nicol and Macfarlane-Dick argue that a wider framework extending beyond cognition to self-regulation of motivation and behavior is necessary for good feedback practice.34 To overcome the limitations of written feedback in ensuring understanding and internalization by students, feedback dialogue has been suggested as a way to engage both the teacher and student in a constructive manner.34

From the qualitative analysis of the interview data, the themes affecting the student experience in using the reflective portfolio included understanding of objectives and guidelines, usefulness of mentor’s feedback, students’ attitude toward and motivation for learning, and technical accessibility. Although studies have shown that portfolios can enhance students’ reflective skills and awareness about their strengths and weaknesses,35,36 the students’ buy-in and commitment to a portfolio greatly depends on the clarity of the objectives and guidelines. The findings are consistent with previous reports that successful use of a reflective portfolio relies on clear guidelines on its purpose, content, and structure.25,37

The interview findings confirmed that students were engaged in reflection during the preparation of their reflective portfolios; this was consistent with the quantitative data showing that the students perceived their self-awareness, critical thinking, and reflective skills were enhanced as they progressed from year 2 to year 4. Critical reflection is essential for perspective transformation.38 This study also confirmed that using the reflective portfolio can promote deep information-processing skills in students, especially in critical reading (understanding) and broadening their context (elaboration). The engagement of students with the learning process, and their subsequent reflection on actions based on their experiential learning activities, collectively encourage learners to adopt a deep rather than a surface learning approach.22 Moreover, their development of deep information-processing skills was strongly correlated with the students’ perception of the use of the reflective portfolio. This finding is consistent with a previous report that students’ reflective ability is positively correlated with their perception of reflective portfolios.21

In addition to a user-friendly technology platform for submission of the reflective portfolio, another determining factor for students’ buy-in was their learning attitude and motivation. Motivation and self-esteem play an important role in learning and assessment.34 Students with a positive perception of the reflective portfolio appreciated its educational value, while those who lacked self-regulation were likely to neglect it. The students indicated that they would put more effort into the preparation of the reflective portfolio if it underwent summative assessment. Driessen and colleagues reported assessment as a motivating factor for completion of the portfolio.39 However, reports by McMullan and colleagues and Gallagher revealed that using portfolios for both assessment and learning can create conflicts.40,41 These findings were consistent with some students’ views that summative assessment of the portfolio might lead to a lack of honesty in their reflective writing in order to achieve higher scores. This view is further supported by Schaffer and colleagues who suggest that summative assessment may decrease the effectiveness of the reflective portfolio by stifling honesty and reflection.42 In particular, the portfolio should not be used for summative assessment if the priority is to support reflection and encourage deep learning.43 Additionally, high-stake summative assessments discourage motivation and self-esteem.34

Future studies should examine faculty members’ perceptions on the use of the reflective portfolio as an educational tool. Moreover, further insights into the factors associated with the student experience of using the reflective portfolio should be explored. For example, students’ reflective thinking skills could be assessed using a validated instrument to determine the correlation with their perception. Because of the nature of the present study, the findings might be limited by the students’ perceptions, which could have been influenced by many factors, including their own perception of the relevance of the portfolio and of their competence in critical thinking and reflective writing. Additionally, the lack of buy-in from some faculty members as well as their heavy workloads may have affected the quality of the feedback they provided. These factors may have limited the full educational benefit of the reflective portfolio.

CONCLUSION

This study provided evidence that requiring pharmacy students to develop a reflective portfolio could aid them in developing deep information-processing skills. The students perceived that the portfolio helped with their personal and professional development. Factors that could enhance their perception of the value of the portfolio include clear understanding of the objectives and guidelines, useful feedback from a mentor, motivation and positive attitudes about learning, and a user-friendly technology platform for submission of the reflective portfolio. The findings support the use of reflective portfolios in the training of pharmacists to become reflective practitioners.

ACKNOWLEDGMENTS

The authors would like to acknowledge the support of an International Medical University Research Grant for the conduct of this study. We would also like to thank Professor Brian Furman and Professor Ray Peterson for their assistance with editorial review. Special thanks to the Asia Pacific Medical Education Network for the constructive comments provided during the development of this work.

Appendix 1. Questionnaire Used for Assessing Pharmacy Students’ Perceptions of the Educational Value of a Reflective Portfolio

A: Personal Development

 It increases my awareness of my strengths.

 It increases my awareness of my weaknesses.

 It helps me to develop independent learning.

 It helps me to value lifelong learning.

 It improves my self-esteem.

 It improves my confidence.

 It helps me to develop responsibility for my own professional development.

B: Professional Development

 It enhances my ability to link theory to practice.

 It helps me to identify areas where my knowledge is good.

 It helps me to identify areas where my skills are good.

 It helps me to identify areas where my knowledge is weak.

 It helps me to identify areas where my skills are weak.

 It promotes my critical thinking.

 It enhances my reflective skills.

C: General Statements Regarding Portfolio Use

 It takes a lot of time to complete.a

 It causes a lot of anxiety.a

 I have good reflective writing skills.

 I like portfolio as an assessment tool.

 I like portfolio as a learning tool.

 It increases the learning value if assessed summatively (ie, contributes to final marks/grades).

 It increases the learning value if assessed formatively (ie, does not contribute to final marks/grades).

D: Portfolio Support and Guidance Received

 The objectives of reflective portfolio are clear.

 I am clear about how much learning evidence to include in the portfolio.

 I know how to use the portfolio.

 There are regular feedback sessions.

 The feedback provided by tutor is useful.

 All items were rated on a 5-point Likert scale: 1=Strongly Disagree, 2=Disagree, 3=Neutral, 4=Agree, 5=Strongly Agree

 a Reverse scoring was applied since for negative statements.

Appendix 2. Deep Information Processing (DIP) Scale

Domain I: Critical Reading

 I attentively and critically look at the argumentation.

 I understand the meaning of the text very quickly.

 I cannot get an overview when the text is long.a

 I read on even when I do not know a certain expression.a

 I quickly distinguish facts from side issues.

 I find it difficult to get an overview quickly.a

 I assume difficult things without really understanding them.a

 I cannot distinguish facts from side issues unless I read the text several times.a

 I keep on reading without really understanding the previous parts.a

Domain II: Broaden Ones Context

 I think of questions while I read.

 I try to think of counter-arguments.

 I try to relate new concepts to concepts that I already know.

 I try to relate different courses.

 I look for the how and why of statements.

 I try to apply things in daily living.

 I compare what I read with things I already know.

 I think of examples myself.

Domain III: Structuring

 I try to find structure in a text by looking at the title and headlines.

 I make notes on the most important issues.

 I pay attention to titles and headlines.

 I pay attention to the paragraph division of the text.

 I write down my conclusions on a text.

 I also look at other books to gain a broader view of a subject.

 All items were rated on a 5-point Likert scale: 1=Never, 2=Rarely, 3=Sometimes, 4=Most of the time, 5=Always

 a Reverse scoring was applied since it is a negative statement.

Appendix 3. Percentages of Responses and Median Scores for the Questionnaire for Assessing Students’ Perceptions of the Educational Value of Reflective Portfolio


Embedded Image

Appendix 4. Summary of Themes and Quotations from Pharmacy Students Interviewed Regarding a Reflective Portfolio


Embedded Image
  • Received October 16, 2017.
  • Accepted March 7, 2018.
  • © 2019 American Association of Colleges of Pharmacy

REFERENCES

  1. 1.↵
    1. Hinett K
    . Improving Learning Through Reflection: Part One. York: The Higher Education Academy; 2002.
  2. 2.↵
    1. Newble D,
    2. Entwistle N
    . Learning styles and approaches: implications for medical education. Med Educ. 1986;20:162-175.
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Marton F,
    2. Saljo R
    . On qualitative differences in learning: I. outcome and process. Br J Educ Psychol. 1976;46:4-11.
    OpenUrlCrossRef
  4. 4.↵
    1. Dacre JE,
    2. Fox RA
    . How should we be teaching our undergraduates? Ann Rheum Dis. 2000; 59:662-667.
    OpenUrlFREE Full Text
  5. 5.↵
    1. McManus IC,
    2. Richards P,
    3. Winder BC,
    4. Sproston KA
    . Clinical experience, performance in final examinations, and learning style in medical students: prospective study. BMJ. 1998; 316: 345-350.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    1. Tsingos C,
    2. Bosnic-Anticevich S,
    3. Smith L
    . Reflective practice and its implications for pharmacy education. Am J Pharm Educ. 2014;78(1):Article 18.
  7. 7.↵
    1. Tsingos C
    . Reflective practice: learning from experience. J Pharm Pract Res. 2013;43(3):249-250.
    OpenUrl
  8. 8.↵
    1. Leung D,
    2. Kember D
    . The relationship between approaches to learning and reflection upon practice. Educ Psychol. 2003;23:61-71.
    OpenUrl
  9. 9.↵
    1. Sobral D
    . Medical students’ reflection-in-learning in relation to approaches to study and academic achievement. Med Teach. 2001;23:508-513.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Mann K,
    2. Gordon J,
    3. McLeod A
    . Reflection and reflective practice in health professions education: a systematic review. Adv in Health Sci Educ. 2009;14:595-621.
    OpenUrl
  11. 11.↵
    1. Dewey J
    . How We Think. London: Heath & Co. 1910.
  12. 12.↵
    1. Schon D
    . The Reflective Practitioner: How Professionals Think in Action. Gower House, England: Ashgate Publishing Ltd; 1995.
  13. 13.↵
    1. Kolb DA,
    2. Boyatzis TE,
    3. Mainemelis C
    . Experiential learning theory: previous research and new directions. Perspectives on Thinking, Learning and Cognitive Styles. 2001;1:227-247.
    OpenUrl
  14. 14.↵
    1. Boud D,
    2. Keogh R,
    3. Walker D
    . Promoting reflection in learning: A model. Reflection: Turning Experience into Learning. London, Kogan Page; 1985:18-40.
  15. 15.↵
    1. Knox AB
    1. Mezirow J
    . Fostering critical reflection in adulthood: How critical reflection triggers learning. In: Knox AB, ed. Fostering Critical Reflection in Adulthood. San Francisco, CA: Jossey-Bass; 1990:1-20.
  16. 16.↵
    1. Tsingos C,
    2. Bosnic-Anticevich S,
    3. Lonie JM,
    4. Smith L
    . A model for assessing reflective practices in pharmacy education. Am J Pharm Educ. 2015;79(8):Article 124.
    OpenUrl
  17. 17.↵
    1. Tsingos C,
    2. Bosnic-Anticevich S,
    3. Schneider CR,
    4. Smith L
    . The effect of reflective activities on reflective thinking ability in an undergraduate pharmacy curriculum. Am J Pharm Educ. 2016;80(4):Article 65.
    OpenUrl
  18. 18.↵
    1. Knowles MS
    . Designs for Adult Learning. Alexandria, VA: American Society for Training and Development; 1995.
  19. 19.↵
    1. Wenzel LS,
    2. Briggs KL,
    3. Puryear BL
    . Portfolio: authentic assessment in the age of the curriculum revolution. J Nurs Educ. 1998;37:208-212.
    OpenUrlPubMed
  20. 20.↵
    1. Buckley S,
    2. Coleman J,
    3. Davison I,
    4. et al
    . The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach. 2009;31(4):282-298.
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. Rees C,
    2. Sheard C
    . Undergraduate medical students’ views about a reflective portfolio assessment of their communication skills learning. Med Educ. 2004;38:125-128.
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Challis M
    . AMEE Medical Education Guide No. 11 (revised): Portfolio-based learning and assessment in medical education. Med Teach. 1999; 21:370-86.
    OpenUrlCrossRef
  23. 23.↵
    Accreditation standards and key elements for the professional program in pharmacy leading to the Doctor of Pharmacy degree 2016, Accreditation Council for Pharmacy Education. https://www.acpe-accredit.org/pdf/Standards2016FINAL.pdf. Accessed July 22, 2019.
  24. 24.↵
    1. Plaza CM,
    2. Draugalis JR,
    3. Slack MK,
    4. Skrepnek GH,
    5. Sauer KA
    . Use of reflective portfolios in health sciences education. Am J Pharm Educ. 2007;71(2):Article 34.
  25. 25.↵
    1. McMullan M
    . Students’ perceptions on the use of portfolios in pre-registration nursing education: A questionnaire survey. Int J of Nurs Stud, 2006;43:333-343.
    OpenUrl
  26. 26.↵
    1. Schouwenburg HC,
    2. Schilder AJE
    . Handleiding bij de Test voor Diepgaande Leerst of Verwerking DLV’95 [Manual for the Test for Deep Information Processing.] Groningen: Studie Ondersteuning; 1996.
  27. 27.↵
    1. Ramamurthy S,
    2. Er HM,
    3. Nadarajah VD,
    4. Pook PCK
    . Study on the impact of open and closed book formative examinations on pharmacy students’ performance, perception, and learning approach. Curr Pharm Teach Learn. 2016;8:364-374.
    OpenUrl
  28. 28.↵
    1. Harris S,
    2. Dolan G,
    3. Fairbairn G
    . Reflecting on the use of student portfolios. Nurse Educ Today. 2001;21:278-286.
    OpenUrlCrossRefPubMed
  29. 29.↵
    1. Sadler DR
    . Formative assessment and the design of instructional systems. Instr Sci.1989;18(2):119-144.
    OpenUrlCrossRef
  30. 30.↵
    1. McKimm J
    . Giving effective feedback. Br J of Hosp Med (Lond). 2009;70(3):158-161.
    OpenUrl
  31. 31.↵
    1. Hounsell D
    . The trouble with feedback: New challenges, emerging strategies. TLA Interchange. 2008;2:1-9.
    OpenUrl
  32. 32.↵
    1. Boud D
    . Sustainable assessment: rethinking assessment for the learning society. Stud in Continuing Educ. 2000; 22(2):151-167.
    OpenUrl
  33. 33.↵
    1. Yorke M
    . Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. High Educ. 2003;45(4):477-501.
    OpenUrlCrossRef
  34. 34.↵
    1. Nicol DJ,
    2. Macfarlane-Dick D
    . Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud High Educ. 2006;31(2):199-218.
    OpenUrlCrossRef
  35. 35.↵
    1. Grant A,
    2. Dornan TL
    . What is a learning portfolio? Diabet Med. 2001;18:1-4.
    OpenUrlPubMed
  36. 36.↵
    1. Priest H,
    2. Roberts P
    . Assessing students’ clinical performance. Nurs Stand. 1998;12(48):37-41.
    OpenUrlPubMed
  37. 37.↵
    1. Gannon FT,
    2. Draper PR,
    3. Watson R,
    4. Proctor S,
    5. Norman IJ
    . Putting portfolios in their place. Nurse Educ Today. 2001;21:534-540.
    OpenUrlPubMed
  38. 38.↵
    1. Wong K,
    2. Kember D,
    3. Chung L,
    4. Yan L
    . Assessing the level of student reflection from reflective journals. J Adv Nurs. 1995;22:48-57.
    OpenUrlCrossRefPubMed
  39. 39.↵
    1. Driessen EW,
    2. van Tartwijk J,
    3. Overeem K,
    4. Vermunt JD,
    5. van der Vleuten CP
    . Conditions for successful reflective use of portfolios in undergraduate medical education. Med Educ. 2005;39:1230-1235.
    OpenUrlCrossRefPubMed
  40. 40.↵
    1. McMullan M,
    2. Endacott R,
    3. Gray MA,
    4. et al
    . Portfolio and assessment of competence: a review of the literature. J Adv Nurs. 2003;41:283-294.
    OpenUrlCrossRefPubMed
  41. 41.↵
    1. Gallagher P
    . An evaluation of a standards based portfolio. Nurse Educ Today. 2001;21:409-416.
    OpenUrlPubMed
  42. 42.↵
    1. Schaffer MA,
    2. Nelson P,
    3. Litt E
    . Using portfolios to evaluate achievement of population-based public health nursing competencies in baccalaureate nursing students. Nurs Educ Perspect. 2005;26:104-112.
    OpenUrlPubMed
  43. 43.↵
    1. Fawns T,
    2. McKenzie K
    . How to ensure e-portfolios are a valuable resource to students' learning. Nurs Times. 2010;106(30):21-23.
    OpenUrlPubMed
PreviousNext
Back to top

In this issue

American Journal of Pharmaceutical Education
Vol. 83, Issue 6
1 Aug 2019
  • Table of Contents
  • Index by author
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Pharmaceutical Education.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Pharmacy Students’ Perceptions of Reflective Portfolios and their Effect on Students’ Deep Information-Processing Skills
(Your Name) has sent you a message from American Journal of Pharmaceutical Education
(Your Name) thought you would like to see the American Journal of Pharmaceutical Education web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
4 + 13 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Pharmacy Students’ Perceptions of Reflective Portfolios and their Effect on Students’ Deep Information-Processing Skills
Hui Meng Er, Marcus Kuek Jia Ming, Pei Sin Keng, Vishna Devi Nadarajah
American Journal of Pharmaceutical Education Aug 2019, 83 (6) 6851; DOI: 10.5688/ajpe6851

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Pharmacy Students’ Perceptions of Reflective Portfolios and their Effect on Students’ Deep Information-Processing Skills
Hui Meng Er, Marcus Kuek Jia Ming, Pei Sin Keng, Vishna Devi Nadarajah
American Journal of Pharmaceutical Education Aug 2019, 83 (6) 6851; DOI: 10.5688/ajpe6851
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • ACKNOWLEDGMENTS
    • Appendix 1. Questionnaire Used for Assessing Pharmacy Students’ Perceptions of the Educational Value of a Reflective Portfolio
    • Appendix 2. Deep Information Processing (DIP) Scale
    • Appendix 3. Percentages of Responses and Median Scores for the Questionnaire for Assessing Students’ Perceptions of the Educational Value of Reflective Portfolio
    • Appendix 4. Summary of Themes and Quotations from Pharmacy Students Interviewed Regarding a Reflective Portfolio
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

Similar AJPE Articles

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • The Association Between Accreditation Era, NAPLEX Testing Changes, and First-time NAPLEX Pass Rates
  • Evaluation and Revision of the Kiersma-Chen Empathy Scale
  • Integration, Perceptions, and Implementation of Legislative Advocacy Within US Schools and Colleges of Pharmacy
Show more RESEARCH

Related Articles

  • No related articles found.
  • Google Scholar

Keywords

  • pharmacy
  • reflective portfolio
  • deep information-processing

Home

  • AACP
  • AJPE

Articles

  • Current Issue
  • Early Release
  • Archive

Instructions

  • Author Instructions
  • Submission Process
  • Submit a Manuscript
  • Reviewer Instructions

About

  • AJPE
  • Editorial Team
  • Editorial Board
  • History
  • Contact

© 2022 American Journal of Pharmaceutical Education

Powered by HighWire