Effects of Reflective ePortfolio on Students Overseas Exchange Learning Experience

+

Kwok Chi Wai, Ron; Cheung Hok Ling, Hokling; Chen Yingjun, Josephine; Lau Tania, Yuenkei;

Bandyopadhyay Rupa; Wong Man Chun, Anthony

City University of Hong Kong

Table of Content• Curriculum Design• Reflective ePortfolio• Research Model• Examples of ePortfolio for Exchange• Measurements• Current Status• Limitations• Potential Implications

Curriculum Design• Exchange Experience Assessment I (IS4935a)• Exchange Experience Assessment II (IS4935b)

Enable students to bridge their study overseas on the exchange programme with their learning experience in Hong Kong. It will challenge them in terms of what they have learned or not learned overseas, and how they learned it. Students should emerge from this short course with a heightened sense of appreciation for cultural differences, and the impact that these differences can have on interpersonal work relations, as well as intercultural relations at the organisational level.

Course Intended Learning Outcomes• Describe the role of communication in culture and overcome

communication barriers• Recognize cultural variables and explain how they shape our

social and work interactions• Identify and critically evaluate communication norms, rituals,

and taboos of students’ cultures and other cultures they have been exposed to during their study programme

• Develop successful strategies to overcome cultural barriers and demonstrate their usefulness

• Compare and contrast the use of IT in universities /organizations in Hong Kong with the counterparts overseas

The Use of Reflective ePortfolio

• In the course, students were required to document their exchange experiences with the use of the reflective ePortfolio

• Training on reflection & Technical training on ePortfolio were provided

• Design & provision of ePortfolio template http://sites.google.com/site/mylearningportfoliotemplate/

Profile Summary

Showcase

Performance

Monthly exchange

experience

Google SitesStudent’s ePortfolio

Teacher’s interactions

Self-Assessment form

Instructors Assessment

Grade Online

Peers review & comments

Gather self-assessment on CILOs from students

View students’ ePortfolios in Google Sites

Student

Instructor

Profile Summary

Showcase

Performance

Monthly exchange

experience

Wiki in BlackboardStudent’s ePortfolio

Teacher’s interactions

Self-Assessment form

Instructors Assessment

Grade Offline

Peers review & comments

Gather self-assessment on CILOs from students

View students’ ePortfolios in Google Sites

Student

Instructor

Wiki

Wiki

Blackboard Test

The ePortfolio Template

The ePortfolio Template

http://sites.google.com/site/exchangeexperienceassessmenti/

Elements of Reflective ePortfolioMetaphors to aid reflection

1. Use the mirror to prompt reflection about yourself

2. Go deeper and analyse the details of an event, task or experience

3. What choices lie ahead?

4. Consider alternatives

5. Consider how you can best evidence your claims?

6. Look for connections and relationships

Cheung & Dean 2009

Examples of Student ePortfolio: Profile

Summary

Showcase (1)

Showcase (2)

Research Model: The Impact of Reflective ePortfolio on Students’ Overseas Exchange Learning Experience

Individual Engagement

Collaborative Engagement

Satisfaction with the Exchange

Experience

Satisfaction with the Reflective ePortfolio

Perceived Achievement of

Learning

Preparation for Future Exchange

Engagement (Usage)

Outcomes

+

+

+

+

Actual Achievement of

Learning

+

Independent Variable: Reflective ePortfolio Engagement (Usage)• Individual Engagement

– Actual usage of the Reflective ePortfolio on:• Constructing profile• Goals setting and planning• Identifying learning outcomes and requirements• Recording achievements and experiences• Selecting and use of evidences• Reflecting on learning experiences

• Collaborative Engagement– Actual usage of the Reflective ePortfolio on:

• Receiving and Giving feedbacks• Providing and Obtaining support• Introduce friends Met in exchange studies

Outcomes• Satisfaction with the Exchange Experience

– Overall satisfaction level of students on their last exchange experience

• Preparation for Future Exchange– Perceptions of students on how Reflective ePortfolio could help them better

plan and prepare for future overseas exchange programme

• Satisfaction with the Reflective ePortfolio– Overall satisfaction level of students on their use of the Reflective ePortfolio

throughout their exchange programme

• Perceived Achievement of Learning– Perceptions of students on the achievement of their personal

goal/development and learning outcomes in the exchange programme

• Actual Achievement of Learning– A performance indicator of students on the exchange assessment course. This

is the actual achievement of the intended learning outcome of the course. Letter grade that students obtained from their course.

Operationalization

Individual Engagement

Collaborative Engagement

Satisfaction with the Exchange

Experience

Satisfaction with the Reflective ePortfolio

Perceived Achievement of

Learning

Preparation for Future Exchange

Engagement (Usage)

Outcomes

+

+

+

+

Actual Achievement of

Learning

+

Questionnaire Items : Individual Engagement

Please determine the extend to which you agree with the following sentences (1=strong disagree, 3=neutral , 5 = strongly agree)

I used the ePortfolio frequently to:1. construct my own profile (Self-Identity)2. develop my own values and beliefs (Self-Identity)3. describe my goals and aspiration clearly (Goal setting & Planning)4. plans to achieve goals (Goal setting & Planning)5. document my achievements (Record of achievements)6. update my achievements from time to time (Record of achievements)7. select appropriate materials to be recorded (selection and use of evidence)8. select appropriate materials to be demonstrated (selection and use of evidence)9. reflect on how the exchange experience has affected my values and beliefs (Reflection)10. observe the differences in behaviors, attitudes and cultures (Reflection)11. Recognize the requirements and standards to the exchange program (Identified outcome &

requirements)12. Aware of the course intended learning outcomes and expectations (identified outcomes

and requirements)

Questionnaire Items : Collaborative Engagement

Please determine the extend to which you agree with the following sentences (1=strong disagree, 3=neutral , 5 = strongly agree)

I used the ePortfolio frequently to:1. share my experiences with my classmates and/or teachers2. provide feedbacks and comments on the experiences of my fellow

classmates3. read feedbacks and comments made from my fellow classmates4. build better relationship with my fellow classmates5. Introduce new friends met in the exchange studies

Questionnaire Items : Outcomes• Satisfaction with the Exchange Experience

1. I enjoyed my exchange experience.2. I was actively involved in my overseas/Mainland exchange programme.3. My exchange experience was successful

• Preparation of Future Exchange 1. The ePortfolio helped me better prepare for the future exchange program.2. The ePortfolio helped me better plan for the future exchange program.

• Satisfaction with the Reflective ePortfolio1. The ePortfolio’s content structure: Profile-Summary-Showcase-Qualifications (PSSQ),

was a good framework to structure my ePortfolio for the exchange program2. The ePortfolio development experience added value to my exchange programme.3. The ePortfolio helped me better prepared for the exchange programme.

• Perceived Achievement of Learning1. I achieved the intended learning outcomes of the exchange programme.2. I achieved my own goals of the exchange programme.3. I realized the importance of life-long learning during the exchange study.

Actual Achievement of Learning• Individual Assignment (90%)

• Build up profile;• Create a theme of the ePortfolio;• Document the expectations and goals of the exchange;

the accomplishments and learning outcomes;• Document the exchange experiences including at least

THREE actual work/incidents with evidences;• Self assess and reflect the performance according to the

Course Intended Learning Outcomes (CILOs);

• Online Discussion (10%) • give constructive comments to peers’ ePortfolios

Current Status

• Validation of Measurement Instrument• Initial Results on the Achievement of ePortfolio Workshop

Validation of Measurement Instrument

• Card Sorting (Moore & Benbasat, 1991)

• Pilot Testing

Construct (Predictor) Alpha Construct (Outcome) AlphaIndividual Engagement Satisfaction with the Exchange ExperienceCollaborative Engagement Preparation for Future Exchange

Satisfaction with the Reflective ePortfolioPerceived Achievement of LearningActual Achievement of Learning NA

At the end of this workshop, you are able to adopt templates to start creat-

ing your ePortfolio

You are able to add selected arti-facts/evidence for showcasing

your learning achievements

You are able to make reflections on your learning and development in this

exchange programme

0%

10%

20%

30%

40%

50%

60%

70%

80%

28%

24%

36%

68%

72%

48%

4% 4%

16%

0% 0% 0%0% 0% 0%

Strongly Agree

Agree

Neutral

Disagree

Strongly Disagree

Achievement of ePortfolio Workshop

Students’ Perception

How useful do you expect a learning ePortfolio to be?0%

10%

20%

30%

40%

50%

60%

32%

56%

12%

0% 0%

Very usefulUsefulAveragePoorNo comment

To what extent do you agree with the statement "using eP...0%

10%

20%

30%

40%

50%

60%

70%

80%

20%

72%

8%

0% 0%

Strongly AgreeAgreeNeutralDisagreeStrongly Disagree

Quality of the Workshop

The workshop activities have helped you master the essential

skills for creating ePortfolios

In this workshop, the speakers have presented information and responded to questions in an in-formative, appropriate and satis-

factory manner

0%

10%

20%

30%

40%

50%

60%

52%

44%44%

52%

4% 4%

0% 0%0% 0%

Strongly AgreeAgreeNeutralDisagreeStrongly Disagree

In general, how useful was this workshop for you?0%

10%

20%

30%

40%

50%

60%

36%

52%

12%

0% 0%

Very usefulUsefulAveragePoorVery Poor

Limitation: Technical problems encounteredGoogle China Incident

ePortfolio Workshop

19 Jan2010 2011

Google China Incident

10 Mar

Tried and discussed different kind of solutions

11 – 16 Mar

Agreed to use Blackboard Wiki

16 Mar

Released the Bb Wiki to students

30 Mar

ePortfolio submissiondeadline

9 Apr, 30 Apr & 30May

• CityU VPN• CityU GApps• Paper Portfolio• Bb Wiki

Potential Implications for Educators

• From Student Externalization to Combination • From Individual Peer-Reflective learning to

Peer-Reflective Based Experiential Learning• From Local Support Network to Distributed

Support Network• From Self-Monitoring Evaluative Learning to

Peer-Assisted and Supportive learning

Potential Implications for Instructors

• Changing Role from Assessor to Facilitator • Enhance intimacy relationship between instructors

and students• Closing the loop for continuous improvement of

course quality by providing better advice to students going for exchange

• Provide timely feedback and meet urgent needs of students through interactive feedback

• Assess achievement of learning goals and expected learning progress

Potential Implications for Designers

• Facebook Approach – Incorporating Facebook design approach in the

user interface to record the frequency of updates• Show Status

– Show Status of feedbacks that have been given and received by students

• Make Friends – Allow sharing the ePortfolios with friends in the

exchange university

Comments and Suggestions