Analytics to inform Continual ImprovementThe Experience of Lingnan University, Hong Kong to implement Blackboard Analytics

Terence Kwok

terence@LN.edu.hk

Agenda

• Who are we?

• Background of Business Intelligence Project

• Implementation Schedule and Approach

• Benefit to the Institution

• Challenges encountered

• Next phase of project

• Conclusion

3

Who are we?

• A Publicly-funded Liberal Arts University in Hong Kong – 2,300 student

• Characteristics– Small Class Teaching– Multi-disciplinary Programmes– Internationalization– Close to Full Residence

4

Background of Business Intelligence Project

• Recommendation from Quality Assurance Council in July 2010

• No data warehouse– Most data are captured in Banner but some essential data are spread

over Excel files and paper records

• A BI solution is therefore considered essential!!

Implementation Schedule and Approach

• Step 1 – Preparation Works– September 2010

• Set up a Task Force on Evaluation Framework • Define 5 University-wide KPIs

5

Internationalization Experiential Learning Small Class

Inter-disciplinary Courses

Residential Experiences

6

Implementation Schedule and Approach

• Step 2 - Acquisition of BI system – September 2010 – February 2011

• sourcing of a suitable BI solution for higher education in Hong Kong

– March 2011• benchmarking with overseas institutions on using different BI

products• Blackboard Analytics is chosen

– June 2011 – • Contract Agreement Sign-off

Implementation Schedule and Approach

• Step 3 – Division of Labour

7

BI Steering Group To develop plans & set directions; chaired by AVP(AQA)

To lead the project, define data models, coordinate with Blackboard Analytics & receive training

AVP(AA) & Registrar(Champion)

Registry/Faculty/ Support Units (functional)

ITSC (technical)

BI Working Group

8

Implementation Schedule and Approach

• Step 4 – Server Installation – July 2011

• Hardware & Software Installation• Technical Training

• Step 5 – Project Planning & Management– August 2011

• User training and customization by Blackboard consultants• Data Cleansing from Banner, Business Rule Validation and GAP

Analysis• Customization based on the Internationalization KPI

9

Implementation Schedule and Approach

• Step 6 – System Refinement & Deployment– Data Warehouse reconciliation– Develop Reports for Initial Deployment

• Step 7 - GO LIVE on Internationalization KPI in October 2011!! – (4 months from acquisition of the BI product)

10

Implementation Approach

• Implementation starts from building localized KPIs– Presume the Blackboard Analytics baseline model is valid as Lingnan

has followed very closely to the Banner baseline in inputting student data

– Some essential reports are not covered in the baseline model– Focus on customization instead of learning the baseline model

11

Benefit to the Institution

• Change on workflow – more efficient

• Use evidence to make decision – more effective

• More proactive bringing policy to deal with change

• Streamlining the collection of important information

12

Example

13

Number of Exchange Partners

14

Competition of Exchange Places

15

Competition of Exchange Spaces in Asia (2012)

16

Personal Growth for Outgoing Exchange Students

17

Overall Exchange-out Rate

18

Residents with cGPA over 3.0 by Hostels in 2012

19

Challenges Encountered

• Cultural Differences – U.S. vs Hong Kong– Not all baseline models can be used (e.g. student attrition & retention

rates)

• Implementation starts from KPI but not Baseline– Extensive customization works

• Data spread through everywhere– Ellucian Banner ERP, Excel, paper records, etc– Extensive data cleansing works

• Change of mindset – Operational Reports vs Analytics Reports

20

Next Phase of Project

• Set up an Institutional Research Team to manage all the planning and analytical tasks

• Implement other KPIs (draft) to measure– Attraction to the Various Programme– Quality of the Programme– Student Engagement in the Programme– Reflection on the Programme Experience

21

Conclusion

• Factors leading to the Success– Get everybody involved – from AVPs to Clerical Staff– Everyone goes for one goal – Phase I implementation goes live by

October 2011– Have the right champion & working partners leading and working for

the BI project

22

Thank YouQ & A Session