Assessment Web Applications: Characteristics and Benefits to the Institutional
Effectiveness Process
Divya Bhati,Ph.D.PatriceLancey,Ph.D.CarlosMartinez
OfficeofOperationalExcellenceandAssessmentSupport
UniversityofCentralFlorida
Overview UCFInstitutionalEffectivenessassessment
process Modelingthebusinessprocess UCFWebapplication
o Structure&designo Functionalityo Benefitso Challenges
2
University of Central FloridaBasicCarnegieclassification:researchuniversities(highresearchactivity)
UCFalsoachievedCarnegieCommunityEngagementClassification
2ndlargestuniversityinU.S.with56,337students10regionalcampusesandnumerousotherinstructionalsites
12colleges,includingamedicalcollege216degreeprograms(91bachelor’s,92master’s,3specialist,29doctoral,1professional)
UCF’s Integrated Approach to Institutional Effectiveness
4
Linkages• shareinformation• informbudgetprocess
Differences• differentcycles• additionaldataelements• differentpurposes
o continuouso improvemento evaluationo planning
InstitutionalEffectivenessAssessment
UnitandProgramReview
StrategicPlanning
Assessment Leadership
Coordinators
DRCMembers
UAC
ProvostVPsandDeans
President
5
Assessment Scope and Schedule
354programsandunitsreporto Yearroundprocesso Centralizedonlinereportingsystemo OngoingreviewsandfeedbackbyDRC
Over800usersinvolvedinconductingassessmentorganizationchart
September– Coordinatorssubmitfinalresultsandplans
October– DRCsreviewresultsandplans
NovembertoDecember– UACfinalreview
6
Structure and Design of Institutional Effectiveness Assessment Web Application
7
UCF IE Assessment Web Application: Structure and Design
Step1:Understandthebusinessprocesso Identifyextraneousand/orredundantstepso Identifychecksandbalancesneededforregulatory
compliance Step2:Conductactivityanalysis
o Identifytheusersanddifferentlevelsofaccesstothedata
o Identifytheinformationthatwouldhelptheusersdotheirjobeffectively
8
UCF IE Assessment Web Application: Structure and Design
Step3:DevelopRequirementsDocumento Shouldbeasspecificaspossibleo Shouldbeoutlineinaneasytounderstandformato Takeintoconsiderationthelimitationsoftime,
experience,database,programminglanguagetobeused
o Sign‐offfromkeystakeholders,especiallythedevelopers
o Originalflowcharto Finalflowchart
9
UCF IE Assessment Web Application: Structure and Design
Step4:DatabaseDesignandDevelopmento MicrosoftSQL2005(Now2008)o BasedonrelationshipsbetweenDRCs,
program/units,usersandtheirroles AssessmentCoordinators DivisionalReviewCommitteeMembers DivisionalReviewChair AssessmentSupportStaff
o Parameterscollectedfortheassessmentplan/resultsandtheirreviews
o Additionalparameterscollectedforstrategicplanningandaccreditation
10
UCF IE Assessment Web Application: Structure and Design
Step5:ApplicationDesignandDevelopmento MicrosoftASP.net/VB.net2.0Framework(Now3.5)o MasterPagecontainingglobalvariableso BasedonRequirementsDocument UserRolesandSecurity CollectionofAssessmentPlan/ResultsandReviews Validationandverification Additionalparameterscollected Reports Staffmanagementfunctions
11
UCF IE Assessment Web Application: Structure and Design
Step6:Testingo Workflowo Functionalityo Validationofdatao Design,developmentandtesting
Step7:Deploymento Turnovero Documentationo Support
12
UCF IE Assessment Web Application Template
13
UCF IE Assessment Web Application: Structure and Design
14www.assessment.ucf.edu
UCF IE Assessment Web Application: Structure and Design
15
UCF IE Assessment Web Application: Structure and Design
16
17
UCF IE Assessment Web Application:Structure and Design
18
UCF IE Assessment Web Application:Structure and Design
Functionality, Characteristics and Benefits of IE Assessment Web Application
19
UCF IE Assessment Web Application: Functionality
Primarymediumusedto:o submitassessmentplansandresultso reviewandprovidefeedbacko captureuserinformationo monitorprogresso platformforreviewerinterventiontoincreasethequalityofassessmentplansandresults
Abletocopyoverfrompreviousyear’sassessmentplano wholeorcomponentso edit
20
UCF IE Assessment Web Application: Functionality
Provides“n”numberofresultsorplansubmissionsafterreviewandfeedback
Passwordprotectedo usersinvolvedintheassessmentprocessmustlogintouseit
Automatedverificationprocessandfeedbacktotheusero numberofoutcomesandmeasureso academiclearningcompactso implementedandplannedchangeso resultsandreflectivestatemento resultstobesubmittedbeforeplan
21
UCF IE Assessment Web Application: Characteristics
Multi‐raterreviews Collaboration
o automatedemailnotification Reportingandqueries
o UAC,DRCmemberandstaff Documentuseofdataandnextsteps Resourcecenterwithintheapplicationbyrole AdministrationoftheDRCs
o usersandroleso namesoftheunitsandprogramso mergesandsplits
22
UCF IE Assessment Web Application: Characteristics
Easynavigation Helpbuttonforeachtab
o definitionsoftermsandinstructionstocompletethetasks
Enhancedtextbox– cutandpasteandotherMicrosofttoolbarcapabilities
Uploadattachmentslinkedtostudentlearningoutcomes
Archiving Security
o useofbestpracticestopreventattacks
23
UCF IE Assessment Web Application: Benefits
Focusesonassessingwhatis:o meaningfulo manageableo measureable
Assistsuserstoembracechangeasaprocess Trackshealthovertime
o academicprogramorunito collegeordivision
Integratesprocesseso accreditationo strategicplanning
24
UCF IE Assessment Web Application:Benefits
Customizable Transportable Userfriendly Timemanagement ITcompliant Datamining Buildreportsdependingonneed
25
Proposition of Building vs. Buying
Qualityimprovementinrealtimeo Reportsforexternalaccreditationagencieso Loginforexternalrevieweranduniversityofficial
Continuetocustomize Mapstobusinessprocess Flexibilitytoproducereporttodeepenthequalityofwork
Costeffective Responsivenesstoexternalrequests
26
UCF IE Assessment Web Application: Challenges
Realistictimeline Resourcestobuildandmaintain Commitmentofstafftime
o requirementsdocumento testingo helpcontentandinstructions
Iterativerollouto adjustuserexpectations
27
Contact InformationDr.DivyaBhati Dr.PatriceLanceyAssociateDirector [email protected] [email protected]
OperationalExcellenceandAssessmentSupportwww.oeas.ucf.edu
28
