Peeking Inside an Peeking Inside an Institution’s Planning Toolbox Institution’s Planning Toolbox Karen A. DeMonte Karen A. DeMonte Senior Institutional Research Analyst, Institutional Senior Institutional Research Analyst, Institutional Research & Planning Research & Planning University of Delaware University of Delaware Heather A. Kelly Heather A. Kelly Assistant Director, Institutional Research & Planning Assistant Director, Institutional Research & Planning University of Delaware University of Delaware Allison M. Walters Allison M. Walters Research Analyst, Institutional Research & Planning Research Analyst, Institutional Research & Planning University of Delaware University of Delaware Office of Institutional Research & Planning
Transcript
Peeking Inside an Institution’s Peeking Inside an Institution’s Planning ToolboxPlanning Toolbox
Karen A. DeMonteKaren A. DeMonteSenior Institutional Research Analyst, Institutional Research & Senior Institutional Research Analyst, Institutional Research & PlanningPlanningUniversity of DelawareUniversity of Delaware
Heather A. KellyHeather A. KellyAssistant Director, Institutional Research & PlanningAssistant Director, Institutional Research & PlanningUniversity of DelawareUniversity of Delaware
Allison M. WaltersAllison M. WaltersResearch Analyst, Institutional Research & PlanningResearch Analyst, Institutional Research & PlanningUniversity of DelawareUniversity of Delaware
Office of Institutional Research & Planning
University of DelawareUniversity of Delaware
Located in suburban Newark, Located in suburban Newark, Delaware midway between Delaware midway between Philadelphia and BaltimorePhiladelphia and Baltimore
Origins back to 1743, was Origins back to 1743, was chartered in 1833chartered in 1833
Public, State Assisted Public, State Assisted UniversityUniversity
Research University (very high Research University (very high research activity)research activity)
UD offers 126 undergraduate UD offers 126 undergraduate and 121 graduate programs in and 121 graduate programs in 7 Colleges and 54 Academic 7 Colleges and 54 Academic unitsunits
Fall 2006 enrollment totaled Fall 2006 enrollment totaled 15,849 undergraduate and 15,849 undergraduate and 3,446 graduate students3,446 graduate students
1,077 full time faculty 1,077 full time faculty members of whom 832 are members of whom 832 are Tenured/Tenure Track (Fall Tenured/Tenure Track (Fall 2005 data)2005 data)
On average, 90% of freshmen On average, 90% of freshmen return sophomore year and return sophomore year and approximately 3 out of 4 approximately 3 out of 4 students graduate in five yearsstudents graduate in five years
Background & Background & ObjectivesObjectives
Support University’s academic, Support University’s academic, financial, and planning effortsfinancial, and planning efforts– Budget Support NotebookBudget Support Notebook– National Study of Instructional Costs National Study of Instructional Costs
& Productivity (a.k.a. Delaware Study)& Productivity (a.k.a. Delaware Study)– FIPSE-Funded Analysis of Out-of-FIPSE-Funded Analysis of Out-of-
Classroom Faculty Activity Study Classroom Faculty Activity Study (a.k.a. Faculty Activity Study)(a.k.a. Faculty Activity Study)
Budget Support Budget Support NotebookNotebook
Background:Background:– Was developed in 1990 as a means to support decisions Was developed in 1990 as a means to support decisions
related to budget cuts and workforce reductionsrelated to budget cuts and workforce reductions– Has evolved from a series of hand-entered Excel Has evolved from a series of hand-entered Excel
spreadsheets to an automated secure web sitespreadsheets to an automated secure web site
Contains three years of productivity measures to help Contains three years of productivity measures to help track trendstrack trends
Fully integrated Secure Web SiteFully integrated Secure Web Site
Secured to Senior Administrators, Deans, and Chairs Secured to Senior Administrators, Deans, and Chairs with open access between departmentswith open access between departments
Budget Support Budget Support NotebookNotebook
Source DocumentsSource Documents Faculty Workload Report - eFaculty Workload Report - examines the xamines the
teaching activity by individual instructor for the teaching activity by individual instructor for the Fall and Fall and Spring semestersSpring semesters
Expenditures Report - summarizes fiscal year-Expenditures Report - summarizes fiscal year-end direct expenditures by unit within the end direct expenditures by unit within the University’s reporting hierarchy University’s reporting hierarchy
Charts comparing UD against National Norms Charts comparing UD against National Norms from the Delaware Studyfrom the Delaware Study
Various other University reportsVarious other University reports
The notebook is organized The notebook is organized by College and …by College and …
… … by Departments within by Departments within each collegeeach college
Productivity measuresProductivity measures– FTE MajorsFTE Majors– Degrees GrantedDegrees Granted– % Student Credit Hours Taught by Faculty on Appointment% Student Credit Hours Taught by Faculty on Appointment– % Student Credit Hours Taught by Supplemental Faculty% Student Credit Hours Taught by Supplemental Faculty
Fiscal DataFiscal Data– Research and ServiceResearch and Service– Cost of InstructionCost of Instruction– Revenue Measures (derived)Revenue Measures (derived)
Budget Support Budget Support NotebookNotebook
Why We Like ItWhy We Like It Easy to navigateEasy to navigate Compiles data from several sources into one Compiles data from several sources into one
document document Contains trend dataContains trend data Includes charts comparing UD against Includes charts comparing UD against
National Norms from the Delaware StudyNational Norms from the Delaware Study Fully accessible by Deans and Chairs for Fully accessible by Deans and Chairs for
comparisons within the University on the webcomparisons within the University on the web Web site contains complete documentation Web site contains complete documentation
on how to interpret the various data elementson how to interpret the various data elements
The Delaware StudyThe Delaware Study
National benchmarking study used to examine:National benchmarking study used to examine:– Teaching loads by faculty classification and course Teaching loads by faculty classification and course
levellevel– Instructional costsInstructional costs– Externally funded research and serviceExternally funded research and service
……all at the discipline level of analysis.all at the discipline level of analysis.
Over 400 institutional participants since 1996 Over 400 institutional participants since 1996 including: including: – Members of Association of American Universities Data Members of Association of American Universities Data
Exchange (AAUDE).Exchange (AAUDE).– Members of the Southern Universities Group (SUG).Members of the Southern Universities Group (SUG).– University of Missouri System.University of Missouri System.– University of North Carolina System.University of North Carolina System.
The Delaware StudyThe Delaware StudyData Collection TemplateData Collection Template
The Delaware Study – Data The Delaware Study – Data ResultsResults
Benchmarks provided by:Benchmarks provided by:– Carnegie ClassificationCarnegie Classification– Highest Degree AwardedHighest Degree Awarded– Undergraduate/Graduate Program MixUndergraduate/Graduate Program Mix
Customized Peer AnalysesCustomized Peer Analyses
Refined means are used to produce the benchmarks. Refined means are used to produce the benchmarks. An initial mean is calculated from the valid values for all An initial mean is calculated from the valid values for all
institutions reporting data for a given CIP or discipline, within institutions reporting data for a given CIP or discipline, within the benchmark category.the benchmark category.
The standard deviation is calculated along with the mean.The standard deviation is calculated along with the mean. Those institutions with values of more than two standard Those institutions with values of more than two standard
deviations above or below the initial mean are defined as deviations above or below the initial mean are defined as outliers.outliers.
A 'Refined Mean' is then calculated, excluding outliers as A 'Refined Mean' is then calculated, excluding outliers as defined above. defined above.
Data Detailed as Follows:Data Detailed as Follows:
Table 1: Percent SCH and OCS by Faculty Table 1: Percent SCH and OCS by Faculty Category within Course LevelCategory within Course Level
Table 2: Percent SCH and OCS by Course Table 2: Percent SCH and OCS by Course
Level within Faculty CategoryLevel within Faculty Category Table 3: SCH, OCS, and FTE Students per Table 3: SCH, OCS, and FTE Students per
The Delaware Study - UsesThe Delaware Study - Uses
Assess department productivity Assess department productivity and costs.and costs.
Compare institutional data to Compare institutional data to national benchmarks and/or self-national benchmarks and/or self-selected peer groups.selected peer groups.
Provides current and longitudinal Provides current and longitudinal data for departmental planning data for departmental planning and resource allocation.and resource allocation.
We invite you to visit the Delaware Study website:
http://www.udel.edu/IR/cost
National Center for Education Statistics indicate that full-time faculty at four-year institutions report they spend approximately one-half of their time on teaching activities, which includes approximately 9 hours per week in the classroom (NCES; Cataldi, Bradburn, Fahimi, Zimbler, 2005NCES; Cataldi, Bradburn, Fahimi, Zimbler, 2005).
The term “work load” is often thought to refer to the time faculty spend in the classroom. However, work load relates to faculty work and the numerous associated activities and responsibilities in and out of the classroom (Braskamp & Ory, 1994).
Is Faculty Work Is Faculty Work Understood?Understood?
Faculty Activity Study - Faculty Activity Study - PurposePurpose
Help alleviate misunderstandings of Help alleviate misunderstandings of faculty activity by providing faculty activity by providing information to discuss what faculty information to discuss what faculty actually do, how much they do, and actually do, how much they do, and the associated products. the associated products.
Faculty Activity Study - GoalFaculty Activity Study - Goal
Demonstrate faculty outputs that are a result of faculty Demonstrate faculty outputs that are a result of faculty spending time outside the classroom on non-instructional spending time outside the classroom on non-instructional activities.activities.
– Teaching (i.e., redesigning course curriculum, advising Teaching (i.e., redesigning course curriculum, advising students, or conducting research with students)students, or conducting research with students)
– Scholarship (i.e., refereed and non-refereed Scholarship (i.e., refereed and non-refereed publications, editorial positions, juried shows and publications, editorial positions, juried shows and commissioned performances, or grant activity)commissioned performances, or grant activity)
– Service (i.e., institutional service, faculty extension and Service (i.e., institutional service, faculty extension and outreach activities, or professional service).outreach activities, or professional service).
The overall goal is to provide evidence regarding program The overall goal is to provide evidence regarding program productivity, as well as the means to encourage more productivity, as well as the means to encourage more effective management in higher education. effective management in higher education.
Faculty Activity Study - Faculty Activity Study - ResultsResults
• RefinedRefined meansmeans were not calculated for were not calculated for the variables owing to the relatively the variables owing to the relatively small number of participating small number of participating institutions within each Carnegie institutions within each Carnegie institution type, and the large variance institution type, and the large variance in data responses.in data responses.
• The large variance for the majority of The large variance for the majority of the variables within each Carnegie the variables within each Carnegie classification makes the classification makes the medianmedian a a better statistic to describe the central better statistic to describe the central tendency for the sample.tendency for the sample.
Activities Related to Teaching:Activities Related to Teaching:
Department X: Activities Related to Teaching2002 Median Analysis
0.00
2.00
4.00
6.00
8.00
10.00
12.00
RedesignCurriculum
UgradResearch
GradResearch
UgradAdvisees
GradAdvisees
Activity
Per
To
tal
Res
po
nd
ents
Baccalaureate
Comprehensive
Doctoral
Research
Department X: Activities Related to Teaching2003 Median Analysis
0.00
2.00
4.00
6.00
8.00
10.00
12.00
RedesignCurriculum
UgradResearch
GradResearch
UgradAdvisees
GradAdvisees
Activity
Per
To
tal
Res
po
nd
ents
Baccalaureate
Comprehensive
Doctoral
Research
Activities Related to Activities Related to Scholarship:Scholarship:
Department X: Activities Related to Scholarship2002 Median Analysis
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
4.50
JuriedShow s,
Exhibitions
Refer Pubs Nonref Pubs Ext GrantProposals
ExternalGrants
Aw ardedActivity
Per
To
tal R
esp
on
den
ts
Baccalaureate
Comprehensive
Doctoral
Research
Department X: Activities Related to Scholarship2003 Median Analysis
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
4.50
JuriedShow s,
Exhibitions
Refer Pubs Nonref Pubs Ext GrantProposals
ExternalGrants
Aw ardedActivity
Per
To
tal R
esp
on
den
ts
Baccalaureate
Comprehensive
Doctoral
Research
Activities Related to Service:Activities Related to Service:
Department X: Activities Related to Service2002 Median Analysis
0.00
1.00
2.00
3.00
4.00
5.00
6.00
Leadership inProf Assoc
Prof Service Ext/Outreach Inst Service
Activity
Per
To
tal
Res
po
nd
ents
Baccalaureate
Comprehensive
Doctoral
Research
Department X: Activities Related to Service2003 Median Analysis
0.00
1.00
2.00
3.00
4.00
5.00
6.00
Leadership inProf Assoc
Prof Service Ext/Outreach Inst Service
Activity
Per
To
tal R
esp
on
den
ts
Baccalaureate
Comprehensive
Doctoral
Research
Utilizing theUtilizing theFaculty Activity StudyFaculty Activity Study
Provides contextual information and supplies a Provides contextual information and supplies a backdrop for examining DE Study’s teaching backdrop for examining DE Study’s teaching loads and associated costs.loads and associated costs.
Institutions experiencing state mandates have Institutions experiencing state mandates have combined state-mandated elements with the combined state-mandated elements with the Faculty Activity Study variables to develop one Faculty Activity Study variables to develop one instrument.instrument.
Institutions have integrated Faculty Activity Institutions have integrated Faculty Activity Study variables into their annual review Study variables into their annual review process.process.
Data facilitates informed decision-making Data facilitates informed decision-making processes.processes.
Data helpful in answering requests from state Data helpful in answering requests from state agencies, as well as other external agencies, as well as other external constituents.constituents.
Faculty Activity Study – Faculty Activity Study – ConclusionConclusion
The Faculty Activity Study provides evidence that The Faculty Activity Study provides evidence that faculty engage in activities such as curriculum redesign, faculty engage in activities such as curriculum redesign, academic advising, thesis and dissertation supervision, academic advising, thesis and dissertation supervision, academic scholarship, and service to the institution, academic scholarship, and service to the institution, community, and profession. community, and profession.
While institutional mission is reflected by how faculty While institutional mission is reflected by how faculty spend their time, regardless of Carnegie Classification, spend their time, regardless of Carnegie Classification, faculty engage in teaching, scholarship, and service.faculty engage in teaching, scholarship, and service.
The data collected has the potential to provide evidence The data collected has the potential to provide evidence about program productivity.about program productivity.
This information will facilitate informed decision making This information will facilitate informed decision making and encourage more effective management in higher and encourage more effective management in higher education. education.
We invite you to visit the Faculty Activity Study website:
http://www.udel.edu/IR/fipse
Using the “Tools” in Using the “Tools” in PracticePractice
Answer frequently asked Answer frequently asked questions from Academic unitsquestions from Academic units
Academic Program ReviewAcademic Program Review Departmental request for Departmental request for
IR Provides…IR Provides…– Budget Support Budget Support
Notebook Notebook pagespages
– Delaware Study Delaware Study comparison comparison charts against charts against National NormsNational Norms
– Other standard Other standard reportsreports
Customized Peer Customized Peer StudiesStudies
How do we How do we compare?compare?
Academic units Academic units select their peer select their peer group from the group from the list of Delaware list of Delaware Study Study participantsparticipants
AccreditationAccreditation
Middles States Standard 7Middles States Standard 7
The institution has developed and The institution has developed and implemented an assessment plan and implemented an assessment plan and process that evaluates its overall process that evaluates its overall effectiveness in: achieving its mission and effectiveness in: achieving its mission and goals; implementing planning, resource goals; implementing planning, resource allocation, and institutional renewal allocation, and institutional renewal processes; enhancing institutional integrity; processes; enhancing institutional integrity; and assuring that institutional processes and assuring that institutional processes and resources support appropriate learning and resources support appropriate learning and other outcomes for its students and and other outcomes for its students and graduates.graduates.
Resource AllocationResource Allocation
Budget Support Notebook Budget Support Notebook provides intra-university provides intra-university comparisons of comparisons of quantitativequantitative data data
Delaware Study provides national Delaware Study provides national comparisons of comparisons of quantitativequantitative data data
Faculty Activity Study provides Faculty Activity Study provides analysis of analysis of qualitativequalitative data data
