Mission Statement

Computer Information & Office Systems

Associate of Applied Science Degree

Educational Effectiveness

Assessment Plan

Adopted by:

CIOS faculty, October 29, 2007

Submitted to:

Dean of the Community and Technical College: October 29, 2007

UAA Office of Academic Affairs: October 29, 2007

document.doc Submitted 10-29-07 Page 1 of 19

TABLE OF CONTENTS

Mission Statement......................................................................................................................4

Program Introduction..................................................................................................................5

Assessment Process Introduction...............................................................................................6

Outcomes................................................................................................................................... 7

Associate Of Applied Science, Computer Information And Office Systems.............................7

Assessment Tools.......................................................................................................................8

Association of Tools to Program Outcomes..............................................................................10

Assessment Implementation and Analysis for Program Improvement......................................12

General Implementation Strategy..........................................................................................12

Method of Data Analysis and Formulation of Recommendations for Program Improvement 12

Modification of the Assessment Plan.....................................................................................13

Appendix A: Exit Timing Test....................................................................................................14

Description:............................................................................................................................14

Factors That Affect The Collected Data:................................................................................14

How To Interpret The Data:...................................................................................................14

Appendix B: 3rd Party Software (My IT Lab, SNAP, SIMNET, Microsoft Office Specialist Certification) or Project Rubric..................................................................................................15

Description:............................................................................................................................15



Appendix C: Portfolio and Resume Rubric................................................................................16

Description:............................................................................................................................16


How To Interpret The Data....................................................................................................16document.doc Submitted 10-29-07 Page 2 of 19

Appendix D: Report Rubric.......................................................................................................17

Description:............................................................................................................................17



Appendix E: Teamwork Rubric.................................................................................................18

Description:............................................................................................................................18



Appendix F: Employer Internship Survey..................................................................................19

Description:............................................................................................................................19



Appendix G: Independent Project Rubric..................................................................................21

Description:............................................................................................................................21




MISSION STATEMENT

The CIOS mission is to produce academically and technically trained administrative professionals to meet Alaska’s business and industry needs.


PROGRAM INTRODUCTION

The Computer Information and Office Systems (CIOS) Department prepares students to successfully engage in business office environments where communication, technical, organizational, interpersonal, and teamwork skills are essential to business success. CIOS assists students in developing and refining lifelong learning skills, while fostering flexible career path options and building confidence to adapt to new technological demands in the workplace.

This Associate of Applied Science Degree program prepares students for career entry or career advancement in a variety of office settings and also offers skill building for personal use. It provides students with the technical, administrative, and human relations skills required of office professionals. Both the Office Foundations and the Office Support OEC articulate directly into this degree.


ASSESSMENT PROCESS INTRODUCTION

This document defines the educational outcomes for the Computer Information and Office Systems Associate of Applied Science Degree and outlines a plan for assessing the achievement of the stated outcomes. CIOS used results of a survey of administrative professionals and their supervisors, a DACUM chart from Greenville Community College, and input from advisory committee members and other industry representatives to revise the curriculum in AY07-08. This curriculum revision will focus emphasis areas and reduce the number of certificates offered while articulating courses with the AAS degree.

The CIOS department consulted the National Business Education Association1 standards to develop the outcomes in this plan. We then conducted an assessment workshop with other UA CIOS faculty to create standardized rubrics for faculty to use in measuring those outcomes.

Community Campus faculty contributed to and agreed upon the content of the rubrics in this plan. Instructors may opt to use either the rubric or 3rd party software to assess computer application skills, so in each appendix we have included both the project rubric and the option to use 3rd party software scores as an assessment tool. The Goose Lake campus will use 3rd party software scores to assess the associated outcomes in this plan.

1 National Business Education Association. (2007). National standards for business education. Reston, VA: Author.


OUTCOMES

The following outcomes are based on the National Business Education Association standards in the area of basic communication skills, basic technical skills, organizational skills, interpersonal skills, and teamwork skills.

These outcomes are published on the CIOS website and in the UAA catalog under the CIOS Associate of Applied Science Degree area.

ASSOCIATE OF APPLIED SCIENCE, COMPUTER INFORMATION AND OFFICE SYSTEMS Upon completion of this program, students will demonstrate:

1. Keyboarding skills of 40 net words per minute, to be measured in CIOS A102 Keyboarding Skill Building.

2. Intermediate skills that utilize advanced features in word processing, spreadsheet, and database software, to be measured in CIOS A230A Word Processing II: MS Word, CIOS A235A Spreadsheets II: MS Excel, and CIOS A240A Databases II: MS Access.

3. Oral and written communications skills that meet business standards, to be measured in CIOS A260A Business Communications and CIOS A262 Professional Development.

4. Application of critical thinking skills to make effective decisions and solve problems, to be measured in CIOS A276A Independent Project or CIOS A282 Office Internship.

5. Professional behavior and interpersonal skills, to be measured in CIOS A261A Interpersonal Skills in Organizations and CIOS A282 Office Internship.


ASSESSMENT TOOLS

We propose the following tools to assess outcomes of the CIOS program:

Tool FrequencyAdministered

ByCollection Method

Analyzed By

Exit Timing TestEvery semester:

CIOS A102Staff

Collect course end timing from instructor of record and average.

Faculty

3rd party software (MY IT Lab, SNAP, SIMNET, etc.)

As scheduled:

CIOS A230AStaff

Collect letter grades from final concepts and skills assessments instructor of record and average them.

Faculty


As scheduled:

CIOS A235AStaff


Faculty


As scheduled:

CIOS A240AStaff


Faculty

Project Rubric (Report)

As scheduled:

CIOS A260AStaff

Collect letter grade for final student project from instructor of record and average.

Faculty

Project Rubric (Teamwork)

As scheduled:

CIOS A261AStaff

Collect letter grade for final student project from instructor of record and average.

Faculty

Project Rubric (Independent Project)

As scheduled:

CIOS A276AStaff

Collect final course letter grade from instructor of record and average.

Faculty

Project Rubric (Resume and portfolio)

As scheduled: CIOS A262A

Staff

Collect portfolio final letter grade and resume final letter grade from Blackboard or instructor of record and average them.

Faculty


Employer internship survey

As scheduled:

CIOS A282Staff

Distribute CIOS A282 survey and collect results; place in Excel spreadsheet for evaluation.

Faculty


ASSOCIATION OF TOOLS TO PROGRAM OUTCOMES

0 = Tool is not used to measure the associated objective.1 = Tool is use to measure the associated objective.

Exi

t T

imin

g

Tes

t

3rd p

art

y so

ftw

are

Pro

ject

Rub

ric

Em

ploy

er

Inte

rnsh

ip

Sur

vey

1. Keystroke skills 40 nwpm. 1 0 0 0

2a. Intermediate skills that utilize advanced features in word processing software.

0 1 0 1

2b. Intermediate skills that utilize advanced features in spreadsheet software.

0 1 0 1

2c. Intermediate skills that utilize advanced features in database software.

0 1 0 1

3a. Oral communications skills that meet business standards.

0 0 1 1

3b. Written communications skills that meet business standards.

0 0 1 1

4. Application of critical thinking skills to make effective decisions and solve problems.

0 0 1 1

5a. Professional behavior. 0 0 0 1

5b. Interpersonal skills. 0 0 1 1


ASSESSMENT IMPLEMENTATION AND ANALYSIS FOR PROGRAM IMPROVEMENT

GENERAL IMPLEMENTATION STRATEGY Many CIOS classes incorporate team projects and research outside of class which employ critical thinking skills and the use of software to develop written communication and presentation materials. CIOS faculty will use rubrics where appropriate to standardize evaluation procedures across all classes. Both faculty members have agreed to collaborate and use theses rubrics. The department will also ensure adjunct faculty know the purpose of the rubrics and use them to evaluate their course outcomes.

The department will work with staff to collect data. Faculty will also work with the CIOS lab technician to administer the keyboarding skills test and report the results.

METHOD OF DATA ANALYSIS AND FORMULATION OF RECOMMENDATIONS FOR PROGRAM IMPROVEMENT The program faculty will meet in May each year to collect and review data from the associated tools. The results of the data collection, an interpretation of the results, and the recommended programmatic changes will be forwarded in the CIOS Assessment Report to the department associate dean, the CTC assessment coordinator, and the UAA Office of Academic Affairs by June 15 each year. A plan for implementing any recommended changes will be sent to the program’s stakeholders.

The proposed programmatic changes may be any action or change in policy that the faculty deems as being necessary to improve performance relative to programs objectives and outcomes. Recommended changes should also consider workload (faculty, staff, and students), budgetary, facilities, and other relevant constraints. A few examples of changes made by programs at UAA include:

o Changes in course content, assessment, scheduling, sequencing, prerequisites,

delivery methods, etc.

o Changes in faculty/staff assignments

o Changes in advising methods and requirements

o Addition and/or replacement of equipment

o Changes to facilities

o Changes or upgrades to software or other course tools


MODIFICATION OF THE ASSESSMENT PLAN After reviewing the collected data and the processes used to collect it, faculty will alter the assessment plan. Changes will be made to any component of the plan, including the objectives, outcomes, assessment tools, or any other aspect of the plan. The modified assessment plan will be forwarded to the dean/director’s office and the Office of Academic Affairs.


APPENDIX A: EXIT TIMING TEST

DESCRIPTION: A keyboarding timed test will be administered in the CIOS lab by staff or faculty. All scores are recorded in the Blackboard gradebook and exported to a Microsoft Excel spreadsheet at the end of each semester.

FACTORS THAT AFFECT THE COLLECTED DATA: Lab hours may not support the students’ schedules, so coordinating testing times may impact testing. Since this course is offered as an open entry (self-paced) course, students’ ability to organize their time to complete the course requirements on time causes many failures. Technological problems may also impact the students’ ability to take the test.

HOW TO INTERPRET THE DATA: A score of 40 or more net words per minute with less than two errors demonstrates proficiency. A report can be printed from the keyboarding software for recording.

The “tool” for this timing test is the report generated by the keyboarding program when the student completes the exam. The student’s net words per minute are recorded on a score sheet. A sample is attached.

Keyboarding A Exit Timing Example.pdf


Appendix B: 3rd Party Software (My IT Lab, SNAP, SIMNET, Microsoft Office Specialist Certification) or Project Rubric

DESCRIPTION: Data will be collected from CIOS A230A Word Processing II: MS Word, CIOS A235A Spreadsheets II: MS Excel, and CIOS A240A Databases II: MS Access. Faculty may choose to use 3rd party software, which a publisher will usually associate with the book chosen for a particular course. Because this software is increasingly user friendly and facilitates skills-based exams, it can be a good choice for evaluating students. Faculty can set up pretests and posttests to evaluate learning objectives. Exam scores are easily collected and evaluated to determine the extent of student learning. Copies of exams are not included in this plan for security reasons. Microsoft Office Specialist Certification exams are another valid way to collect data on student performance with this software.

FACTORS THAT AFFECT THE COLLECTED DATA: Technological problems could impact students’ ability to complete tests since they’re done completely online. Open-entry style courses can be difficult for students to complete, resulting in some failures. The Microsoft Office Specialist exams are expensive and difficult, and most students will not opt to take them, but we’ll encourage them to do so through the Eagle River campus testing center.

HOW TO INTERPRET THE DATA: Passing is 70 percent when using the 3rd party software.

The overall score from the rubric, if used, will indicate performance and result in a letter grade of A – F.

CIOS A230 Project Rubric.xls




APPENDIX C: PORTFOLIO AND RESUME RUBRIC

DESCRIPTION: These rubrics are used for CIOS A262A Professional Development. After developing a portfolio and resume throughout the semester, students will apply for a job and participate in a mock interview for that job. Their performance will be evaluated with the rubrics linked below.

FACTORS THAT AFFECT THE COLLECTED DATA: Scheduling students for live interviews if this is an online course will be a challenge. Although we can use video conference for students outside of Anchorage, it will still be difficult to fairly grade appearance without meeting in person while we could meet directly with Anchorage students and get a more realistic picture of their overall performance. Instructor subjectivity will influence the data collected; committees could reduce the impact by averaging scores from each committee member.

HOW TO INTERPRET THE DATA The overall score between the interview and portfolio will indicate the level of performance and will result in a letter grade of A – F.

CIOS A262A Interview and Portfolio Rubric.xls


APPENDIX D: REPORT RUBRIC

DESCRIPTION: Students will create reports in CIOS A260A Business Communication to demonstrate their written skills. This rubric is based on business standards and is linked in the file below.

FACTORS THAT AFFECT THE COLLECTED DATA: Plagiarism can be a problem because of the ease of copying content from the Internet. Unless the instructor becomes a plagiarism cop, they may not discover a student has plagiarized. The instructor must commit time and resources to figure out what to do. CIOS faculty will typically choose to give students caught plagiarizing a zero grade, which will influence the overall scores. If not caught, their writing is an inaccurate representation of their skills, making the rubric a tool for evaluating someone else’s work rather than the student’s own.

HOW TO INTERPRET THE DATA: The score will indicate the level of performance and will result in a letter grade of A – F.

CIOS A260 Project Rubric.xlsx


APPENDIX E: TEAMWORK RUBRIC

DESCRIPTION: This rubric will be used in CIOS A261A Interpersonal Communication Skills to measure student interpersonal skills and professional behavior while working with a team. A sample rubric is linked below.

FACTORS THAT AFFECT THE COLLECTED DATA: If this course is conducted online, instructors must monitor group work carefully to detect the group dynamics present since student interactions in an online class differ greatly from face-to-face interactions.

HOW TO INTERPRET THE DATA: The score will indicate the level of performance and will result in a letter grade of A – F.



APPENDIX F: EMPLOYER INTERNSHIP SURVEY

DESCRIPTION: This will be used for students who participate in CIOS A282 Office internship. The survey is linked below.

FACTORS THAT AFFECT THE COLLECTED DATA: It may be difficult to get employers to respond either with a paper form or an electronic form. This will take close coordination with the intern’s supervisor. We hope sending it via email and offering the opportunity complete it electronically and return it via email will increase participation.

HOW TO INTERPRET THE DATA: The overall employer rating must be an average of 3 (based on the numerical value assigned to Professional Behavior, Communication, and Interpersonal Skills, Technical Skills, and Critical Thinking and Problem Solving Skills areas on the survey—a rating of Excellent = 5; Satisfactory = 3, and Poor = 0 ). The current survey is attached below and is still under revision, but represents what we’re trying to achieve with the survey. If completed electronically and sent back via email, it will be received as an xhtml file which can then be entered into an Excel spreadsheet for calculation.

Care should be taken to investigate and discuss the factors influencing the results before interpreting the outcome. Personality conflicts and not being the right fit for a particular organization can influence performance and impact the ability to get a true picture of how the program is preparing students for the workforce.

Employer internship survey.pdf


APPENDIX G: INDEPENDENT PROJECT RUBRIC

DESCRIPTION: Data will be collected from CIOS A276A Independent Project. This rubric will be used to evaluate students who do not participate in an internship because it is not appropriate for them. The rubric is linked below.

FACTORS THAT AFFECT THE COLLECTED DATA: Potential roadblocks students may face accomplishing their objectives in the business place. They will need to work closely with supervisors and other employees so they can meet the project goals and deadlines.

HOW TO INTERPRET THE DATA: The overall score will result in a grade of Pass/No Pass.



Date post:	12-Jan-2015
Category:	Documents
Upload:	terry34
View:	609 times
Download:	1 times

Mission Statement

Documents