ACEJMC Standard 9 9-1
STANDARD 9: ASSESSMENT OF LEARNING OUTCOMES
COM student award winners at
Eastern States Communication Association L-R Top: Sarah Horton, Meg Stookey, Amanda King
ACEJMC Standard 9 9-2
STANDARD 9: ASSESSMENT OF LEARNING OUTCOMES
Highlights
The ACEJMC professional values and competences are reflected in the Nido R. Qubein School of Communication’s (NQSC’s) Values and Competencies. These standards guide all faculty in preparing their syllabi and teaching their courses. The NQSC has also developed an assessment matrix that matches COM course descriptions with these values and competencies so that we can visualize how they are addressed and reinforced throughout each COM sequence. (See Standard 2, item 3)
The NQSC’s formal assessment plan for learning outcomes (APPENDIX
9.1) uses the following direct and indirect measures: a LinkedIn-based student portfolio; a written competency exam measuring the cognitive learning conditions of first and fourth year cohorts; evaluations of interns by site supervisors and faculty; exit surveys of graduating seniors; program review and production critiques by communication professionals in the Dean’s Advisory Council; input from currently enrolled students in the Student Advisory Board; and an alumni survey.
The NQSC utilizes communication professionals for some assessment. The Dean’s Advisory Council assists with course assessment by evaluating random samples of student work and by auditing faculty instruction; the NQSC uses the Council’s feedback to assess the relevance of the curriculum and the quality of student work expressed in students’ LinkedIn based electronic portfolios. Also, internship supervisors evaluate student performance based on the competencies.
The NQSC is committed to the development, implementation and on-
going data driven assessment of learning. The School collects and stores quantitative and qualitative data relevant to these competency outcomes and compiles these data in an assessment report (APPENDIX 9.2) provided to faculty and discussed in the annual faculty retreat. This information has guided the formative and summative reviews of the
ACEJMC Standard 9 9-3
effectiveness of the NQSC’s curriculum and its execution in delivering related student services. Subsequent changes implemented to address real and perceived program weaknesses are ongoing.
ACEJMC Standard 9 9-4
STANDARD 9: ASSESSMENT OF LEARNING OUTCOMES 1. Provide a copy of unit’s written plan for assessment of student learning outcomes. This plan must include the date of its adoption and of implementation of its components. The Nido R. Qubein School of Communication’s (NQSC/School) comprehensive plan for the assessment of learning outcomes is designed to determine if the program is meeting identified learning objectives at the conclusion of the curriculum (summative assessment), and to facilitate any necessary revision of the School’s curricular, service, and programmatic elements to better meet the defined learning objectives (formative assessment). In 2012, the faculty mapped all COM courses to correlate with these competencies in order to see where defined learning was supposed to take place. A comprehensive assessment plan was finalized in spring/summer 2014 and approved by the faculty in fall 2014. The assessment data is presented for three areas under ACEJMC review: Electronic Media Production, Journalism, and Strategic Communication. Data for this report, collected in the fall of 2014, is the School’s first formal assessment since adopting the new assessment plan. The assessment plan is included as APPENDIX 9.1.
NQSC Assessment Timeline The NQSC has experienced explosive growth since its inception in 2007. The first few years of the program were focused on curriculum development and faculty hiring. From the start of the program, however, assessment has been included. In Spring 2010, the first graduating class of students (N = 20) that had all of the major classes in NQSC completed a satisfaction survey (n = 12). These results were the start of the assessment feedback process that has continued each year. The provost authorized the NQSC to seek accreditation at the beginning of spring 2013. Prior to that, and in the next few semesters, the NQSC tested and evaluated a variety of assessment activities before finalizing its ACEJMC
ACEJMC Standard 9 9-5
assessment plan in summer 2014 (approved by faculty in the beginning of the fall 2014 semester). The final assessment plan includes four direct and four indirect measures (some assessment measured were discontinued because they yielded little data for assessment: reviews of teaching evaluations (See APPENDIX 9.13); observations of classes; re-evaluations of student assignments, etc. These are not included in the assessment report). Since the provost’s approval in January 2013, the School has conducted 22 separate assessment activities. Table 9.1 is a timeline that includes all NQSC development and assessment activity relevant to accreditation. The self-study includes assessment information through summer 2015, but assessment continues and is noted on the timeline.
ACEJMC Standard 9 9-6
TABLE 9.1: THE NQSC DEVELOPMENT AND ASSESSMENT TIMELINE
NQSC DEVELOPMENT AND ACCREDITATION EVENTS
YEAR NUMBER OF
UNDERGRADS
NQSC ASSESSMENT ACTIVITIES
Fall 2007 N = 13
The Nido R. Qubein School of Communication established
1 new faculty member starts
Fall 2008 N = 205
NQSC building grand opening
5 sequences established: Electronic Media Production, Game and Interactive Media Design, Journalism, Media and Popular Culture Studies, Strategic Communication
4 new faculty members start
Fall 2009 N = 295
NQSC building grand opening
2 faculty members hired
Spring 2010
ASSESSMENT: Graduating student exit survey
Fall 2010 N = 485
5 new faculty members start
ACEJMC Standard 9 9-7
Spring 2011
The MA program in Strategic Communication began operation
ASSESSMENT: Graduating student exit survey
Trevor Brown visits for ACEJMC accreditation pre-visit
NQSC develops SACS learning outcomes
First graduating class of students who had been in the NQSC for four years
Fall 2011 N = 578
3 new faculty members start; 1 faculty member left
Faculty develop NQSC values and competencies that align with ACEJMC’s values and competencies
Spring 2012
Faculty map all courses onto the NQSC ACEJMC competencies and values grid
ASSESSMENT: Graduating student exit survey
Fall 2012 N = 604
Faculty vote about pursuing ACEJMC accreditation
3 New faculty members start
ACEJMC Standard 9 9-8
Spring 2013
Provost approves the NQSC ACEJMC accreditation process
ASSESSMENT: Graduating student exit survey
Sports Management minor acquired (from School of Business)
ASSESSMENT: Internship supervisor evaluations
Fall 2013 N = 594
3 new faculty members start; 3 faculty member left
ASSESSMENT: Student advisory board reviews the Noel Levitz student satisfaction survey and provides feedback
Event Management Minor established
ASSESSMENT: Internship supervisor evaluations
ASSESSMENT: Faculty evaluation of internship presentations
Spring 2014
First Dean’s Advisory Board meeting
ASSESSMENT Dean’s Advisory Board reviews and provides feedback on student media, including newscast
Visit to the ACEJMC meeting in Washington DC
ASSESSMENT: Faculty evaluation of internship presentations
ASSESSMENT: Internship supervisor evaluations
ASSESSMENT: Graduating student exit survey
Summer 2014
Formal ACEJMC assessment plan developed
ACEJMC Standard 9 9-9
Fall 2014
N = 629
3 new faculty members start
ASSESSMENT: Dean’s advisory board
Formal ACEJMC accreditation assessment plan approved by faculty
ASSESSMENT: Competency pre/post exams in COM 1110 and 3390
ASSESSMENT: Faculty evaluation of internship presentations
ASSESSMENT: Internship supervisor evaluations
Spring 2015
Visit to the ACEJMC meeting in Chicago
ASSESSMENT Dean’s Advisory Board (a) interviews students, evaluates their LinkedIn pages, and assesses their professional preparation
ASSESSMENT: Competency post exams in COM 3390
ASSESSMENT: Faculty evaluation of internship presentations
ASSESSMENT: Internship supervisor evaluations
Summer 2015
ASSESSMENT: Advisory board’s evaluation of students’ LinkedIn portfolios
ASSESSMENT: Alumni survey sent to graduates from 2011-2014
ACEJMC Standard 9 9-10
Fall 2015
N = 669
4 new faculty hired ASSESSMENT: Competency pre/post exams in COM 1110 and 3390
Sport Communication major sequence established
Event and Sport Management major established sequence
ACEJMC Self-Study due
ASSESSMENT: Faculty evaluation of internship presentations
ASSESSMENT Dean’s Advisory Board (a) interviews students, evaluates their LinkedIn pages, and assesses their professional preparation
Spring 2015
ACEJMC Site Visit
2. Provide the unit’s definition of goals for learning that students must achieve. If this definition is incorporated into the plan for assessment, a page reference will suffice.
In 2011 the NQSC faculty identified 12 professional values and competencies closely paralleling the ACEJMC’s values and competencies that form the basis for our teaching objectives and subsequent assessments: The Nido R. Qubein School of Communication VALUES:
Expression – Appreciating the principles and constraints on the exercise of free expression in a democratic society
Integrity – Maintaining a commitment to honesty, accountability, and professional ethics
ACEJMC Standard 9 9-11
Excellence – Performing high-quality work in a capable, efficient, and appropriate manner
Accuracy – Communicating fairly, without distortions or conflicts of interest, and in recognition of subjectivities
Diversity – Encouraging creative and independent ways of thinking and mindfulness about cultural differences and multiple perspectives
Curiosity – Acquiring new skills and knowledge and continuously pursuing education and innovation
Awareness – Understanding the history, role, context and reality of the process of communication
The Nido R. Qubein School of Communication emphasizes the following COMPETENCIES:
Analytical thinking – Extracting from various areas the knowledge required to formulate realistic responses to complex problems
Communication skills – Developing the ability to present, listen to, and exchange written, oral, aural, and visual information in forms appropriate for the audience, purpose, and context
Interpretation of converging information – Linking data, knowledge, and insight for strategic decision-making and presentation of information through media
Technological development – Using technology in ways that add value to the communication professions
Integration of theory and practice – Understanding how communication theory informs both research and best practices
The NQSC’s faculty is committed to using competencies to organize and assess what students learn as they pursue a BA degree in Communication; while not a guarantee that all students will learn at similar pace or depth, this approach provides markers for faculty to determine if graduates are acquiring the skills and knowledge necessary to assume entry-level positions as competent and ethical journalists, media producers, and strategic communicators or to be admitted to quality graduate/professional programs.
ACEJMC Standard 9 9-12
3. Describe the collection and reporting of data from both direct and indirect assessment measures and how the unit used its analysis of the data to improve curriculum, instruction, etc. Provide copies of any end-of-year assessment reports. If there are multiple reports from the six-year period, summarize the findings and make the reports available in the appendices or in the workroom. The NQSC’s assessment strategy centers around eight direct and indirect measures:
Direct measures involve direct faculty and professional assessment of student performance. Four direct measures were built into the assessment plan:
(a) Evaluation of student LinkedIn portfolios
(b) Cognitive competency exams of first and fourth year cohorts
(c) Internship site supervisor evaluations
(d) Faculty analysis of student presentations about their internships
Indirect measures involve data analysis, outside evaluation or self-evaluation by students and alumni. Three indirect measures were built into the assessment plan:
(a) Satisfaction surveys of graduating seniors
(b) Reviews by the Dean’s Advisory Council
(c) Input from the Student Advisory Board
(d) Alumni survey
ACEJMC Standard 9 9-13
DIRECT MEASURES Much of the direct assessment information was collected in the fall 2014 and spring 2015. Three assessment committee members—Dr. Virginia McDermott (chair), Dr. Vern Biaett, and Dr. Sojung Kim—worked on the data entry, analysis, and compilation of the results. The databases were entered into Excel and SPSS programs for analysis. Drs. McDermott and Kim, both of whom have advanced training in statistics, analyzed the quantitative data. Dr. McDermott compiled the final report.
Direct Measure 1: Assessment of LinkedIn Student Portfolios (Compiled in fall 2014 and spring 2015, and evaluated in summer 2015): To assess NQSC students’ writing and production proficiency and their professional self-presentation, 9 members of the Dean’s Advisory Board each reviewed two randomly selected graduating students’ LinkedIn profiles (n = 18). As of spring 2015, a LinkedIn profile with at least one writing sample and one production piece is a requirement for graduating seniors. Advisory board members used a rubric developed by the assessment committee that measures the portfolio’s presentation, especially the quality of writing, and level of graphic/video production (APPENDIX 9.3). The evaluators used a five-point scale (1 = strongly disagree and 5 = strongly agree) to evaluate students’ LinkedIn profiles and supplemental material on six criteria. Portfolios were randomly selected and represented a range of students: GPA: M = 2.99; Range: 2.16-3.81 Gender: 50% males; 50% female The Dean’s Advisory Council members’ evaluation were overall positive, though the amateur quality of some production pieces were noted:
ACEJMC Standard 9 9-14
Table 9.2: Advisory Council Members’ Evaluations of Electronic Portfolio
CRITERIA AVERAGE*
Initial appearance of LinkedIn page 4.06
Writing is clear, organized, and accurate 4.12
Writing is appropriate for the intended audience
3.88
Context for the student’s work samples is clear 3.67
Production materials meet expectations 3.46
Would interview the student for an entry-level job in your organization
3.93
*Does not reflect those students who did not have a writing or production piece included.
There was no correlation between students’ GPA and the evaluation of the LinkedIn profile (computed as a composite score of the six criteria) (r = .2; p = .42). In fact, the student in the group with the highest GPA (3.81) had an incomplete profile and subsequently received the lowest evaluation. The feedback for students with completed profiles was very positive:
[Name] does an excellent job of showing how his education is responsible for and is the motivation for his professional goals. I get a very clear picture of what [name] has done at HPU and how he plans to use that plus his experience to find success in the field of TV and production. The only piece of advice I could offer is that some statements run just a little long. I'd also be interested in some more explanation of his creative motivation on some project accomplishments. I believe he has a very unique creative mind that should be a little more front and center. Well done!
ACEJMC Standard 9 9-15
Even if the student did not have all the required components but had taken time to add other elements that demonstrate experience and skills, the evaluation was fairly positive:
I did not find a resume, writing samples or production work on (name’s) LinkedIn page. The summary section was lacking. I liked that he had some results from personality profiles but those were given without explanation. It would have been helpful for those who are unfamiliar with Gallup Strengths Finder and Myers-Briggs (which he shortened to MBTI) to have some explanation as to what these mean. The items listed under each of his jobs did not use grammatically correct parallel construction. Fortunately, based on the profile, [name] appears to be outgoing and well thought of by those that meet him. For that reason, I would interview him.
Though the advisory feedback about the completed profiles was quite positive, a few students had incomplete profiles and could not be fully evaluated.
Response to direct measure 1: Assessment of LinkedIn Portfolios
Starting spring 2016, a final check of each student’s LinkedIn profile is required for graduation and will ensure that each student includes a writing sample and production piece in the profile. The School has added a course to show in the transcript to assure it doesn’t get overlooked.
Starting spring 2016, the guidelines for developing the LinkedIn profile will require a summary statement about each project to contextualize the piece.
Starting fall 2015, Strategic Communication and Journalism faculty are required to integrate more media production elements into their curricula, so students should have more high quality production options for their portfolio.
ACEJMC Standard 9 9-16
Direct Measure 2: Competency Exam (Fall 2014) The competency exam is based on a comprehensive exam used at the University of New Mexico and was revised by the HPU faculty. In the fall of 2014, the School assessed students’ basic knowledge about the five key competency areas in the NQSC—analytical thinking, communication skills, interpretation of converging information, technological development, and integration of theory and practice (See APPENDIX 9.4). In fall 2014, students’ competency was assessed at two different points in the programs. One group (subsequently noted as “pretest”) completed the exam in the first two weeks of COM 1110—Introduction to Human Communication, usually the first course taken by all communication majors and prerequisite to most 2000 or higher level COM courses. The other group (subsequently noted as “posttest”) took the exam in the last two weeks of COM 3390—Communication Law and Ethics course (now renumbered COM 4450), also required of all COM majors. Even though this class was listed as a 3000-level junior-level class, the course is typically populated with seniors since limited sections of this class are offered and student registration is based on student credit totals; priority registration is given to students with the most completed academic credit. To the School’s knowledge, no students were simultaneously enrolled in both COM 1110 and COM 3390. The goal of this competency exam simply was to determine if students learned more about their chosen subject areas after they had taken communication courses in the NQSC than they knew when they started the program and, if they did not, to identify particular areas of weakness. Instructors were responsible for distributing and collecting paper copies of the exams. The NQSC Assessment Committee graded the exams, computed an item analysis, compared the scores in COM 1110 to the scores in COM 3390, and analyzed any statistical variations among the communication sequences.
ACEJMC Standard 9 9-17
Basic demographics The data were collected in eight COM 1110 sections (“pretest”) and almost 200 students (n = 199) completed the exam. Of those, 131 identified as communication majors. Among those were 23 electronic media, nine game and interactive media, 28 journalism, seven media & popular culture studies, and 59 strategic communication students. The majority of the students were in their first-year (n = 137), but classes also included 44 sophomores, 11 juniors, and seven seniors. The male/female ratio (39.2%/60.3%) was consistent with the university ratio. Because the committee wanted to compare the competency of students at the start of the program to that of students at the end of the program, it excluded juniors and seniors so a total of 181 students were included in the analysis. (Also, almost all the juniors and seniors were non-communication majors, so these would be irrelevant to our assessment.) The exam was also given to 48 students in the COM 3390 class (“posttest”). Among those 48 were 12 electronic media, three game & interactive media, four journalism, two media and popular culture studies, and 27 strategic communication students. Forty students were seniors; the rest were juniors. Approximately 60% of the students were female. (Information on gender is included to identify sample representation and as an intellectual curiosity).
Comparison of overall pretest and posttest results Several interesting and informative patterns were revealed when comparing the results of the exams. First, the overall scores among the seniors (M = 13.52) were significantly higher than the scores of first-year students (M = 11.44) (t (222)= -3.35; p = .001) (see figure 1). The four years of communication education at High Point University seem to positively contribute to students’ understanding about several aspects of communication practices. In particular, the mean scores of technology development, integration of theory and practice, and interpretation of converging information categories were significantly higher among the seniors than among the first-year students. These results may be an indicator that the NQSC’s current curriculum is effectively delivering these particular objectives to its majors. Of course, this learning gain may be representative of factors not directly related to the NQSC’s instruction. For example, it’s possible that students picked up this material in other courses, from self-instruction, from work/internship experience, or simply scored better because of enhanced reading skills or personal maturity.
ACEJMC Standard 9 9-18
Figure 9.1. An overall mean score comparison between the pretest and posttest (pretest=COM 1110/First-year students; posttest=COM 3390/Seniors)
The results also revealed areas for improvement. For example, the mean scores of analytical thinking and communication categories did not significantly differ between the pretest and posttest, suggesting the NQSC could increase its focus on these areas going forward. Also, although students in COM 3390 scored significantly higher than students in COM 1110, the seniors did not score particularly well, suggesting additional areas that may need to be enhanced.
11.4413.52
0
5
10
15
20
25
pretest posttest
pretest posttest
ACEJMC Standard 9 9-19
Figure 9.2. Mean score comparison of pretest and posttest on each competency
Comparison of pretest and posttest results for each sequence The committee also conducted separate analyses for the five sequences. (The two newest sequences in the NQSC—sport communication and sports and events management—had not yet started). Electronic media students improved their technology development skills significantly from the first-years (n = 23; M = 12.43) to the seniors (n = 12; M = 13.67). There were no meaningful differences among electronic media students on other learning objective categories, though seniors scored lower on communication skills and converging information than did the first-years (see figure 9.3).
2.51 2.49 2.51
1.87
2.05
2.632.5
3.02
2.31
3.02
0
0.5
1
1.5
2
2.5
3
3.5
Analytical Thinking Communication skills Converginginformation
Technologicaldevelopment
Integration of theoryand practice
Pretest
Posttest
ACEJMC Standard 9 9-20
Figure 9.3. Electronic media sequence mean scores by different learning outcomes
For students in the journalism sequence, only the mean scores of the integration of theory and practice category were significantly higher for students in the Communication Law and Ethics class (n = 4; M = 13.5) than among the Human Communication classes (n = 28; M = 12.46) (see figure 4). Though the differences in the other competency areas weren’t significant, they are not good because seniors actually scored lower on three competency areas: analytical thinking, communication skills, and technological development. Figure 9.4. Journalism sequence mean scores by different learning outcomes
For the strategic communication students, only the mean scores of the integration of theory and practice and the interpretation of converging
11.95
2.45 2.60 2.79 2.10 2.10
13.67
2.5 2.33 2.67 3.25 2.92
0
3
6
9
12
15
18
21
24
overall score analytical communication converging technology integration
pretest posttest
12.46
2.79 2.79 2.71 2.04 2.14
13.5
2.25 2.5 3.251.75
3.75
0
5
10
15
20
25
overall score analytical communication converging technology integration
pretest posttest
ACEJMC Standard 9 9-21
information categories were significantly higher among the seniors than among the first-years (see figure 9.5). Figure 9.5. Strategic communication sequence mean scores by different learning outcomes
Comparison of seniors in the three sequences When comparing different sequences in the NQSC, the seniors were comparable in overall score and scores on four of the five competencies. Seniors in the electronic media sequence performed significantly better than students in the other sequences on the technology development questions (see figure 9.6 for details). The seniors across all the sequences performed poorly on analytical thinking and communication skills.
11.65
2.60 2.53 2.55 1.80 2.18
13.63
2.65 2.64 3.122.04 3.04
0
5
10
15
20
25
overall score analytical communication converging technology integration
pretest posttest
ACEJMC Standard 9 9-22
Figure 9.6. Mean scores by different sequences on technology development learning outcome
Response to direct measure 2: Competency exams Based on the results of the competency exams, the following actions have been taken for each competency area Analytical thinking – The School defines this as “Extracting from various areas the knowledge required to formulate realistic responses to complex problems.” Actions taken:
Student Success Program. HPU implemented this program in 2013. All first-year students are required to participate in a structured program that introduces students to learning skills. They are also assigned a Success Coach, an individual adviser who monitors all aspects of their advisees’ lives, both academic and personal. While this is not directly correlated to analytical thinking, many HPU students could not learn effectively as they were dealing with time management and personal issues that interfered with any type of advanced cognitive processing. In two years of operation, the
13.67
2.5 2.332.67
3.252.91
13.5
2.25 2.5
3.25
1.75
3.75
13.63
2.65 2.643.11
2.04
3.04
0
2
4
6
8
10
12
14
16
Overall Score Analytical Thinking Communicationskills
Converginginformation
Technologicaldevelopment
Integration oftheory and practice
ELM
Journalism
Strat Com
ACEJMC Standard 9 9-23
university has seen positive results, particularly with first-year retention, as at least 4% fewer students are leaving the university. (In fall 2015, the NQSC has the highest retention rate for student transition from first-year students to sophomores with 86% retention. The Media Fellows first-year to sophomore retention rate was 100%).
Comquest (Sophomore Professional Community program): The NQSC is serving as a prototype for a new sophomore student program called Comquest. Students who have academic difficulty often indicate that they have not integrated to a community, and this lack of integration becomes especially apparent in their second year. Starting in the fall 2015, all sophomore introductory courses in each of the communication sequences will have a common directed reading, in-class discussion, and short writings on what it means to be part of a professional community. Sophomore classes will also feature professional speakers who will discuss what it means to be a professional and how they have to survey the environment to make reasoned choices in their professional careers. This concerted focus on professionalism at the sophomore level is not predicted to have any immediate impact on first-year learning but it will influence, the administration believes, student interest in understanding the value of analytical thinking to functioning as a professional in the community they are preparing to enter.
Communication law debate: For the last two years, the NQSC has hosted a panel during Communication Week where faculty debate controversial communication legal decisions from various viewpoints. Written feedback from Communication Week assessments suggest that this is a highlight to many students as they see that their faculty can have differing and interesting takes on one issue and that there are many ways to look at complex problems. (The NQSC has secured external funding from a national organization to expand this program in 2016.)
Diversity panel during Communication Week: In spring 2014, the NQSC introduced the diversity panel to Communication Week. This panel featured four communication professionals discussing the impact of their biological sex/race/age on the career trajectory and how they manage some of the challenges. More than 100 students attended. The School will continue to feature this panel in future Communication Week events, and it will use
ACEJMC Standard 9 9-24
these discussions to continue the conversation about the value of diversity in the communication industry.
Starting fall 2015, the competency exam will be refined. Questions that more than 50% of first-year students answered correctly will be modified to be more challenging. Questions that fewer than 50% of seniors answered will be noted and instructors will commit extra time in class to covering those topics while ensuring that they do not teach to the test.
Communication skills – “Developing the ability to present, listen to, and exchange written, oral, aural, and visual information in forms appropriate for the audience, purpose, and context
Actions taken:
The Assessment Committee developed, tested, and refined grammar and punctuation worksheets and quizzes. These quizzes are a mandatory part of the COM 1110 curriculum and are available to all faculty for their classes.
The School hired a full-time coordinator for COM 1110/1111 to oversee three defined tasks related to accreditation: (a) enhance the public speaking component of 1110 and ensure that students are competent presenters; (b) begin to integrate some technology training in 1110; and (c) to integrate and enhance this foundational material into relevant upper-level COM courses.
Starting in fall 2015, seniors now develop and deliver a public presentation in capstone classes. They are graded on their performance and expected to deliver a professional quality presentation.
Starting in spring 2014, students completing internships have been required to do a public presentation to faculty summarizing their experiences. This is evaluated not only in terms of what they learned during the internship experience but also for presentation skill.
ACEJMC Standard 9 9-25
The NQSC secured funding to develop one-credit persuasive speaking modules to start in fall 2015. These modules focus on developing a mastery of speaking skills, and allow students to complete assignments and speeches multiple times to ensure skill development.
Interpretation of converging information – “Linking data, knowledge, and insight for strategic decision-making and presentation of information through media.” Actions taken: Beginning in fall 2015, students in the capstone course of each sequences
were required to complete an online module about basic research principles. The module includes an online exam. A faculty member developed the module in spring/summer 2015, and the module was implemented in fall 2015.
Beginning in fall 2016, the research methods module will be implemented in
the following foundation sequence courses: COM 2204 Media and Popular Culture (Media & Popular Culture Studies; COM 2241 Electronic Media History and Development (Electronic Media); COM 2225 Foundations of Strategic Communication (Strategic Communication); COM 2243 Convergent Journalism 1 (Journalism); COM 2252 Theory and Design of Games (Game and Interactive Media Design).
Technological development – “Using technology in ways that add value to the communication professions”. Action taken: The NQSC purchased a membership to Lynda.com. Faculty in strategic
communication and journalism began training on InDesign and Photoshop in spring 2014. These faculty have also identified other production applications that they can integrate into their courses.
The NQSC now requires production assignments in all relevant upper-level journalism and strategic communication courses and does not rely on skills training to be delivered in just COM 1111. Regardless of age or
ACEJMC Standard 9 9-26
previous professional experience, all faculty are now required to be competent in the software standards prevalent in their industries and merit pay evaluation and tenure consideration will include this factor.
Integration of theory and practice—“Understanding how communication theory informs both research and best practices.” Action Taken: The posttest indicated that integration of theory and practice is one of
the strengths of the program. We will continue emphasizing these elements in our courses. We have also opened graduate student thesis defenses to the public and invite undergraduates to attend. All theses presentations require the students to address how theory informed their choices. In spring 2015, 16 undergraduate students attended at least one defense. The NQSC will use social media and class announcements to continue to promote this to the undergraduates.
As mentioned above, the law panel debate during Communication Week enhances students’ ability to see how different theoretical backgrounds can help frame a complex issue.
Most of all COM classes bring in professionals for guest lectures. This provides a practical application formulated on our theoretical platform.
Direct Measure 3: Internship Supervisor Evaluations (Spring 2013, 2014, & 2015) From spring 2013 to spring 2015, 101 NQSC students completed approved internships for credit. To qualify for an internship, students must have junior standing, a 2.3 overall and 2.5 major GPA, and apply to the NQSC internship coordinator.
The internship site supervisor completes a written evaluation of the student’s performance and preparation. The survey used for this evaluation was developed by the career and professional services staff and is included in APPENDIX 9.5. The School internship coordinator shares these evaluations with
ACEJMC Standard 9 9-27
the dean. (Since we average about 15-20 interns per semester, sharing information more broadly with the faculty would violate FERPA confidentiality.) Overall, the internship supervisors’ evaluations (evaluated on a five-point scale) were very positive. Table 9.3: Internship Supervisors’ Evaluations
ABILITY TO LEARN
Asks pertinent and purposeful questions 4.31
Seeks out and utilizes appropriate resources 4.35
Accepts responsibility for mistakes and learns from experiences
4.34
READING/WRITING/COMPUTATION SKILLS
Reads/comprehends/follows written materials 4.43
Communicates ideas and concepts clearly in writing 4.16
Works with mathematical procedures appropriate to the job 4.17
LISTENING AND ORAL COMMUNICATION SKILLS
Listens to others in an active and attentive manner 4.40
Effectively participates in meetings or group settings 4.42
Demonstrates effective verbal communication skills 4.71
CREATIVE THINKING AND PROBLEM SOLVING SKILLS
Breaks down complex tasks/problems into manageable pieces 4.23
Brainstorms/develops options and ideas 4.30
Demonstrates an analytical capacity 4.06
PROFESSIONAL AND CAREER DEVELOPMENT SKILLS
Exhibits self-motivated approach to work 4.44
Demonstrates ability to set appropriate priorities/goals 4.33
ACEJMC Standard 9 9-28
Exhibits professional behavior and attitude 4.49
INTERPERSONAL AND TEAMWORK SKILLS
Manages and resolves conflict in an effective manner 4.36
Supports and contributes to a team atmosphere 4.47
Demonstrates assertive yet appropriate behavior 4.27
ORGANIZATIONAL EFFECTIVENESS SKILLS
Seeks to understand and support organization's mission/goals 4.48
Fits in with the norms and expectations of the organization 4.46
Works within appropriate authority and decision-making channels
4.40
BASIC WORK HABITS
Reports to work as scheduled and on time 4.50
Exhibits a positive and constructive attitude 4.64
Dress and appearance are appropriate for this organization 4.61
CHARACTER ATTRIBUTES
Brings a sense of values and integrity to the job 4.57
Behaves in an ethical manner 4.63
Respects the diversity of co-workers 4.56
STUDENT’S OVERALL PERFORMANCE DURING THE INTERNSHIP EXPERIENCE
4.48
There was no significant correlation between students’ GPA and the internship supervisor’s evaluation (based on a composite score of all evaluation criteria) (r = .145; p = .149). This could be because all students in internships must have at least a 2.5 major GPA.
ACEJMC Standard 9 9-29
Most of the internship supervisors (n = 88) provided qualitative comments about the interns. Of those comments, 85 were positive and only three were negative. (Of the internship supervisors who did not comment, only one had evaluated the intern negatively). The responses indicate that the interns are professional, hard-working, prepared, and pleasant.
Organized, skilled writer, takes direction well, goes the extra mile
Went above and beyond, took initiative, professional, adaptable, excellent com skills
Most prepared we've ever seen
Standout, impressive, exemplary work ethic and character
Went above and beyond, took initiative, professional, adaptable, excellent com skills
For the three negative comments, the issue appears to be initiative and work ethic:
Struggled with professionalism, accuracy and attention to detail, lack of desire to apply herself
Didn't take initiative or problem solve on her own
Disappointed in his effort
Response to direct measure 3: Internship supervisor evaluations Continue to enforce criteria for internships
Direct Measure 4: Faculty Evaluations of Internship Presentations (Fall 2013 – Spring 2015)
All students who have completed an internship for credit must prepare a five-minute presentation to faculty about their on-site duties, learning outcomes, and how their courses prepared them for the internship. The NQSC’s administration and the faculty use aspects of this process to note areas of curriculum improvement.
ACEJMC Standard 9 9-30
After the fall 2014 semester internship presentations, the dean discussed the presentations with the internship coordinator and faculty in attendance and compiled notes about the presentations. These were then discussed at a School faculty meeting. The resulting “Impressions of Internship Presentations” below suggests that students were prepared for internships (in terms of software training) but lacked “soft” people skills, which may be considered difficult to model in an academic environment. It was also evident that presentation skills were weak. The dean met with the COM internship coordinator to discuss specifics of the internship presentations and at the NQSC faculty meeting discussed the importance of reintroducing presentation guidelines in upper-level classes to supplement and reinforce material previously taught in COM 1110.
Sample comments about the students’ presentation style include (full comments available in APPENDIX 9.6):
Students tried to pack too much information into each presentation. Template can be shortened (e.g. it is not necessary for students to present a slide on what their goals for the internship were).
Don’t read slides and certainly do not include complete sentences and paragraphs on slides.
We need to reintroduce PowerPoint presentation guidelines in upper-level classes. We only do it in COM 1110 but our upper-class students need to have this reinforced.
At some of these student internship presentations in 2012 and 2013, faculty took note that strategic communication students were expected to be proficient in Excel when they started their internships; yet, it was apparent after discussions among the NQSC’s administrators that the School didn’t teach Excel in any of its classes and, indeed, many faculty were only casually familiar with the software.
Similarly, journalism students’ internship presentations often suggested that they weren’t exposed to many of the programs and apps they were expected to know at their internship placements. An analysis of this issue by the NQSC’s administration suggested the problem was that most of journalism faculty came from print-oriented careers and had not worked in the contemporary journalism industry.
ACEJMC Standard 9 9-31
In fall 2015, approximately 20 faculty members attended the internship presentations and provided written feedback (See APPENDIX 9.7) about the skills the students mentioned they needed. These observations were consistent with other assessment measure that identified weaknesses in students’ research and numeracy skills, their need for more advanced public speaking skills, and their desire for more training in various production software. The assessment committee reviewed all the faculty comments and noted the following topics in need to development:
Experience working with clients—more real world experience in class More Excel More research methods More technology training, specifically infographics More public speaking training
Response to direct measure 4: Faculty evaluations of internship presentations
Redesign COM 3385—Applied Research in Strategic Communication so that student projects were completed in Excel, rather than SPSS, to provide a more research focused package. Faculty in other sequences are now required to employ Excel as appropriate. For example, students in Electronic Media Production courses are now expected to develop production budgets in Excel.
The Department of Journalism and Strategic Communication began regular training in journalism-related software at faculty meetings and retreats and the department has now made it mandatory for all journalism classes to incorporate video and other new media projects in their syllabi. Previously, students were simply given the option of turning in a print-based writing assignment or an electronic assignment.
As previously discussed, the NQSC hired a full-time coordinator for COM 1110/1111 to ensure communication skills development in our introductory 1110 course and to integrate this foundational material into relevant upper-level COM courses.
ACEJMC Standard 9 9-32
INDIRECT MEASURES Indirect Measure 1: Student Satisfaction Surveys (Spring 2012, 2013, 2014, 2015) Surveys were administered to every graduating student. Overall, the students had positive evaluations of the NQSC, especially the School’s facilities and equipment, learning how to identify a target audience, learning how to make strategic decisions, and learning how to function well in teams. The greatest dissatisfaction expressed in these surveys was related to advising and the advising process. The table below displays how graduating students from the last four years evaluated the advising and curriculum. A summary of qualitative comments can be found in APPENDIX 9.8.
Table 9.4: Student Satisfaction Survey
GRADUATION YEAR
2012 n = 27
2013 n = 47
2014 n=39
2015 n=60
Seven-point scale
The courses that made up your sequence's courses (i.e., Electronic Media Production, Strategic Communication, Game and Interactive Media Design, Media and Popular Culture Studies, Journalism) provided a thorough basis for future application development.
5.69 6.00 5.61 5.46
ACEJMC Standard 9 9-33
The instructors in the School presented the information in a clear and thorough way.
5.53 5.87 5.55 5.51
The instructors in the School worked hard to help you develop your maximum potential.
5.46 5.91 5.82 5.70
The School's equipment (facilities, hardware, software) provided support for your work in your sequence's courses.
6.27 6.21 5.53 6.02
The courses that made up the curriculum in your sequence provided a thorough supplement for future application and development.
5.54 5.91 5.34 5.32
Seven-point scale
Five-point scale
You found it easy and convenient to see your adviser.
6.03 5.74 4.31 4.2
Your adviser gave you accurate information.
5.73 5.51 4.00 4.00
Your adviser gave you the kind of support and/or advice you needed and wanted.
5.61 5.32 3.89 3.96
Five-point scale
I am able to identify and describe target audiences for a specific communicative purpose if asked to.
4.27 4.45 4.29 4.35
4.08 4.36 4.23 4.06
ACEJMC Standard 9 9-34
I have learned, given a specific target audience, how to make strategic decisions about how to most effectively communicate to achieve persuasive and/or informative objectives.
I have learned how to function effectively in small group/team contexts.
4.29 4.60 4.26 4.42
I have learned how to effectively present messages in (depending on my emphasis) oral, written, electronic media or computer forms to a variety of audiences.
4.12 4.55 4.40 4.40
I have learned to collect, interpret, and present information to achieve a communicative purpose.
4.08 4.43 4.37 4.25
I have learned to conduct formal research appropriate to my field.
3.73 4.14 4.14 3.92
I have been exposed to discussion of the various ethical problems unique to my field.
4.27 4.11 4.00 4.10
Response to indirect measure 1: Student Satisfaction Survey
HPU has modified the advising process for first-year students. First-year students now have Success Coaches housed in the Office of Academic Services who assist them transition to HPU by not only helping with class scheduling but also in dealing with personal and emotional considerations that were often outside the capabilities and training of the academic faculty. This has also taken a great burden from COM faculty
ACEJMC Standard 9 9-35
whereby their average number of advisees shrank from 40 to 20. It has also improved freshman to sophomore retention by 3-4%.
The NQSC has modified its advising paperwork to more clearly reflect graduation requirements. These documents are included under Standard 6, item 2. Relatedly, the University Registrar has automated much of the student transcript making it much easier for a student, and the faculty, to identify remaining requirements. And registration can now be completed online and with a smartphone.
Starting fall 2015, the School is separating the mentoring and scheduling components of advising. Previously, faculty were considered course and schedule advisers, available to ensure students took the right classes. The School’s administration believes that faculty should be academic and career mentors and scheduling should be more of an automated process designed to eliminate mistakes and ensure degree completion if followed accordingly. The standard will now be group scheduling. This will increase the number of eyes reviewing the student transcript so as to minimize human error. Advisers can get to know and counsel students in how to achieve success in their chosen careers rather than trying to fix earlier scheduling mistakes.
Indirect Measure 2: Dean’s Advisory Council Review (2x annually since AY 2014) Minutes are taken at the Dean’s Advisory Council meetings. The dean shares Council feedback to faculty in a slightly redacted manner as some of the comments are very frank and relate to individual faculty. The dean reports back to the Council about the changes made in response to their feedback. The Council audits classes and provides written, but most often, verbal feedback on these visits; the council also meets with selected students one-on-one and critiques their work informally. (This is in addition to the direct random review of LinkedIn portfolios discussed above.)
ACEJMC Standard 9 9-36
Response to Indirect Measure 2: Dean’s Advisory Council Review
The dean regularly presents student work at Council meetings and monitors feedback. For example, the Council expressed significant “disenchantment” with the quality of our student newscasts. The dean and the chair of Journalism and Strategic Communication department performed a top-to-bottom review on why the Council thought the newscast was weak and why there also appeared to be a lack of interest in TV news, even though many students are recruited to the NQSC because of an interest in that area. The NQSC administration looked at syllabi, examined student evaluations, and watched student productions from the broadcast journalism area. The analysis suggested that the School needed to hire a faculty member with significant professional news experience rather than peripheral experience while in graduate school. The dean then secured permission to hire an artist-in-residence to supervise our news production and was fortunate to secure the services of a professional who directed the Today Show for 23 years. He began teaching in August 2015. While some problems associated with being new to the teaching industry might be anticipated, one can also assume that issues of experience and gravitas should no longer be problematic. In addition, both the dean and the chair made clear that all journalism classes must now include more video work and train students in broadcast writing style, video composition, the importance of externally acquired audio, and all classes must operate under non-negotiable production deadlines.
A second way that the NQSC is attempting to address this issue is by mandating that more than one class will have to work on developing a newscast. To this end, students in all the classes listed below will participate in our three news productions during the fall 2015 semester in the manner described.
ACEJMC Standard 9 9-37
Table 9.5: Courses that coordinate a newscast development
COM 2001-01 Video Production I Michaels MWF 10:40-11:50
COM 2001-02 Video Production I Trammell MW 12:05-1:45
Run cameras and production equipment on selected productions
COM 2011-01 Video Production II Powell MWF 3:25-4:35
Direct/TD/Edit stories on selected productions
COM 2243-01 Journalism I Eltantawy MWF 12:05-1:45
COM 2243-02 Journalism I Smith MWF 10:40-11:50
Write stories for some newscasts
COM 2246-01 Sports Reporting Hayes TTH 9:45-11:25
Write sports stories
Write and sports stories on some sports casts
COM 2262-01 Video Practicum Yount T 3:30-5:10
Production help on some productions
COM 3006-01 Sports Broadcasting McConnell TTH 11:40-1:20
Sports packages for some productions/deliver sports on some newscasts
COM 3331-01 Video Journalism Trammell TTH 1:35-3:15
Develop news packages/Deliver news
COM 4451-01 Senior Production Experience
Michaels TTH 9:45-11:25
Produce longer-form programming and newscasts.
COM 2265-01 Publicity Planning Practicum
Ritter
Promote programming throughout semester
ACEJMC Standard 9 9-38
Indirect Measure 3: Student Advisory Board Review Each year, a representative group of undergraduate students is invited to serve on the Student Advisory Board. These students are nominated by faculty from different sequences and selected by the dean to be representative of different grades, gender, and ethnicity. (Clearly, faculty only nominate our better students for the Board and a case could be made that weaker students should be represented as well.) The Board meets each semester with the dean and provides input on School policies, potential curriculum changes, and university-wide issues. As can be expected, most of the Student Advisory Board’s concerns have focused on day-to-day student issues such as access to labs, and equipment sign out procedures, etc. and not necessary on learning outcomes. This board’s input, however, has been helpful to the NQSC in providing better constituent service and by so doing, removing barriers to student learning. (For example, the School installed a card access lock on the video edit suite door because the Board complained about having to wait for campus security to open the door every time they needed access.) The Student Advisory Board’s most substantive ongoing complaint has been about the registration/advising process, especially the perception that the communication requirements were confusing, that the registration process was cumbersome and unfair, and that students’ academic progress was hindered by poor academic advising. While most of this input comes from direct conversations between the dean and the Student Board, in October 2013, the NQSC administration wanted to garner student input in a more formal manner, assuaging any concerns that students might be too intimidated by the presence of an administrator to speak freely. Accordingly, a recent graduate of the MA program was hired to conduct a focus group. Topics were determined by a campus-wide student satisfaction survey conducted by the Noel Levitz consulting firm the previous semester. The NQSC’s Assessment Committee culled the focus group topics from the Noel Levitz statistic that identifies perceptual gaps between student expectations before enrollment at HPU (See APPENDIX 9.9) and what students’ actually perceived to be delivered by the university and its programs. (Gap size is listed in last column; the larger the number, the greater the perceived discrepancy and thus the most essential to investigate.)
ACEJMC Standard 9 9-39
The following 15 topics were identified as important for students to discuss and provide guidance for why NQSC received these scores and what we could do to improve it. Table 9.6: Student advisory board discussion items from Noel-Levitz survey
Topic Importance Satisfaction Gap
My academic adviser is knowledgeable about requirements in my major
6.27 5.38 .89
I am able to register for classes I need with few conflicts
6.29 3.94 2.35
The content of the courses within my major is valuable.
6.41 5.48 .93
The instruction in my major field is excellent 6.44 5.50 .94
Nearly all the faculty are knowledgeable in their field
6.25 5.66 .59
My academic adviser is approachable 6.27 5.53 .74
Faculty are fair and unbiased in their treatment of individual students
6.23 5.09 1.14
Major requirements are clear and reasonable 6.08 4.96 1.12
My academic adviser is concerned about my success as an individual
6.11 5.24 .87
Faculty provide timely feedback about student progress in a course
6.09 4.96 1.13
Freedom of expression is protected on campus
6.13 4.61 1.52
Adjunct faculty are competent as classroom instructors
5.70 5.04 .66
My academic adviser helps me set goals to work toward
5.74 4.93 .81
Channels for expressing student complaints are readily available
5.88 4.83 1.05
There is a strong commitment to racial harmony on this campus
5.54 4.58 .96
ACEJMC Standard 9 9-40
A recent MA graduate, Matt Ritter, conducted an approximately one-hour focus group with the Student Advisory Board on 10/15/13. A full transcript of the students’ clarification on each discussion point is contained in APPENDIX 10. The following seven topics were discussed.
Class registration The number one identified discrepancy was “registering for classes.” Have trouble unless you’re honors, seniors or athletes. Not a ton of sections. I had to take courses I didn’t want to as a junior. MPC
studies has lots of courses that aren’t offered. Limited amount of sections in strategic com. MPC hasn’t grown as much. Lot of trouble getting strategic com classes. I’m trying to graduate in three
years and system won’t let me register at appropriate year.
Advisers Study abroad is a big problem. Students need to look ahead and plan
schedule accordingly. Advisers don’t help you get into classes you need. Com advisers don’t know
about other minors. Have ENG minor and that was really confusing. Have someone available to help with minors—maybe a secretary—so someone can talk about minors (e.g., a marketing professor available at a certain time to talk about the minor).
Faculty and treatment of students For most part they’re unbiased. Production classes are subjective because you
can’t always use rubrics. How do you do well in those classes: suck up to the professor. (Similar to Art.)
Feedback I hate that we’re only required to post bad grades on MyStuff at mid-term.
Should be required to post at midterm. All professors don’t use Blackboard and you don’t know how much they weight assignments.
Like the way Professor X does it. Need to be informed on how to calculate grades. (Tell you what number to divide your score by.)
Freedom of Expression We have almost no public speaking expression. Communication and Culture
won’t let anything out they don’t approve.
ACEJMC Standard 9 9-41
University has no public forum for students.
Faculty knowledgeable A lot have real world experience. Difference between learning something
from the textbook and real world. A lot of faculty are published. Adjunct faculty: I love them because of real world experience. I had one last
year and this summer he offered me a job. They’re not worried about tenure and are more open to class discussion. They’re very knowledgeable and provide current experience. They’re very real with you.
Racial Harmony 90% white people. Nothing we can do about that. Harmony is not an issue in the program but needs to be a stronger university
initiative. Diversity in faculty has increased since we’ve been here but it’s decreased
with students
Response to Indirect Measure 3: Student Advisory Board
The main items regarded advising/registration. In response, the NQSC has clarified the advising process in several ways: (a) The School revised advising guides to better explain the requirements for graduation. (The guides are found under the Standard 6—Student Services section.); (b) The School created an online note-taking system, allowing advisers to keep digital notes of student progress. This system predated the university-wide Starfish system currently in use; and (c) the University created a new Office for Student Success. This new system mandates that all first-year students be advised by Success Coaches. This was welcomed by COM students and faculty because it cut in half the number of advisees assigned to each COM faculty, and mitigated the need to move advisees around to different advisers in order to balance advising loads; and 4) the School was able to convince the university administration to separate the definitions of “advising” and “scheduling.” Starting in fall 2015, student scheduling will no longer be the sole responsibility of individual advisers; rather, there will be a group scheduling process for the entire School that we anticipate will eliminate many of the scheduling problems encountered under the old one-on-one system. This will also free advisers to do more mentoring and career advising.
ACEJMC Standard 9 9-42
Other areas discussed by the focus group: faculty and treatment of students, feedback, faculty knowledge, and racial harmony were all discussed but they did not present any distinct negatives that needed to be addressed, other than one or two complaints about individual faculty members. Students recognized that some issues such as lack of diversity are symptomatic of the economic structure inherent to a private university with high tuition such as HPU. The discussion about “freedom of expression” seemed to encompass a hodge-podge of items related to shortage of faculty in one sequence, to foreign languages on TV monitors in the communication building. Only one student spoke directly about administration control of student expression.
Indirect Measure 4: Alumni Survey (Summer 2015) An important measure of the effectiveness of the NQSC’s curriculum in preparing students for the profession is the students’ reflection on the curriculum. In summer 2015, the NQSC administration emailed a link to a short (8 questions) survey (see APPENDIX 9.11). Students indicated how well the curriculum developed their competency in five areas: (a) analytical thinking; (b) written and verbal communication; (c) strategic decision making and research skills; (d) technological skills; and (e) how theory should inform choices. The survey was emailed to almost 200 alumni, excluding the 2015 graduates. The survey was active for almost three weeks, and two reminders were emailed. The next table indicates the number of responses received from the graduates of each year: Year 2009 2012 2013 2014 2015* Number of responses 1 3 13 26 1 *the survey was not sent to the 2015 graduates Though there was a low response rate (n = 44), the responses were consistent (all standard deviations below 1.0; M = .79, on a five-point scale). The next table indicates the average score for the competency questions. The full results of the alumni survey are in APPENDIX 9.12.
ACEJMC Standard 9 9-43
Table 9.7: Alumni survey results
Prepared me to think analytically 4.07 Improved my written and verbal communication 4.34 Enhanced my strategic decision making and research skills
4.18
Increased my technological skills 3.95 Helped me understand how communication theory should inform professional practice
3.70
These results indicate that students feel well-prepared overall but would have liked more focus on production training and understanding of communication theory. This is more positive than other assessment indications. The comments are consistent with the assessment report, which indicates (a) a need for production skills to be integrated into journalism and strategic communication courses, and (b) the business elements of the communication field to be taught in all sequences.
Response to Indirect Measure 4: Alumni Survey The response rate for the survey was low, which indicates a need to better connect with alumni. Though we ask all graduating students to provide an alternative email address, many of the email links were inactive. The university’s alumni office is developing an alumni database, which we will be able to access in the future. In the meantime, the School has added a link to the NQSC’s webpage requesting that alumni update their contact information and leave a note. Consistent with the other assessment indicators, the NQSC is integrating production training into more classes and requiring numeracy training in more courses.
ACEJMC Standard 9 9-44
4. Describe the involvement of journalism and mass communication professionals, including alumni, in the assessment process. The NQSC utilized professionals for three of the eight measures of assessment. The full plan is included at the end of this section, but a brief summary is included here.
First, the Dean’s Advisory Council members reviewed student produced assignments in spring 2015. Council professionals evaluated student projects based on an evaluation rubric developed by the assessment committee. They also offered open-ended feedback.
Second, as described above, Council members critiqued student LinkedIn portfolios.
Third, Council members have audited COM classes and evaluated both content and faculty presentation. Some Council members submitted written evaluation forms of these encounters; others just provided verbal feedback
Fourth, COM students who do internships are evaluated by their site supervisors who submit summative assessment of their experience via a School designed rubric.
Information gathered from these methods is shared with the NQSC’s administration and non-confidential information is shared with faculty.
5. List awards won by the unit’s students in local, regional or national competitions in the past six years. 2014-15
Christina Hernandez, Mid-Atlantic N.A.M.E. Scholarship recipient ($5000) Jeremy Johnson, Pulitzer Center for Crisis Reporting Fellowship
(Problems with World Cup Construction projects in Qatar)
ACEJMC Standard 9 9-45
2013-14 “I Love HPU,” produced by COM 2001—Video Production I students,
National Broadcasting Society Undergraduate Electronic Media Honorable Mention
Britton Nagy, Pulitzer Center for Crisis Reporting Fellowship (Prison system in Norway)
2012-13 Adam Keelan, 2012 Communicator Award of Distinction, Film/Video—
Student division Rachael Lehman, “Weekly Roundup, 11.15.12,” 2013 Top Video Sports
Segment, National Broadcasting Society Undergraduate Student Electronic Media Award
Henry Molski, Pulitzer Center for Crisis Reporting Fellowship (Scottish National Election)
2011-12 Henry Molski, 2012 Society of Professional Journalists National Mark of
Excellence Award for Best Sports Feature Andrew Faust, Pulitzer Center for Crisis Reporting Fellowship (Impact of
Fast Food on Health of citizens in (Mideast) Gulf States)
2010-11 Panther Sports, produced by the COM 4441—Sport Production II class,
2011 Top Video Sports Program, National Broadcasting Society Undergraduate Student Electronic Media Award
2009-10 Andrew Tzavaras, “The Office of Admissions” video featured at the Big
South Undergraduate Research Symposium, 2010
ACEJMC Standard 9 9-46
6. List by specialty each member of the graduating class of 2012 and those graduates’ current jobs. If practical, please give a total number of “unknowns” rather than including them in the list. The NQSC graduated 71 students in 2012 and was able to sequence 54 (76%) of the students.
ACEJMC Standard 9 9-47
Table 9.8: May 2012 NQSC graduates May 2012 COM Graduates Electronic Media Graduation- 5-9-12 Games Updated: 3/8/2015 Journalism
Media and Pop Culture Strategic Communication Graduate School Non-COM position
First Name Last Name Program Job
Match of degree and job
Graduate School
Brendan Agans BA.COM.JOU
Production assistant at Root Sports Yes
Christian Bettendorf BA.COM.GIC unknown
James Bolling BA.COM.ELM Fat Loot Films producer Yes
Sebastien Bonnot BA.COM.ELM Photographer in New Orleans Yes
Montgomery Brown BA.COM.ELM unknown
Brian Canaris BA.COM.MPC Hard Knock Life LLP Founder No
Brittany Carter BA.COM.ELM unknown
Andrew Burrus Clark BA.COM.ELM
DoubleTree By Hilton Front Desk Agent No
William Condon BA.COM.ELM
Sales Consultant at Apogee Design Systems No
Sarah Conner BA.COM.STC Full-time homemaker
Audrey DeKraker BA.COM.STC
Brand Activation Association Marketing Coordinator Yes
ACEJMC Standard 9 9-48
Holly DesMeules BA.COM.STC
Public Affairs and Marketing Coordinator at NTELOS Yes
Bridget Donahue BA.COM.STC
Senior marketing campaign manager at Living Social Yes
Dana Erickson BA.COM.ELM unknown
Jennah Fahey BA.COM.STC
Marketing and Research Administrator Yes
Margaret Fanning BA.COM.JOU unknown
Erika Farr BA.COM.STC Pace University Law School NA
Pace University
Andrew Faust BA.COM.JOU
PR and Marketing Professional at Jackson Spalding Yes
University of Georgia
Rachel Feeley BA.COM.STC
Marketing and leasing associate at Blackline Retail Group Yes
Courtney Gacona BA.COM.STC
Digital Marketing Associate at TeamPeople Yes
Susanna Gaither BA.COM.ELM
Customer Service Representative at Ralph Lauren No
Skylar Galayda BA.COM.ELM unknown
Veronica Garcia BA.COM.ELM
Administrative assistant in real estate No
Tia Gebhard BA.COM.ELM Artist management Yes
Rebecca Gencarelli BA.COM.MPC
Marketing Coordinator at Jake's Franchising Yes
Rebecca Gitlin BA.COM.STC Underwriting Coordinator No
Michael Goins BA.COM.ELM TV Production Freelancer Yes
Ryan Harvey BA.COM.GIC Graphic Designer Yes
ACEJMC Standard 9 9-49
Kelsey Hinchliffe BA.COM.STC
Graduate student at University of Maryland NA
University of Maryland
Kaitlyn Hodgins BA.COM.JOU
Social Media Community Manager and Blogger Yes
Anne Hurt BA.COM.ELM unknown
Marshall Jefferson BA.COM.ELM
Sales and Marketing at Corporate Marketing Solutions Yes
Dean Judson BA.COM.STC
Sales agent at Jackson Hole Central Reservations No
Adam Keelan BA.COM.ELM
Freelance marketing and advertising Yes
Mary Kelly BA.COM.STC
PR at Proehlific Park & Proehlific Club at Forest Oaks Yes
Jane Kilgore BA.COM.STC
Public Communication Graduate Student at American University NA
American University
Skylar Marie Mabe (now Trivette) BA.COM.JOU Office manager No
Tyler MacDonald BA.COM.STC Media Assistant at V Group World Yes
Christine Marchetti BA.COM.STC Business Analyst Insurance No
Alexis Marley BA.COM.MED
Assistant to the Worship Pastor, Apex Baptist Church, Apex, NC
John Matheny BA.COM.ELM
MBI Sports Management Agency Associate Scouting Intern No
Hannah McKenna BA.COM.STC
Enterprise Rent-a-Car Position: Management Assistant No
Jasmyne McNeely BA.COM.ELM Lead Generation No
ACEJMC Standard 9 9-50
Chelsey Middlebrook BA.COM.STC
Managing director of the Silicon Valley at Betts Recruiting Yes
Jillian Montoya BA.COM.MPC Military officer no
Kimberly Muller BA.COM.MED unknown
Emma Nichols (now Dill) BA.COM.STC
Communication and sourcing specialist at Intellect Resources Yes
Henry Patterson BA.COM.MPC unknown
Jasmine Paul BA.COM.ELM Military officer No
Carlee Pett BA.COM.STC
Account executive at R&J Public Relations Yes
Lauren Pivirotto BA.COM.ELM Stitcher at Hartford Stage No
Megan Plasket BA.COM.STC
Managing logistics and supply chain for CH Robinson No
John Pyzik BA.COM.ELM unknown
Haley Randazzo BA.COM.STC
Account executive at Red Moon Marketing Yes
Christine Reinicker BA.COM.JOU
Marketing and Advertising professional Yes
Andrea Ritchie BA.COM.ELM
Technical assistant/promotions at Alpha Broadcasting Yes
Paige Rudzin BA.COM.STC
Media and customer insights at CHANEL Yes
Jessica Ryan BA.COM.STC
Administrative assistant at NJ dealers Auto Mall No
Carlton Sarcione BA.COM.ELM unknown
Kathryn Searles BA.COM.ELM Producer at WCCB Charlotte Yes
ACEJMC Standard 9 9-51
Anna Seiler BA.COM.STC
Office design assistant at Tradition Homes
Alexis Sherman BA.COM.JOU unknown
Jessica Shultz BA.COM.MPC unknown
Bridget Simon BA.COM.STC
Account coordinator at LMO advertising Yes
Caroline Stewart BA.COM.ELM Associate producer at the X-factor Yes
Justin Terrell BA.COM.STC unknown
Jessica Thornes BA.COM.STC
Social Media coordinator at Center for Innovative GYN care Yes
Celeste Villafano BA.COM.STC
Marketing and communication specialist Yes
Daniel Vivenzio BA.COM.JOU Producer at Time Warner Cable News Yes
Andrew Walker BA.COM.GIC Data abstractor at Cornerstone Health No
Jason Williams BA.COM.STC Nationwide Insurance Agent No
Kaitland Willingham BA.COM.STC
Director of Communication strategy--United Business Yes
High Point University
Lauren Young BA.COM.ELM unknown
7. Describe the program used to track graduates to assess their experience in the professions and to improve curriculum and instruction. The NQSC’s alumni base of 795 is relatively small because the school and major were only started in 2007. However, a critical mass of alumni is anticipated within the next few years. High Point University has a growing alumni network and the School is taking steps to track NQSC graduates.
ACEJMC Standard 9 9-52
Databases of alumni names, postal addresses and e-mail addresses are maintained in the NQSC; however, until two years ago employment histories were not sequenced. With prodding from the Dean’s Advisory Council and an expanded School administration, the School’s administration has made concerted efforts to improve our alumni relations. The NQSC conducted an alumni survey summer 2015 (see APPENDIX 9.12 for results) as part of the assessment and anticipate conducting this survey to alumni each year. This process will allow the School to systematically collect data from alumni to help strengthen the curriculum and instruction. In addition, Megan Garafola, a member of the Dean’s Advisory Council, is a NQSC alum and her feedback as a board member is a component of the assessment plan as well. The NQSC developed an alumni database that includes home and email addresses. The School’s website includes a link for alumni to self-register, update their contact information, and request a copy of the NQSC newsletter—Q The News—that was emailed in February 2015. This project produced by one of our practicum classes was well done but, in hindsight, too long and had too many stories. Going forward, the School is targeting four editions with only four items in each email. Rather than relying on a class to produce it, that responsibility has been assigned to Phil Watson, an assistant professor of the practice of communication. Each year, the NQSC hosts an open house during alumni weekend, and the School’s administration typically visits with 30-40 alumni during that time. In addition, the NQSC faculty also network informally with alums and professionals (e.g., meet occasionally for coffee, have lunch together, attend professional meetings, converse by telephone, etc.). All faculty members host professionals, including alums, as guest speakers in their classes each semester. A full list is available in the Standard 3—Diversity & Inclusiveness section.