UNIVERSITY COLLEGE CORK 2015
PANEL B REPORT
EPIDEMIOLOGY & PUBLIC HEALTH
REPORT OF THE RESEARCH QUALITY REVIEW
Report of the Research Quality Review at University College Cork, 2015
2
Panel B Report
Epidemiology & Public Health
Units in Panel B• Gerontology&Rehabilitation• Epidemiology&PublicHealth• GeneralPractice• Paediatrics&ChildHealth• Obstetrics&Gynaecology• INFANT
Panel B membersChair:Professor Eric Steegers,ErasmusMC,Rotterdam,TheNetherlandsDVCforGerontology:Professor Peter Crome,UniversityCollegeLondonDVCforEpidemiology:Professor Mark McCarthy,UniversityCollegeLondonDVCforPaediatrics:Professor Vineta Fellman,LundUniversity,SwedenDVCforObstetrics:Professor Fiona Lyall,UniversityofGlasgowDVCforINFANT:Professor Mark D. Kilby,UniversityofBirmingham
How the Panel went about the business of the review
TheUCCRQRSteeringCommitteeprovidedadviceonthestructureofthisReport.
TheDisciplinaryViceChair(DVC)forGeneralPracticewasunabletoattend.HisworkwascoveredbytheDVCforEpidemiology&PublicHealth.
Duringthefirstday,aftertheinputbythesteeringcommittee,initialdraftreportsoftheunitspriortothevisitsthatafternoonwerediscussed.Inparticular,substantialmutualagreementwasachievedonscoringtheResearchActivityIndicators.
TheseconddaywasusedtoindividuallyadaptthedraftreportsaccordingtotheinputprovidedduringthevisitsandtodiscussthosebetweenthemembersofthePanel.
Duringtheeveningoftheseconddayandearlymorningofthethirdday,finalreportsweredraftedbytheindividualDVCstobediscussedandagreedlaterinthemorningbythePanel.Thesereportswereguidedbydisciplinarynorms.Furthermore,summaryslideswerepreparedforeachunitaswellassomegeneralintroductoryandconcludingremarksofthePanelasawhole,fortheindividualexitpreparationsthatafternoon.
General observations and comments
ThemembersofthePanelwereimpressedbythehospitalityandprofessionalismoftheQualityPromotionUnitandtheRQRSteeringCommittee.UCCshowsaremarkableambitioninperformingsuchRQRforthesecondtime.Furthermore,werecognisedtheambitionintransformingthehealthservicetoanAcademicHealthCentre.Weexperiencedgenerallygood,enthusiasticengagementfromtheunitsduringthevisits.
AssetoutintheGuidelines,theunitswereassessedandscoredasawholeandtointernationaldisciplinarystandardsratherthanlocalornationalstandards.
ThereseemedtobesomediversityonhowunitspresentedtheirmaterialfortheRAIsandnotallresearchersprovidedtheirtopfivepeer-reviewedpublicationsforassessment.Forwardedpublicationsmaybethebestcited,themostimportantfortheircareersorgrantsachievedorimportantfortheirnationalfieldinbeingsocietallyrelevant.
ThePanelrecognisedthelimitationsputuponUCCbythenationalbudgetcutsandthemoratoriumonfixedtermsofacademicpersonalandtheopportunitiesforpromotiontoProfessor.
Introduction
TheDepartmenthasitsoriginswithintheMedicalSchoolforteachingundergraduatemedicalstudents.Since2008,theProfessor/Lecturerstaffnumberhasrisenfromsevento12FTEequivalents,andtheDepartmenthasbeenrelocatedinhigh-qualityofficeswithinthecampus,fundedthroughthePRTLI-5capitalprogramme.
TheDepartmenthasacoregroupofestablishedandemergingresearchleadersindietandhealthresearch,cardiovasculardiseaseanddiabetesepidemiology,occupationalhealth,healthservicesresearch(currentlyassessingemergencydepartments)andworkonthecausesandpreventionofsuicideandself-harm.
TheDepartmenthasalsogainedstrengththroughdevelopingnewteaching(includinganimportantBScinPublicHealthwhichnowgraduates30studentsayear,anda‘feeder’intotheresearchprogramme),supportforyoungcareerscientists(throughtheHealthResearchBoard-fundedScholarProgrammeentitledSPHeRE)andenablingcontactsbetweentheDepartmentandotherresearchersbothwithinUCCandexternally.TheDepartmentnowoffersteachingforaround200studentsayearinundergraduate,mastersandpostgraduatecertificatecourses(sometaughton-line),aswellascontributingelsewhereacrosstheuniversity.
RAI 1 – Selected published output
Themainfieldsofresearchpublicationincludeepidemiology(dietandhealth),occupationaldisease,healthservicesresearch(includingaccidentservices)andbroaderpublichealth(includingsuicideprevention).TherearealsosignificantcollaborationswithcollegedepartmentswithinUCC.
Thesubmittedpublicationswererefereedbythreesub-unitassessors(onerequestedassessordidnotprovidearesponse).Wheretworeportswereavailable,therewashighconsistency.
Therefereesindicatedstrongsupportforthequalityofpublications.Overall,thepublicationoutputofsixresearcherswasconsideredtobeexcellent.ForCategoryAresearchers,10outof15achievedratingsacrossthefivepapersofexcellentorverygood.ForCategoryBresearchers,fouroutofsevenachievedaverageratingsofexcellentorverygood.
3
Panel B Report: Epidemiology & Public Health
TheselectedpublishedoutputoftheDepartmenthasbeendemonstratedtobeofaverygoodstandard.
RAI 2 – Total published output
TheResearchStatementreportedthattherehadbeen892“uniqueresearchoutputs”publishedoverthereviewperiod.434werejournalarticlesand417werepublishedininternationaljournalsandhighimpactjournalsincludingNature,Lancet,PLOSMedicine,InternationalJournalofEpidemiology,Diabetes,aswellasDiabetesCare,TheJournalofClinicalEndocrinologyandMetabolism,PLOSOne,JournaloftheAmericanGeriatricSociety,JournalofChildPsychologyandPsychiatry,PreventiveMedicine,JournalofEpidemiologyandCommunityHealth,BMJQualityandSafetyandCochraneReviews.
Twoofthethreerefereesquantifiedthismetric.Ofthe19researchersassessed,11wereconsideredtobeexcellentorverygood,whileeightwereconsideredgoodorfair.AllthePIsappearedtobesuccessfulinthismetric.
ThetotalpublishedoutputoftheDepartmenthasbeendemonstratedtobeofanexcellentstandard.
RAI 3 – Peer esteem
Ahighlevelofscoringwasgainedforpeeresteem,perhapsreflectingthelongertimeneededforepidemiologicalresearchfrominitiationtofinalpublicationthaninlaboratorysciences.
TheDepartment’smembershavecreatedstudiesthatlinkinternationally(European-wide)andwithnationalbodies,includingtheHealthResearchBoard(CentreforHealthandDiet),HRBResearchLeadersaward,HRBInterdisciplinaryEnhancementAward,HRBClinicalHealthProfessionalAward.Membershavegainedfundingforthehealthservicesresearchtrainingprogramme,inassociationwithtwopartnersinDublin,towardsaforthcomingcollaborativeNationalHealthServicesResearchInstitute.TheDepartmenthasalsoworkedcloselysince1999withtheNationalSuicideResearchFoundation.
Twoofthethreerefereesprovidedthismetric,andassessedthestaffmembershighly:ofthe19assessed,thepeeresteemactivityof15researchers,includingallPIs,
wasconsideredtobe‘excellent’or‘verygood’,whilethepeeresteemactivityoffourwasconsideredtobe‘good’.
ThepeeresteemactivityoftheDepartmenthasbeendemonstratedtobeofaverygoodstandard.
RAI 4 – Research-related activity
DepartmentmembershavecontributedtointernationalresearchactivitiesincludingcoordinationoftheTRUSTEU-wideclinicaltrial,theDEDIPACEUJointProgrammingInitiativeondietandphysicalactivity,theCASEWHO/EuroMulticentrestudyonSuicidalBehaviour,ChildandAdolescentSelfHarm,theEuropeanNetworkofCancerRegistries,andconsultationonthedisciplinaryreviewoftheEUSeventhFrameworkprogramme.
TheCentreforHealthandDietcontributedtothe2014McKinseyGlobalInstitutereport“Overcomingobesity:Aninitialeconomicanalysis”.TherearestudentandstaffexchangesandcollaborativefundingwiththeUK,otherEuropeancountriesandNorthAmerica.
Staffmembersholdseniorpositionsinnationalhealthandresearchadvisoryorganisations.Therehasbeenstrongcollaborationwithnationalgroups,includingongoingmajornationalcohortstudies(theGrowingupinIrelandChildren’scohortstudyandtheIrishLongitudinalStudyonAgeing[TILDA]).TheNationalSelfHarmRegistrydevelopedanewSuicideSupport&InformationSystem(SSIS)incollaborationwithCoroners’courts,providingdataonsuicideclustersinIrelandandsupportforbereavedfamilies.TherehasbeencollaborationwithcommercialcompaniesonapplicationsfromtheCentreforHealth&DietResearch.
ThereareinternalUCCcollaborationswiththeScienceFoundationIreland(SFI)-fundedAlimentaryPharmabioticCentre,theSFI-fundedInfantCentreandtheHealthResearchBoard-fundedClinicalResearchFacility.
TheDepartmentholdsregulardepartmentalmeetingswithpresentationsfrominternationalandnationalspeakers,aswellasUCCandinternalstaffmembers.
Theresearch-relatedactivityoftheDepartmenthasbeendemonstratedtobeofaverygoodstandard.
Report of the Research Quality Review at University College Cork, 2015
4
RAI 5 - Postgraduate research education
Therehasbeenaprogressiveincreaseinpost-graduateandpost-docactivitiesintheDepartment.DevelopmentofthepublichealthBSchasprovidedstrongfirst-degreetrainingforpostgraduatestudiesandacompetitivefieldforapplications.
TheDepartmentcurrentlyhasover20PhDresearchstudents,workingwithseniorstaffmembersacrossarangeofpublichealthfields:bothPhDstudentsandselectedMasters’studentscontributetotheplanningandconductoffieldworkformajorstudiesledbytheDepartment.
Postgraduatestudentshaveastrongpublishingrecordofresearchpapersduringtheirstudentship:PhDstudentsaregenerallyrequiredtosubmituptofivepapers(andaminimumofthree)forpublicationbeforesubmissionoftheirthesisforexamination.Studentscontributedto35paperspublishedin2014andto34publishedin2013.
Manystudentshavedemonstratedmeritthoughawards,includingSheppardMemorialPrize,HorganBronzeMedal,bestposterprize(InfectiousDiseaseSocietyofIreland),UCCteaminIrishHealthcareAwards,HigherEducationAuthoritycompetitionforcommunicationofresearch,IEAstudentposteraward,andUKSocietyofMedicinebestposteraward.
Amonthlyresearchsupportgroup,forPhDstudents,post-doctoralresearchersandseniorstaff,enablesdiscussionofdraftsofpapersandchallengingmethodologicalissuesinepidemiologyandbiostatistics.Thereisalsogoodattentiontocareerdevelopmentforyoungerstaff,andmanypostgraduatestudentshavesubsequentlyachievedfurtherresearchpositionsbothabroad(Harvard,MRCUK)andwithintheDepartment.
ThepostgraduateresearcheducationactivityoftheDepartmenthasbeendemonstratedtobeofanexcellentstandard.
RAI 6 – Research income
Therehasbeenasubstantialachievementingainingresearchfundingacrossarangeoffieldsandagencies,bothnationalandindependent.Apartfromtheuniversity’sfundingforteaching,andimportantresearchfundingsupportfromtheIrishHealthResearchBoardandtheNationalSuicideResearchFoundation,theDepartmenthasdevelopedapplicationsacrossawiderrangeincludingEuropeanUnionandNorthAmericansources.Thisdiversity,whichdoesnotdependonasinglefundingagency,isimportantforthestrategicdevelopmentofnewfields,forexamplenewProfessorialappointmentsinoccupationalhealthandhealthservicesresearch.
TheUCCResearchStatementdescribedgrantincometotheDepartmentof¤8.3millionovertheperiod,althoughitwasdifficulttocorrelatethistotalwiththeinformationprovidedforindividualgrants.(SomesumswerereportedacrossinstitutionsandsomeonlyforUCC,andacrossvarioustimeperiods).Asecondmajorsumofaround¤8million(whichincludeddatacollection)wasgainedfortheNationalStudyofSelf-harm.
TheresearchincomeactivityoftheDepartmenthasbeendemonstratedtobeofanexcellentstandard.
Areas of good practice
TheDepartmenthasbeenproactiveindevelopingepidemiologyandpublichealthresearch.ThefieldhasbeenidentifiedbyUCCasoneoffiveareasforpriority,andtheDepartmenthasbenefittedinincreasedacademicappointmentsandimprovedphysicallocation.
TheDepartmenthasadynamicofficesettingwhichmatchesthelaboratoriesofthebiosciences,andensuringacloserelationbetweenallstaffandstudents.Aquarterlynewsletter,strengtheningoutreach,describesDepartmentactivitiesbothinresearchwork/publications/teaching,andalsoincommunityengagementandoutreach–abenefittoUCCasawhole.
Departmentalleadershiphasenabledexcellenceingainingresearchgrantsfromawiderangeofsources,andthisismatchedbyextensivescientificpublicationininternationaljournalsandsignificantrecognitionofseniorstaffatinternationalandnationaladvisorypositions.
Recommendations for future development
TheDepartmenthasrespondedwelltotherecommendationsmadeinthe2009review.Aforwardfive-yearstrategy2015-2019proposesnowtorationalisestructuresandgovernance,createaninternationallycompetitivecentreforpopulationhealthsciencesandhealthservicesresearch,andcontinuetoprovideopportunitiesforcareerdevelopmentandprogressionforacademicstaff.
TheDepartmentwillneedtopromotethevariedthemesacrossepidemiology(includingnutrition,CVDanddiabetesstudies),andhealthservicesresearch(includingA&Eworkandsuicideprevention).Equallythereisaneedtoworkindepthonmethodologies(suchasimplementationsciences,modellingandcollaborationbetweenstatistical,socialscienceandpolicyanalysesincomplexinterventions),andtostrengthentheopportunitiesfromclinicaljointappointments(suchasthosealreadywithperinatalepidemiologyandIrishcancerregistry).Publichealthinfectiousdiseaseresearchremainsasignificantopportunityforlinksbothinfieldpracticeandalsolaboratorystudies.Indeed,afurtherperspectivemaybetoengagewithglobalpublichealth,whereIrelandhassomecompetitiveadvantageininternationalrelationsandcandrawonastrongrangeofnationalsystemsfordiseasecontrol.
Thereisalsoevidentpublicengagementfortheactivitiesthatareofcentralinteresttothedepartmentalleads.Thereshouldbestrongpublichealthteachingwithinmedicalundergraduateandpostgraduatepractice(bothprimarycareandhospitaltraining),aswellaswithpublichealthpracticeatlocallevel–wheretheresultsofresearchmustbeapplied.ThisisanissuenotonlyforIrelandbutinternationally,wherethereisincreasingrecognitionofthepopulationdimensioninhealthaswellasclinicalsciencesandclinicalpractice.
Concluding statement
ThereviewshowsaDepartmentthatisdevelopingstrongly,isresearch-focusedandnationallyinfluential.ThereisimportantcooperationwithotherresearchgroupswithinUCC,membersoftheDepartmentarerecognisedandcontributeinternationallyacrossseveralalliedfieldsofepidemiologyandpublichealth.Members
5
Panel B Report: Epidemiology & Public Health
provideimportantinputtonationalpolicyaswellaslinkingbeneficiallyatlocallevelwithlocalissues.Despitethefeweropportunitiesforpopulationresearchcomparedwiththebiosciencesandcommercialpharmaceuticalcompanies,excellencehasbeenshownbothincompetitiveincomeformedicalresearchgrantsandinthemajorcontributionofpublications.TheDepartmenthasappropriatelydevelopedlinkswiththeHealthResearchBoardforbothpublichealthandhealthservicesresearchandhasimportantdevelopingcollaborationsacrossEuropeandwithNorthAmerica.Thestrongresearchactivityandhighpublicationrateininternationalpeer-reviewjournalsalsoreflectstheDepartment’sexcellentperformanceinattractingandtrainingpostgraduatestudents,whonowcontinueintopost-doccareersaswellasdevelopingwiderlinksinIrelandandabroad.
TheresearchactivityoftheDepartmenthasbeendemonstratedtobeexcellentandofleadinginternationalstandard.
Overall comments
Developing research capacity
ThesixunitsconsideredbythePanelformasignificantcontributionwithintheSchoolofMedicine,undertakingresearchatcellular,diseaseandpopulationlevels.Therewerethreeunitswithprimaryresearchfocus(Gerontology,INFANTandPublicHealth)andthreewithstrongclinicalresponsibilitiesaswellasresearch(Obstetrics,Paediatrics,PrimaryCare).BecauseofthehistoricstructureswithintheUniversity,therewassomeoverlapintheassessmentbetweenObstetrics,PaediatricsandINFANT.
Allunitsshowedstrengthinundertakingresearch.TherehasbeensubstantialprogresssincetheUniversity’sresearchassessmentin2009,withsubstantialindependentresearchfunding,anddemonstratingpublicationandesteematinternationallevel.Performanceinsomeunitsdependedonrelativelyfewleadingresearchers,andraisingperformanceoffurtherprincipalinvestigatorsisneededforsustainability.
IftheUniversitycontinuestoappointlecturerstoonlygiveundergraduateteachingandnotrequireresearchactivitiesofthem,itwouldbemoreaccurateforresearchreviewoftheunitiftheywerenotincludedintheunit’sresearchactivestaff.Aseparateeducation/teachingqualityreviewwouldbewarranted.
Staff development
Recognisingthelimitationsoftherecentfinancialsituation,andthepositionofuniversitieswithinthepublicsectorworkforce,theprocessforcareerprogressseemedunclear.Thiscouldbeaddressedthroughannualformativeperformancereviewanddevelopmentassessmentforstaff.
UCCisadvisedtoimplementauniformannualreviewforPhDstudents,andtosetstandardsinprogress,suchasupgradingassessmentsandpublications.Post-doctoralstaffareencouragedtokeepaportfolioforself-reflection.Continuedsupportisneededinprogressiontoprincipalinvestigator.
Assessment process
Theguidelinesforreviewbyunitsmayneedtobeclarified,asunitsprovidedveryvariableinformation.Forexample,insomestaffthe5submittedpublicationswerenotalwaysoriginalresearcharticles.SomeunitsdidnotprovideasummaryofRAI4data,butreferredtoinformationinIRIS.TheIRISdatawasveryvariablebetweenindividualsandcollectinginformationfromthedatabasewasnoteasyforthePanel.
HigherstandardsofrecordingonIRISmightbeachievediftherewasobligatoryannualreportingbydepartmentsandresearchcentres.TheUniversityshouldalsoinvestigatefurthertheuseofbibliometryindicesforresearchreviewandprioritisation.
Recommendations to the University
UCCmaywishto:
Improvethescoringsystemforpapersmakingthosemoredetailedinfutureassessmentsallowingbettercomparisonbetweenreviewers.
Providemoreconsistentinstructionstotheunitsregardingthenatureofpublicationsputforward.TheinstructionsonRAIcriteriafortheexternalreviewersmayalsobeimprovedasthereareoccasionalsubstantialdiscrepanciesbetweenreviewers.Considerhowtoincludeall(divisionsof)Departmentsforfullreview.
Considerhowtoratesocietalimpact(botheconomicallyaswellassocietalwell-being).
Considerhowtoavoiddoublecountingbetweendepartmentsandcentresintheallocationoffundingandpublications.
Webelievethatagreaterroleforbibliometricindicatorsinresearchreviews,bothonanindividualasaunitlevel,wouldbeadvisableaswellasthepresentationofSWOTanalyses.
IncreasedfocusisadvisableonthedispersionofpoliciesonscientificintegritytothelevelofPhDstudentsandpost-docs.Thismayincludetheinitiationofanauditingprocessofthepracticeofscientificworkwithinunits.
Theeffectsofthemoratoriumonthesustainabilityofhumantalentandlackofcareerprogressionatseniorlevelsshouldhavecontinuousattention.WecomplimentUniversityontheattentionpaidtopostgraduatestudentneeds.
OnemayconsiderrepositioningofunitsbetweenthePanels.Forexample,itwouldhavebeenusefultoshifttheSchoolofNursingandMidwiferyinPanelCtoPanelB.
Report of the Research Quality Review at University College Cork, 2015
6
Section B: Outline of RQR 2015 Process
ThefollowinginformationoutliningthestructureofthereviewprocessisabridgedfromtheRQRGuidelines2014.
Review Structure
1. FifteenPeerReviewPanelswillbeappointed,basedondisciplinaryclusters.Peerreviewteamsmayvaryinsizeaccordingtothesizeandcomplexityoftheclusterofacademicunitsanddisciplineswithinthecluster.
2.PeerReviewPanelswillreceivematerialinadvance.Themajorityofreviewerswillworkremotely.ChairswillvisittheUniversitytwice:beforetheexerciseforbriefingandtoensureconsistencyofapproachand,togetherwiththedisciplinaryvicechairs,aftertheremotereviewofsubmissionshastakenplace.
3.Sitevisitstoinclude:
Firstsitevisit(byChairs)- InformationandbriefingmeetingsbetweenPanel
ChairsandmembersoftheSteeringCommittee.- BriefingswithCollegesandRICUsonprevailing
researchandgraduateeducationconditions.
Secondsitevisit(byChairsandDisciplinaryViceChairs)- Presentationfromacademicunitsonresearchactivity.- Meetingswithstaff,researchersandpostgraduate
researchstudents.- MeetingswithrelevantOfficersoftheUniversity.- Visittofacilitiesofunits.- Considerationofthereportsoftheremotereviewers.- Agreementonresults.- Draftingofreportaccordingtoguidelinesandcriteria
forassessment.
Criteria for Assessment
Researchperformancewillbeevaluated,relativetointernationaldisciplinarynorms,underthefollowingheadings:
a.Selectedpublishedoutputb.Totalpublishedoutputc.Peeresteemd.Research-relatedactivitiese.Postgraduateresearchenvironmentf. Researchincome
Definitions
Forthepurposesofthereviewthefollowingdefinitionsapply:
1. AssessmentPeriod:theperiodfrom1January2008to31December2014.Theresearchdescribedinsubmissionsfromacademicunitsandresearchcentres/institutes,includingdataaboutresearchfundingandthetextualcommentary,mustrelatetothisperiod.
2.CensusDate:thedatedeterminingtheaffiliationofacademicandresearchstafftoaparticularacademicunit/researchcentre/institute.Allstaffshouldbesubmittedbytheacademicunit/researchcentre/institutethatemploysthemonthisdate,regardlessofprevious
orforthcomingchangesintheiremploymentstatus.NotethatstaffcanbeassociatedwithanacademicunitandaRICU,butwillonlysubmitandbereviewedonceandtheoutputsincorporatedintotheacademicunitandtheRICU.Astaffcensuswillbeundertakenduringthepresentacademicyearon31May2014toenableplanning.Anupdatetothecensuswillbeundertakenon31October2014,toaccountforallstaffhiredafterMay2014andwhowillbeinpostatthetimeofthereview,toprovidethefinallistforthereview.
3.PublicationPeriod:theperiodduringwhichresearchoutputsmustbeplacedinthepublicdomain(orinthecaseofconfidentialoutputs,lodgedwiththesponsor)iftheyaretoqualifyforinclusionintheassessment.Thepublicationperiodrunsfrom1January2008to31December2014.
4.Research:thisdefinitionwasapprovedattheAcademicCouncilmeetingof7March2008andremainsunchanged:
‘Research’forthepurposeofthereviewistobeunderstoodasoriginalinvestigationundertakeninordertogainknowledgeandunderstanding.Itincludesworkofdirectrelevancetotheneedsofcommerce,industry,andtothepublicandvoluntarysectors;scholarship*;theinventionandgenerationofideas,images,performances,artefactsincludingdesign,wheretheseleadtoneworsubstantiallyimprovedinsights;andtheuseofexistingknowledgeinexperimentaldevelopmenttoproduceneworsubstantiallyimprovedmaterials,devices,productsandprocesses,includingdesignandconstruction.Itexcludesroutinetestingandroutineanalysisofmaterials,componentsandprocessessuchasforthemaintenanceofnationalstandards,asdistinctfromthedevelopmentofnewanalyticaltechniques.Italsoexcludesthedevelopmentofteachingmaterialsthatdonotembodyoriginalresearch.
*Scholarshipisdefinedasthecreation,developmentandmaintenanceoftheintellectualinfrastructureofsubjectsanddisciplines,informssuchasdictionaries,scholarlyeditions,cataloguesandcontributionstomajorresearchdatabases.
5.Consultancy:incomeandresearchoutputsarisingfromconsultancycontractsshouldnormallybeexcluded,sinceconsultancyisusuallyconcernedwithapplyingexistingknowledge.However,theymaybeincludediftheworkundertakenorpublishedasaresultmeetsthedefinitionofresearch,irrespectiveofthenatureofthecontractorinvoicingarrangement.
6.PedagogicalResearch:isincludedinthescopeoftheRQRandincludesresearchwhichenhancesthetheoreticaland/orconceptualunderstandingof:- teachingandlearningprocessesinhighereducation- teacherandlearnerexperiencesinhighereducation- theenvironmentorcontextsinwhichteachingand
learninginhighereducationtakeplace- teachingandlearningoutcomesinhighereducation- therelationshipsbetweentheseprocesses,outcomes
andcontexts
7.AppliedandPractice-BasedResearch:isincludedinthescopeoftheRQRandinvolvesaprocessofsystematicinvestigationwithinaspecificcontextinordertosolveanidentifiedprobleminthatcontext.Itaimstocreate
7
Panel B Report: Epidemiology & Public Health
neworimprovedsystems(ofthoughtorproduction),products,processes,materials,devices,orserviceswhichhaveanimpactonsocietythroughenhancedwealth-creationandqualityoflife.
Somecharacteristicsofappliedresearchandpractice-basedresearcharethat:
a) Theyareinformedbyanintellectualinfrastructureofscholarlyresearchinthefield.
b)Theyapplyand/ortransferenhancedknowledge,methods,toolsandresourcesfrompureresearchanddevelopmentalresearch.
c) Theycontributetoscholarshipinthefieldthroughsystematicdisseminationoftheresults.
d)Theoutcomesmaybespecifictothesituationinwhichtheresearchhasbeenapplied,althoughthemethods/toolsevolvedareoftentransferable.
8.CreativeResearch:encompassescreativeworkanditsoutcomesinarangeofsubjectareas,includingcreativewriting,music,drama,dance,theatre,performance,liveart,andfilm.Thisresearchmayleadtopublishedmaterialsinavarietyofformsinanyofthesesubjectareas.Suchresearchisalsodiverseintherangeofartisticpracticesonwhichitmaydrawandmayextendtoanycultural,geographicalandhistoricalcontext.Itmayincludeproductionorperformanceofcreativematerialwhichitselfresultsfromaprocessoforiginalcreativeenquiry.Thisworkmayalsobecollaborativeinnature.
9.ResearchSubmission:thisisthetotalityofwhatwillbesubmittedtoreviewPanelsandincorporatescontextualinformation(theresearchdescriptionforeachunitwhichsetsouttheextentandboundariesoftheresearchcarriedoutinthatarea),theresearchstatement(seebelow)andtheinformationrequiredbythesixResearchActivityIndicators(seebelow).
10.ResearchStatement:theresearchstatementwillprovidecontextualinformationandanoverviewoftheresearchactivityineachunitofassessmentduringthereviewperiodinadditiontoacriticalassessmentofprogressmadesincethelastRQR,includingaresponsetoanyrecommendationsmade.Atemplateandfurtherinformationonsubmissionwillbeprovided.Itwillbeamaximumof5,000words(seebelowforfurtherdetail).
11. ResearchActivityIndicators(RAIs):therearesixresearchactivityindicators.Theinformationprovidedundereachofthesixheadings,togetherwiththeresearchstatementandtheresearchdescription,constitutestheresearchsubmission.
12.UnitofAssessment:thesearetheunitsreviewedbyeachPanelasdefinedinAppendixA.ItincludeseachoftheacademicunitsandeachoftheassociatedResearchInstitutes,Centresorunits.NB:NotalloftheassociatedResearchInstitutes,Centresorunitswillbereviewedseparately.
Assessment Process
1. Thisisanexpertpeerreviewexercise.Panelmemberswillexercisetheirknowledge,judgementandexpertisetoreachacollectiveviewonthequalityprofileofresearchdescribedineachsubmission,thatis,theproportionofworkineachsubmissionthatisjudgedtoreacheachoffivequalitylevels(seebelow).Thedefinitionofeachlevelreliesonaconceptionofquality(ofleadinginternationalstandard)whichistheabsolutestandardof
qualityineachunitofassessment.Eachsubmissionwillbeassessedagainstabsolutestandardsandwillnotberankedagainstothersubmissions.
2.Externalexpertsnominatedbytheacademicunitswillbeaskedtosuggestwho,fromamongtheirlistofPanelnominations,mightbesuitablefortheroleofChair.ThefinaldecisionandapprovalofchairswillbemadebytheSteeringCommittee.
3.UptofiveDisciplinaryVice-Chairswillbeappointed,withtheassistanceoftheChair,foreachPanel.Theywillberesponsiblefortheco-ordinationoftheelectronicevaluationofeachdisciplinaryunitbytheremotereviewers.Theywillattendthesitevisitpost-evaluation.
4.ChairsandDisciplinaryVice-ChairswillberesponsibleforensuringconsistencyacrossandwithinPanelsandtheapplicationofinternationalstandardsintheexercise.
5.PanelreviewerswillinitiallyevaluateRAIs1-3andelementsofRAI4atanindividuallevel.TheywillsubsequentlyreviewoverallperformanceoftheacademicunitorRICUdrawingontheinputofeachresearcher,recognisingthatresearchersmayappearinmorethanone.
6.FirstSiteVisit.PanelChairswillvisitUCCforonedayforbriefingpurposesandtoensurethatthePanelsworkconsistentlyasfaraspossible.
7.SecondSiteVisit.Followingtheremotereviewofthesubmissions,theChairsandDisciplinaryVice-ChairsofthePanelswillvisitUCCtoconductsitevisits.TheywillmeetwithstaffandofficersoftheunitandUniversityandwillvisittheresearchandotherfacilitiesofeachunitunderreviewinordertoformanassessmentoftheresearchenvironment.Atthesecondsitevisit,theChairsandDisciplinaryVice-Chairswillconsiderthereportsfromtheremotereviewersinordertoinitiatediscussiononeachindividualsubmission.Apreliminaryprofileofthequalityofoutputswillbeconsidered.Aprofileofthequalityofresearchoutputsandpeeresteemwillbecompiled,alongwithdecisionsmadeastoscoresfortheresearch-relatedactivities,postgraduatetraining,theresearchfundingandresearchenvironment,takingonboardthedeliberationsofthePanelatlarge.
8.Anoverallresearchevaluation(ORE)willbeawardedbythePaneltoeachunit.ThiswillbeachievedthroughaprocessofconsiderationofallscoresinthesixRAIsalongwithconsiderationbythePaneloftheResearchStatementandothercontextualinformation.TheresultsforthesixRAIswillalsobeproducedforeachunit,providinganonymouspercentilesforRAIs1,2and3,alongwithresultsfortheunitinRAIs4,5and6.ThePanelwillfinallyconfirmthat,initsexpertjudgement,theoverallrecommendedscoreisanaccurateandappropriatereflectionoftheresearchactivityineachsubmission,andthatitsassessmenthastakenaccountofallcomponentsofthesubmission.FurtherguidancewillbeprovidedtoChairsofPanelsatthefirstsitevisit.
9.Descriptiveandevaluativestatements.Panelswillprovideadescriptivestatementoftheirviewoftheoverallqualityofresearchactivityforeachacademicunit.Panelsarealsoasked,withinthisstatement,tocommentonthetotalityofresearchactivityandperformanceinthecontextoftheresearchenvironmentinwhichtheunitisworkingandtomakerecommendationsforimprovement.
Report of the Research Quality Review at University College Cork, 2015
8
Research Excellence
Panelsrecognisethediverserangeofdisciplinesrepresentedbytheunitsofassessmentassignedtothem.SetoutbelowarethebroadparametersfortheassessmentofthequalityofresearchforeachofthesixResearchActivityIndicatorswithinwhichindividualPanelsmayexerciseadegreeofvariation.Thequalitylevelsrefertoqualitystandardsofscholarshipthatarethenormwithintheinternationalacademiccommunity.
Level 5 Qualitythatisofleadinginternationalstandard.
Theresearchworkoractivitywillbeexcellent,displayingaveryhighleveloforiginality,significancetothedisciplineandrigour;itwillbeinnovativeandpotentiallyagenda-settinginresearchand/orpolicyfields
Level 4 Qualitythatisofverygoodstandardintermsoforiginality,significanceandrigourcomparablewithsuchworkinternationally.
Theresearchworkoractivityhashadorislikelytohaveasignificantimpactonresearchand/orpolicyagendas
Level 3 Qualitythatdemonstratessignificancetothedisciplineandrigourtoagoodstandard.
Theresearchworkhashadorislikelytohavearecognisedimpactonresearchand/orpolicyagendas
Level 2 Qualitythatdemonstratessignificancetothedisciplineandrigourtoafairstandard.
Theresearchworkoractivityhasonlyhadorislikelytohaveamarginalimpactuponexistingparadigmsandagendaswithinthediscipline.
Level 1 Qualitythatfallsbelowtheadequatestandardofrecognisedworkwithinthediscipline.
Theresearchworkoractivityispoorandhashadnoimpactnorisitlikelytohaveanimpactuponexistingparadigmsandagendaswithinthediscipline.
BecauseofthedifferenceswhichexistbetweenthesixRAIs,appropriatecriteriawillbeemployedineachone:
RAI1willbeevaluatedagainstthecriteriaoforiginality,significanceandrigour.RAI2and3willbeevaluatedagainstthecriteriaofextent,diversityandquality.RAI4and5willbeevaluatedagainstthecriteriaofinternationaldisciplinarynorms.RAI6willbeevaluatedagainstthecriteriaoffundinglevelsforthespecificunitandcognatedisciplinesavailabletoresearchersinIreland.
Definitions of Research Activity Indicators (RAI)
Research Activity Indicator 1 (RAI 1): Selected Published OutputPanelswillberequiredtorateeachofthefiveselectedresearchoutputsforeachCategoryAandBresearcher.EachpublicationwillberatedbytwoReviewers.TheoverallqualityprofilewillbefinalisedbythePanel.
Research Activity Indicator 2 (RAI 2): Total Published OutputTwoPanelmemberswillberequiredtoallocateanindividualCategoryAorCategoryBresearcher’stotalresearchoutputintheperiod,identifiedonIRIS/CORAtooneoffivequalitycategories.
Research Activity Indicator 3 (RAI 3): Peer EsteemThepurposeofthismetricistocapturetheoverallscholarlystandingofCategoryAandCategoryBresearcherswithintheunit,basedoninformationpresentedintheirIRISprofile.Evidenceofpeeresteem,acrossthecareerasawhole,includespublicationoutput,Fellowships,Honours,InvitedPlenaryPresentationsatsignificantdisciplinaryconferences,serviceonappointmentPanelsatotherinstitutions,externalexamining,translationofworks,refereeing/editingofjournalsetc.,aswellassignificantresearchactivitywhichoccurredbeforethereviewperiodbegan(e.g.widelycitedpublications,internationalprizesawarded,etc.).Theratinggiventoanindividualshouldreflecttheleveloftheindividual’sachievementsacrosshisorherresearchcareerasawhole.ThePanelwilldeterminethequalityprofileforeachindividualresearcher.TheoverallqualityprofilewillbefinalisedbythePanel.
Research Activity Indicator 4 (RAI 4): Research-related ActivitiesForthepurposesoftheRQR‘research-relatedactivity’isintendedtocaptureactivitywithinandbeyondtheunitbyindividualorgroupsofresearchersintheunit.Thisincludesseminarseries,research-focusedpublicengagementexercises,specialisttrainingprovision,collaboration,researchmentoring,outreachactivities,supportforscholarlyinstitutions,evidenceofresearch-ledteachingatalllevels,etc.Theevidenceforthiswillbecollatedfromindividual’sIRISprofiles,andthecontextualinformationsuppliedbytheunit.
EachmemberofthePanelisaskedtogiveasinglequalitylevelforthecollectiveresearch-relatedactivitiesoftheunitbasedontheirprofessionaljudgement.
Themodal(mostfrequentlyoccurring)ratingacrossreviewerswillbetakenastheresearch-relatedactivityscore.[Thehigherratingwillbepreferredwherethedistributionofratingsismultimodal.]
Research Activity Indicator 5 (RAI 5): Postgraduate Research EducationPanelmembersareaskedtoeachgiveasinglequalitylevelforthecollectiveactivitiesrelatedtopostgraduatetraining.Thisratingshouldreflecttheprofessionaljudgementofthepeerreviewersconcerningthequalityleveldescriptorsprovided,takingintoaccountthenumberofstudentsstudyingforresearchdegrees,cultureofsupport(i.e.arrangementsforsupervision),andresearchtrainingenvironmentandopportunitiesavailableforresearchstudentswithintheunitunderreview.Theevidenceconsideredwillincludeastatementonpostgraduateresearchsubmittedbytheunit,informationfrompublishedunitweb-pages,numericaldatafromuniversityofficesregardingcompletionrates,completiontimes,etc.andprocessusedbytheunittoensurethatthesearesatisfactory.
EachmemberofthePanelisaskedtogiveasinglequalitylevelforthecollectiveresearch-relatedactivitiesoftheunitbasedontheirprofessionaljudgement.Themodal(mostfrequentlyoccurring)ratingacrossreviewerswillbetakenastheresearch-relatedactivityscore.[Thehigherratingwillbepreferredwherethedistributionofratingsismultimodal.]
Research Activity Indicator 6 (RAI 6): Research Income EachmemberofthePanelisaskedtogiveasinglequalitylevelforthecollectiveresearch-relatedincomeoftheunitbasedontheirprofessionaljudgementoftheresearcharea,takingintoaccounttheResearchLandscape
9
Panel B Report: Epidemiology & Public Health
relevanttoresearchersinIrelandasdescribedinthebriefingdocumentsprovided.Themodal(mostfrequentlyoccurring)ratingacrossreviewerswillbetakenastheresearch-relatedactivityscore.[Thehigherratingwillbepreferredwherethedistributionofratingsismultimodal.]
List of Panels & Units
Panel ASchoolofMedicine,incorporating:• DepartmentofMedicine(incRadiology)• DepartmentofSurgery(incAnaesthesia)• DepartmentofPathology(incMedMicrobiology)• DepartmentofPsychiatry• MedicalEducationUnit
Panel BSchoolofMedicine,incorporating:• CentreforGerontology&Rehabilitation• DepartmentofEpidemiology&PublicHealth• DepartmentofGeneralPractice• DepartmentofPaediatrics&ChildHealth• DepartmentofObstetrics&GynaecologyIrishCentreforFoetalandNeonatalTranslationalResearch(INFANT)
Panel C SchoolofClinicalTherapies,incorporating:• DepartmentofOccupationalScience&Occupational
Therapy• DepartmentofSpeech&HearingSciencesUniversityDentalSchool&HospitalSchoolofNursing&MidwiferySchoolofPharmacyOralHealthServicesResearchCentre(OHSRC)
Panel DSchoolofMedicine,incorporating:• DepartmentofAnatomy&Neuroscience• DepartmentofPharmacology&Therapeutics• DepartmentofPhysiologySchoolofFood&NutritionalSciencesDepartmentofMicrobiologyDepartmentofBiochemistry
Panel EDepartmentofChemistrySchoolofBiological,EarthandEnvironmentalSciences(BEES),incorporating:• Geology• PlantScience• Zoology&EcologyEnvironmentalResearchInstitute(ERI)Analytical&BiologicalChemistryResearchFacility(ABCRF)
Panel FSchoolofComputerScience&InformationTechnologySchoolofMathematicalSciences,incorporating:• Mathematics• AppliedMathematics• Statistics
Panel GSchoolofEngineering,incorporating:• DepartmentofCivil&EnvironmentalEngineering• DepartmentofElectrical&ElectronicEngineering• DepartmentofProcess&ChemicalEngineeringDepartmentofPhysicsTyndallNationalInstitute
Panel HSchoolofGeography&Archaeology:theHumanEnvironment,incorporating:• DepartmentofGeography• DepartmentofArchaeologyCorkCentreforArchitecturalEducation
Panel IDepartmentofAccountingFinance&InformationSystems(BIS)DepartmentofAccountingFinance&InformationSystems(AF)DepartmentofFoodBusiness&DevelopmentDepartmentofManagement&MarketingSchoolofEconomicsCentreforPolicyStudies
Panel JDepartmentofGovernmentSchoolofLawSchoolofSociology&Philosophy,incorporating:• DepartmentofSociology• DepartmentofPhilosophyStudyofReligionsSchoolofAppliedSocialStudiesInstituteforSocialScienceinthe21stCentury(ISS21)
Panel KSchoolofAppliedPsychologySchoolofEducation
Panel LSchoolofIrishLearning,incorporating:• DepartmentofModernIrish• DepartmentofEarly&MedievalIrish• Béaloideas/Folklore&Ethnology
Panel MSchoolofLanguages,LiteraturesandCulture,incorporating:• DepartmentofFrench• DepartmentofGerman• DepartmentofSpanish,Portuguese&LatinAmerican
Studies• DepartmentofItalianAsianStudies
Panel NSchoolofHistory,incorporating:• DepartmentofHistory• HistoryofArtDepartmentofClassicsSchoolofEnglish
Panel OSchoolofMusic&Theatre,incorporating:• DepartmentofMusic• Drama&TheatreStudies