www.eurocris.org

Brigitte Joerg, PhD, euroCRIS, JeiBee Ltd.

Harmonised CORE Information Reporting Profile

www.eurocris.org

Towards a Core Information Reporting Model

„Institution submits report to funder“

www.eurocris.org

UKRISS Modeling Approach

1. Bottom-Up Analysisa. ROS (ROS) objects and fieldsb. ResearchFish (RF) objects and fields

2. Consulting Best Practicesa. MICE; REF; DESCRIBE; CRISPool, etc.b. Essential: “Theory-building and logic-modelling is essential to

establish causal inference in evaluation.”

3. Top-Down Use-Case driven Modelinga. “institution submits report to funder”

www.eurocris.org

Results: Bottom-up Analysis (object-harmonisation)

Objects

Vocabu- laries

ROS ResearchFish

Impact

Staff Development

Publication Intellectual Property Dissemi

nation / Communication

Collaboration / PartnershipProduct /

Intervention

Award Recognition

DatasetKey Findings

Spinout Further FundingEvent Exploitation

● Current Harmonisation ○ Objects (e.g. Publication; IP; Partnerships, etc.)○ via e.g. Mappings to UKRISS Model

● Potential Harmonisation ○ Objects (e.g. Dataset; Event; Exploitation; Key Findings; Product/Intervention)○ via e.g. Extension assigning Objects to the UKRISS Model

www.eurocris.org

Results: Bottom-up Analysis (field-harmonisation)

Objects

Vocabu- laries

ROS ResearchFish

Impact

Staff Development

Publication Intellectual Property Dissemi

nation / Communication

Collaboration / PartnershipProduct /

Intervention

Award Recognition

DatasetKey Findings

Spinout Further FundingEvent Exploitation

● Current Harmonisation ○ Semantic Similarity such as e.g.

■ RF: “Provide a short name/title for this output.” ■ ROS: “Series Title”

● Potential Harmonisation ○ Semantic Similarity through extensions such as e.g.

■ Mapping to UKRISS:Output Types (via ROS/RF Mappings)■ Extensions such as UKRISS IDs (e.g. OrgID; PersonID, etc).

www.eurocris.org

ROS/RF Harmonisation Degrees(based on Field counts / semantic ‚similarity‘)

Total Field Counts

ROS 235

ResearchFish 99

Current Harmonisation 45

Potential Harmonisation 31

Similarity Examples:RF: “Provide a short name/title for this output.”

ROS: “Series Title”

RF: Year of Publication

ROS: Date Published

RF: Volume

ROS: Volume Number

Current Harmonisation = Semantic Field Similarity

Potential Harmonisation = via UKRISS Field Extensions

www.eurocris.org

ROS/RF Harmonisation Degrees(based on Field counts / semantic ‚similarity‘)

www.eurocris.org

ROS/RF Harmonisation Degrees(based on Field counts / semantic ‚similarity‘)

compared to total

www.eurocris.org

ROS/RF Harmonisation Degrees(Vocabulary counts following Field ‚similarity‘)

Similarity Examples:

ROS: Publication TypeRF: Type of Publication

ROS: International AudienceRF: “What was the extent of geographical "reach" of this activity (e.g. [...] region, nation, or international)?

Current Harmonisation = Semantic Field Similarity

Potential Harmonisation = via UKRISS Field Extensions

Total Vocabulary Counts

ROS 39

ResearchFish 12

Current Harmonisation 5

Potential Harmonisation Needs further Investigation

www.eurocris.org

UKRISS Modeling Approach

Following Best Practice - Recommend a higher level overarching Reporting Model as introduced in: “Measuring the Impact of Research” (2007)*

ATN = Australian Technology Network of Universities, which includes Curtin University of Technology, University of South Australia, RMIT University, University of Technology, Sydney and Queensland University of Technology

*http://www.atn.edu.au/docs/Research%20Global%20-%20Measuring%20the%20impact%20of%20research.pdf

www.eurocris.org

UKRISS Core Information Model

12

CERIF Entities

Harmonisation through conceptual alignment

Objects

Reporting Profile

Vocabularies

Research Output

Research Outcome

Research Impact

Measure- ments

ROS ResearchFish

Research Transfer

Impact

Staff Development

Publication Intellectual Property Dissemi

nation / Communication

Collaboration / PartnershipProduct /

Intervention

Award Recognition

DatasetKey Findings

Spinout Further FundingEvent Exploitation

Potential Current

UKRISS

CERIF XML

www.eurocris.org

Submission ID; Date; Version; Contact; Org; Type CERIF Mapping

Theme Sector cfClass.cfClassId

Beneficiary Sector cfClass.cfClassId

Potential Stakeholders Project; Institution; Funder; GtR; ROS; RF; cfClass.cfClassId

Cross-System-Interoperation GrantID; ProjectID; InstitutionID; FunderID cfFedId.cfFedId

Report

Reporting Types following the ATN Model

Research Outputs (OP)

Research Transfer (RT)

Research Outcomes (OC)

Research Impact (IMP)

Measurements (MM)

ATN Explanations ATN: For example: Discoveries; Publications; Patents; IPs;

ATN: Engagement with End-Users

ATN: New or improved products, services or processes

ATN: Value-added, improvements achieved

--- introduced by UKRISS ---

UKRISS Explanations UKRISS: Things done during research; research activity; tangible results describing what done

UKRISS: Changes arisen from output; e.g. invention; chance in approach people behave.

UKRISS: Measurements to verify / underly impact.

Use Case: Institution submits report to funder (1)

www.eurocris.org

Use Case: Institution submits report to funder (2)

www.eurocris.org

CERIF – Common European Research Information Format

A Formal Metadata

Model

www.eurocris.org

EuroCRIS Membership

Current membership is 172: 113 institutional, 37 personal and 22 affiliate (with altogether 325 delegates from 43 countries).

An international not-for-profit organisation, bringing together users, experts and developers of research information systems.

Main activity is the development,

maintenance and implementation of the

CERIF metadatamodel, the “Common Euopean

Research Information Format”, a standard for the

development, implementation and

interoperability of current research information

systems (CRIS) and their various application. CERIF

is an official EU Recommendation to

Member States

www.eurocris.org

EuroCRIS Strategic Partners

www.eurocris.org

EuroCRIS Board

CANADA

Greta Christina LingjaerdeIndicators

NORWAY

www.eurocris.org

UKRISS:Output Description

cf Measurement

Institution Sector

Stakeholder

cf OrgUnit

Measurement period

Date measurement was created

Date of data currency

Journal Article

cf Class

ROS/RFMapping

DescriptionNumber of outputs (cf Count)

Reference to ongoing Mapping/Work in Snowball Metrics:Anna Clements, St. AndrewsLisa Colledge, ElsevierBrigitte Jörg, euroCRIShttp://www.snowballmetrics.com

ServiceROS / RF

CERIFy e.g. Publication (UKRISS Output)

www.eurocris.org

www.eurocris.org

www.eurocris.org

Publication Counts in ROS

www.eurocris.org

Publication Counts in ROS

www.eurocris.org

Following REFSimilar to HEBCIS

www.eurocris.org

Staff Development in ROS/RF

Following REFSimilar to HEBCIS

www.eurocris.org

Staff Development in ROS/RF

www.eurocris.org

Staff Development in ROS/RF

www.eurocris.org

www.eurocris.org

www.eurocris.org

www.eurocris.org

UKRISS at ReConnect13 (Ottawa)

Research Information StandardsMachine Anatomy in UK and Germany

Annual CASRAI International ConferenceOttawa, October 16-18, 2013

Mathias Riechert, Institute for Research Information and Quality Assurance (IFQ), Berlin, GERBrigitte Jörg, euroCRIS, EU / CASRAI, INT

Joint Presentation!See also slides by

Mathias Riechert, IFQ

www.eurocris.org

UKRISS at ReConnect13 (Ottawa)

Objects

Vocabu- laries

ROS ResearchFish

Impact

Staff Development

Publication Intellectual Property Diss

emination / Communication

Collaboration / Partnership

Product / Intervention

Award Recognition

Dataset

Key Findings

Spinout

Further Funding

Event Exploitation

Current Harmonisation

Potential Harmonisation

• Publication ✓• Intellectual Property• Product/Intervention• Spin-Out• Collaboration/Partnership• Further Funding ✓• Staff Development ✓• Dissemination/Communication• Exploitation• Award / Recognition ✓• Key Findings• Impact• Dataset• Event

•Underlying Vocabularies were not considered here

✓ = UK – GER Overlap

www.eurocris.org

Remaining Work

• Further Model Verification via Data• Complete Formal CERIF Mapping (XML)

– ROS– RF– (HEBCIS)

• Definition of Vocabulary Boundaries• Final Report

www.eurocris.org

Summary - Conclusion

• Need for Harmonisation is obvious– National– International

• UKRISS Main Destination of Results– CASRAI UK Working Group on Contributions and OA Reporting

• Long-term Governance Model needs to be discussed• Business Case / Efficiency

– Re-Usability demonstrated– Standardized Interchange possible– Harmonisation (Alignment) required incrementially

• Need: Agreed Requirements (agreed questions)!!