Disclaimer: This analysis does not represent an official ANDS position. However, ANDS maintains a central interest in Value of Research Data and seeks to increase such value for researchers, institutions and the nation.

Objective● discuss the nature of value (the theory)● apply value to research data (foundations)● measure value of research data to the nation

(the practice)

ANDS Purpose: to make data more valuable for:- the researchers, research institutions and the nation. iPRES 2014

What is Value?

Ferrers (2013) A consumer value theory of innovation. PhD.

a process that resolves multiple meanings (eventually) into an emotional vector.

an outcome of the valuing process… what endures over time as an attitude.

“what delights customers and makes employees proud of what they do” Tim Cook 2011

VALUE is:

Types of Research Data Value:Int’l ● US: results of federally funded scientific research are made available to

and useful for the public (2013) OSTP, Exec Office of the President

● Royal Society 2012 Data must be accessible, readily located, intelligible, assessable, usable by others. Data and literature to be interoperable.

● US: Data is a valuable national resource and a strategic asset to the US Govt, its partners and the public… strengthens democracy... promotes efficiency... improve citizens’ quality of life. (project-open-data.github.io)

● G8 Open Data Charter: use our data to fuel innovation… high in quality… enormous potential...more responsive govt and business… spur economic growth (2013) https://www.gov.uk/government/publications/open-data-charter/g8-open-data-charter-and-technical-annex

Types of Research Data Value: ANDSManaged | Connected | Discovered | Reused

iPRES Keynote Oct 2014 - sharable, longer lasting (preserved), address social problems, as open as possible, answer new questions, enhances reputation

FAIR - findable, available, interoperable, reuseable

ANDS Purpose: to make data more valuable for:- the researchers, research institutions and the nation. iPRES 2014

Examples of local valueANDS Partner and Researcher Survey: Satisfaction with ANDS overall

Comments reveal: Value dimensions...service: The service provided by ANDS is excellent | time: Helpful and prompt in dealing with meuseful: I have attended some ANDS workshops/seminars and found them really useful for content and to meet other people… | staff: very helpful and enthusiastic

Very Satisfied

Satisfied Unsatisfied Very Unsatisfied

2013/14 33% 65% 1% 0%

2012/13 24% 70% 5% 0%

Constructing a Value metric

Value: “what delights customers and makes employees proud of what they do” Investment$* process* products /

services

customers* customers*joint activity

invest*

co-invest*

employees* sales$profit$

relationship*

Key intangibles: business processes, skills of employees, relationships with customers (Sveiby 1997; Managing and Measuring Knowledge-based Assets)

Comparing to other data metricsHoughton (2011): three public sector data publishing cases, give away data, increases use (+9*), and reduces cost

Houghton (2014): three research data centres; cover impact on data publishers and users; quantitative and qualitative approaches; investment, use value, willingness to pay, efficiency estimates (time) based on use

Productivity Commission (2007) 900pp; effectiveness (outcomes vs goals), efficiency (how well inputs used), inc. quality, risk, social, environmental and uncertainty - net community benefits of public support; RQF -> ERA: HERDC“A major perceived current deficiency in performance evaluation and measurement is the lack of

comprehensive retrospective information about the quality and impact of higher education research” p.336

Recommendation: Value V1 => S1 * C1 * E1

(S1) Stakeholder Satisfaction

(C2) Co-investment / Investment ($/FTEs)

(E1) Employee Satisfaction

Quality Quantity Quality

Recommendation: Value of Intangible Benefits and Inputs (V1)

How V1 might work? InstnInstitution: Chooses researchers for value assessment:

Top 25 high impact researchers

[1%, 5%, 10%] CHOOSE of other researchers (at random)

Annual review - vary high impact researchers over five year cycle

How V1 might work? RschrResearcher: posts a five minute video testimonial describing their research work, data shared and outputs created; self-assess their impact: high/med/low.IMPACT on POLICY, RESEARCH, INDUSTRY, COMMUNITY.

Researcher approaches top five most impacted stakeholders to respond to testimonial.

Researcher: advertises request for stakeholder feedback through network channels, email, online groups, collaborators - can be anonymous [one mth]

Feedback collected as short survey responses and testimonials. Including audio or video responses. Can be anonymous to researcher but collect identifying information for auditing eg email, twitter

For Researcher Assessing Value: 1.How satisfied are you with Dr. X research? research data? research agenda? Very Un-satisfied | Un-satisfied | Neutral | Satisfied | Very Satisfied

2.Are you an Internal / External Stakeholder? ___________

3. How much PAID / UNPAID time did you work with or use the data outputs of Dr. X? _____hrs unpaid/_____hrs paid

4.Other comments: ____________________________________________________________________

How V1 might work? Rschr

Applying V1 to the NationV1: value of research data

Stakeholder Satisfaction S1

Coinvestment / Investment C1

Employee Satisfaction E1

The Nation(Sum of Institutions)

Users of research data - see Unis

Int’l and unfunded effort / R&D budget

Sum of Unis/other research, plus Dept

Universities/other(Sum of Rschrs)

Users of research data, both local and international

Unfunded and partner effort / Labour, Grants, O/H

As per Uni surveys

Researchers External colleagues Unfunded labour and external colleagues / grants + salary

Internal colleagues, PhDs, other staff

Aggregating Value to NationApproach 1: Value Accounting: Consolidation of reporting entities

- Annual Reporting; Value Metrics [Value Census]; no sampling- National Consolidation

Approach 2: Sample Reporting: Quarterly Survey of Users of Research Data- What value created? Case Study Approach [Sample Approach]- Attitude to Research Data - V.Sat, Sat. Dis-Sat. V. Dis-Sat

Approach 3: Live Reporting. Livestream of data. eg Sentiment Analysis, Impact Story. Customer Stories. Employee updates. Constant customer feedback.

Conclusions

Many issues: Who are research customers (sampling), cost of measurement, credible / defensible / understandable measures

Recommend: Employee and Customer satisfaction - measureRecommend: Customer co-investment / Investment - measure (form of ROI)

Multiple value targets to measure - Universities, Researchers, The Nation

But: just a beginning of the Value story… Contact: @valuemgmt PhD: http://dx.doi.org/10.6084/m9.figshare.680002