+ All Categories
Home > Documents > What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a...

What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a...

Date post: 27-Mar-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
42
What Do We Talk About When We Talk About Dashboards? Alper Sarikaya, Michael Correll, Lyn Bartram, Melanie Tory, and Danyel Fisher IEEE InfoVis 2018 http://bit.ly/dashboardconspiracy
Transcript
Page 1: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

What Do We Talk About When We Talk About

Dashboards?

Alper Sarikaya, Michael Correll, Lyn Bartram, Melanie Tory, and Danyel Fisher

IEEE InfoVis 2018

http://bit.ly/dashboardconspiracy

Page 2: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Dashboards arepeoples’ primary access to data-driven thinking

Page 3: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

We ignore dashboardsas a research community

DB007

DB123 DB024 DB121

DB006

DB043

Page 4: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Key Performance Indicators (KPIs)DB001

DB056

Page 5: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

DB021 DB102

Page 6: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

DB117

Page 7: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Non-interactivity (definitely not VA-like)

Extremely simplevisuals

Non-expressivevisual language

How do challengeswith dashboards

extend visualizationresearch?

Page 8: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Non-interactivity (definitely not VA-like)

Extremely simplevisuals

How do challengeswith dashboards

extend visualizationresearch?

Non-expressivevisual language

Page 9: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Non-interactivity (definitely not VA-like)

Extremely simplevisuals

How do challengeswith dashboards

extend visualizationresearch?

Non-expressivevisual language

Page 10: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Non-interactivity (definitely not VA-like)

Extremely simplevisuals

How do challengeswith dashboards

extend visualizationresearch?

Non-expressivevisual language

Page 11: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Two-prong approach

Multi-domain literature review(how do other fields view dashboards?)

Survey of Examples(how are dashboards designed?)

Page 12: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Lessons from the Field

What does the literature say about dashboard use in practice?

Page 13: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

diversity

Smart Cities

HealthcareEducation

Personal Analytics

Business Intelligence

Social Orgs

Page 14: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Familiar Challenges

End-user flexibility

Difficult to target dashboards for a diverse range of analysis tasks, goals, and users

Could include: view configuration, what-if analysis, data choice, automatic insights, storytelling & animation…

Visual, analytic, and data literacy

“...most users do not have the time or motivation to learn new software applications. The golden rule is to simplify, simplify, simplify!”

How do we educate users to use new interactions and designs?

Page 15: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Familiar Challenges

End-user flexibility

Difficult to target dashboards for a diverse range of analysis tasks, goals, and users

Could include: view configuration, what-if analysis, data choice, automatic insights, storytelling & animation…

Visual, analytic, and data literacy/fluency

“...most users do not have the time or motivation to learn new software applications. The golden rule is to simplify, simplify, simplify!”

How do we educate users to use new interactions and designs?

Page 16: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

New challenges —Beyond the dashboard itself

Data is part of the design

Social impact

Accountability, provenance, and trust

Page 17: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

“visual expression of the KPI mindset” [Angrave et al.]

[J. Tucker. How is your school doing?, www.sfgate.com]

Page 18: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Social Impact and Framing

Drug and alcohol related crime in Atlanta [O’Connell et al., 2016]

Page 19: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Exploratory Survey of Dashboard Examples

Page 20: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Exploratory Survey of Dashboard Examples

Page 21: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if
Page 22: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Reconcilation (final table?)

Example reconciliation?

Coded examplesReconcile categories

Resolve differences

Code DB001

Strategic Y

Tactical Y

Operational N

Learning N

Audience Org

Vis Literacy +

Requires Domain Knowledge N

Has Construction Aspects N

Has Interactive UI N

Can Modify Data/World N

Alerting+Notification N

Benchmarks Y

Multipage N

Streaming Y

Updatable Y

Highlighting Y

Page 23: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Categories and Features to Distinguish Dashboards

Page 24: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Decision Support (+ Learning)

DB064

Strategichigh-level trends; long temporal lag

TacticalMore actionable detailMedium temporal lag

Page 25: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Decision Support (+ Learning)

StorytellingNarrative structureBuilding context

DB012

Page 26: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if
Page 27: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Clusters of Dashboard Designs

Page 28: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Clusters of Dashboard Designs

Page 29: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Clusters of Dashboard Designs

Page 30: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Clusters of Dashboard Designs

• Decision-Making

• Awareness

• Motivation and Learning

• Dashboards Evolved

Page 31: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Cluster: Decision-Making

DetailsAugments domain

knowledge of viewer

BenchmarksDrives priorityof actionability

DB036

InteractivityAllows viewer to“ask questions”

Page 32: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Cluster: Awareness

DB020

Designed for AwarenessAll data presented!

Limited interactivityViewer must understand chart intentions(very abstract)

Page 33: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Cluster: Motivation and Learning

DB117

AnnotationsExplanation of analysis context

Data with no benchmarksAllows viewers to drawtheir own conclusions

Page 34: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Cluster: Dashboards Evolved

DB007

Designed to tell a storyMulti-page with narrative structure

Visuals augment insights

Page 35: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Challenges for Vis Research and Practice

Page 36: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Challenges for Vis Research and PracticeMechanisms to support a diverse range of literacy —supporting experts but scaffolding and guiding novices

DB041

Page 37: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Challenges for Vis Research and PracticeLook beyond the dashboard – study the social context and impact of dashboard use in the world

DB122

Page 38: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Challenges for Vis Research and PracticeExtend the data and representational vocabulary —not all concepts can be reduced to KPIs and visual variables

DB101

Page 39: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Many more tidbits in our paper!

Page 40: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Dashboards are a great way to get access to users across many disciplines and interests(and potentially motivated users! [e.g. sports])

DB045

Page 41: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

What We Know Is Wrong

Dashboards are more than a collection of visualizations

Consider the “dashboard form” as a holistic piece in data understanding

It’s time to start supporting “individual differences”

Page 42: What Do We Talk About When We Talk About Dashboards? · Difficult to target dashboards for a diverse range of analysis tasks, goals, and users Could include: view configuration, what-if

Thank you!

Alper Sarikaya, Michael Correll, Lyn Bartram, Melanie Tory, Danyel Fisher

Paper and Materials http://bit.ly/dashboardconspiracy


Recommended