VAST ChallengeVAST Challenge

John StaskoJohn Stasko

Information Interfaces Research GroupInformation Interfaces Research Group

School of Interactive ComputingSchool of Interactive Computing

Georgia Institute of TechnologyGeorgia Institute of Technology

December 9, 2010December 9, 2010

FODAVA ‘10 Annual Meeting

HistoryHistory

• Began in 2006 as VAST ContestBegan in 2006 as VAST Contest– Changed to “Challenge” in 2008Changed to “Challenge” in 2008

• ““Contest” had one main Contest” had one main problem/data setproblem/data set

• ““Challenge” has 3 mini-problems Challenge” has 3 mini-problems and one grand challengeand one grand challenge

2

Problem NatureProblem Nature

• Synthetic dataset of some typeSynthetic dataset of some type

• Embedded “ground truth” (solution)Embedded “ground truth” (solution)

• Sources/CreatorsSources/Creators– ThreatStream Generator project at ThreatStream Generator project at

PNNLPNNL

– G. Grinstein at U Mass-LowellG. Grinstein at U Mass-Lowell

3

2010 Challenge2010 Challenge

4

http://hcil.cs.umd.edu/localphp/hcil/vast10/index.php

Mini Challenge 1Mini Challenge 1

5

103 intelligence reports,emails, phone calls, etc.

Arms dealers in Pakistan,Yemen, and other locales

Goal: Describe the keyplayers, events, …

(2007 Contest had 1500+ articles)

Mini Challenge 1 TasksMini Challenge 1 Tasks

6

Mini Challenge 2Mini Challenge 2

7

Hospital admittances

Fatalities

Hospital records – Patientadmittance dates and symptoms, accompanied byfatalities

15 different world locationsZipped datafile is 157 MB(much larger than usual)

Goal: Characterize thepandemic

Mini Challenge 2 TasksMini Challenge 2 Tasks

8

Mini Challenge 3Mini Challenge 3

9

Genetic sequences ofpeople from outbreakalong with diseasecharacteristics

Goal: Find the keyindividuals, where didit start, characterizethe genetic mutations

Mini Challenge 3 TasksMini Challenge 3 Tasks

10

RequirementsRequirements

• You prepareYou prepare– A solution descriptionA solution description

– A video showing how you arrived at A video showing how you arrived at your solutionyour solution

– (Optional) 2-page double-column (Optional) 2-page double-column summary articlesummary article

11

Sample SolutionSample Solution

12

VideoVideo

13

Tip: Use Camtasia

VisWeek WorkshopVisWeek Workshop

14

One day workshopat VisWeek

All teams whosubmitted an entryare invited

Discuss approachesand solutions, dodemos

RepositoryRepository

15

Includes all previous datasets,past entries, solutions

Can just use olddatasets to testyour new systems

Past Datasets/ProblemsPast Datasets/Problems

16

BenefitsBenefits

• Very good datasets to test your Very good datasets to test your algorithms, visualizations, and algorithms, visualizations, and systemssystems

• Having “ground truth” is a benefit in Having “ground truth” is a benefit in many waysmany ways– Though not always realisticThough not always realistic

• Existence of tasks and objectives is Existence of tasks and objectives is a plusa plus

17

BenefitsBenefits

18

Awards & publicity

2007

2010

BenefitsBenefits

19

Publications

Some DetailsSome Details

• New problems come out around New problems come out around Feb/MarFeb/Mar

• Due in JuneDue in June

• Some transitions in organizing teamSome transitions in organizing team– Future is not certainFuture is not certain

20