time for events telling the world’s stories from social media
Mor Naaman Rutgers SC&I & Mahaya, Inc.
@informor
revolution take II
a new archive
needs new methods
social"media"information"lab
our work qu
alita
tive
quan
titat
ive
syst
ems
motivations,!practices
large scale quant, data mining
tools, services, !and prototypes
people, together
radiohead
byobw
pepper spray
tahrir
outside lands festival
organize the world’s memories
objectives de
tect
iden
tify
orga
nize
objectives de
tect
ICWSM 2011a JASIST 2011 WebDB 2009 SIGIR 2007
objectives
iden
tify
WSDM 2012 ICWSM 2011b WSDM 2010
objectives
orga
nize
ICMR 2012 CHI 2012
CSCW 2012 MTAP 2012 VAST 2010
WWW 2009
today de
tect
iden
tify
orga
nize
Vox!SRSR!Multiplayer
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
[with postdoctoral fellow Nick Diakopoulos]
research questions how can (Twitter) content contributed around large-scale broadcast news events inform journalistic inquiry? what kinds of insights and analyses are enabled through visual analytic tools?
designing for journalism divergent points of view newsworthiness: surprising, unusual, extremes of positive / negative
supporting analysis direct attention to relevant information automatic content analysis for filtering – relevance – uniqueness / novelty – sentiment – keyword extraction
how to evaluate? directly evaluate the output of the algorithms (quantitative) deep, extensive evaluation of users’ interaction with the system (qualitative)
read more: Olsen (UIST ’07) Naaman (MTAP ’12)
Vox evaluation goals • How effective for generating story ideas? • What kind of insights/analysis are supported? • Shortcomings and how features are used?
Vox evaluation: framing • “develop two story pitches for the event” • open-ended questionnaires, content analysis • 18 participants
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
VAST 2010
research question how can we help a journalists identify reliable, knowledgeable sources for remote breaking news events?
[with postdoctoral fellows Nick Diakopoulos, Mummun De Choudhury]
supporting analysis eyewitness detection network embeddedness user “type” classifier location embeddedness …
evaluation “technological inquiry” with working journalists not: “how our tools worked” yes: “how fits into journalistic needs, practices”
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
VAST 2010
CHI 2012 CSCW 2012
what the hell?
[with: Lyndon Kennedy, Dan Ellis, Kai Su]
supporting analysis extract the signal from people’s attention: find overlapping moments compute and rank scenes extract scene descriptors
audio fingerprinting
Wang et al. (ISMIR ’03)
a story of two clips
a story of two clips
0:00
0:00 3:14
2:32
a story of two clips
0:00
0:00 0:18
2:32
3:32
a story of n clips
time
clips => scenes
time Happy Birthday, Birthday
Higher Ground Encore
evaluation deployment scenario/task:
Decide whether to attend a show
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
VAST 2010
CHI 2012 CSCW 2012
NM&S 2012 ICMR 2012 MTAP 2012
WWW 2009
towards better models of large-scale human attention
experience
Her story allows us to see what was lost, [and] gained, in the political, economic and social transformations of the 18th and 19th centuries.
a new archive
PUZPNO[Z°H[)**°ZJHSL
YouTubL-SPJkr
WorK7YLssTwP[[Lr
Hypotheses and
research questions
Researcher°L_WSVYLZ°KH[HEXPLORE
*VKLK°Ka[H°MVY°HUHS`ZPZ
9LZLHYJOLY°YLX\LZ[Z�HUUV[H[PVUZANALYZE
3HYNL�ZJHSL�Kata
9LZLHYJOLY°KLMPULZ°PU[LYLZ[COLLECT
SOCRATES fut
ure
work
CityBeat
PUZPNO[Z°H[)**°ZJHSL
YouTubL-SPJkr
WorK7YLssTwP[[Lr
Hypotheses and
research questions
Researcher°L_WSVYLZ°KH[HEXPLORE
*VKLK°Ka[H°MVY°HUHS`ZPZ
9LZLHYJOLY°YLX\LZ[Z�HUUV[H[PVUZANALYZE
3HYNL�ZJHSL�Kata
9LZLHYJOLY°KLMPULZ°PU[LYLZ[COLLECT
SOCRATES
CityBeat
Everywhere where there is an interaction between a place, a time, and an expenditure of energy, there is rhythm. - Henri Lefebvre
Luis Gravano Hila Becker Nick Diakopoulos Kai Su Dan Ellis Munmun de Choudhury Tarikh Korula …
thanks