Reporting Data in the Social Media World Panel Title: Practical Applications for Social Media in...

AAPOR 69th Annual Conference5/16/2014

Casey Langer TesfayeAmerican Institute of Physics

Reporting Data in the Social Media World

Panel Title: Practical Applications for Social Media in Survey Research


2

Problem

•It has always been difficult to control the trajectory of published data

•Can we leverage social media to increase Awareness of trajectory? Accessibility of findings? Accuracy of interpretations?


3

Proposed solution- topical case study

•Twitter search stream Women + physics September + October 2013

At the Solvay Conference on Physics in 1927, the only woman in attendance was Marie Curie (bottom row, third from left).Source: http://ontd-political.livejournal.com/10806258.html#ixzz30UyWOvOz

http://ontd-political.livejournal.com/10806258.html#ixzz30UyWOvOz


4


5



•Find references to survey data Look for patterns


6



•Find references to survey data Look for patterns

•Goal: practical, data-driven recommendations


7 Corey S. Powell ?@coreyspowell Oct 10Men and women really do communicate differently...according to an analysis of old Enron emails. https://medium.com/the-physics-arxiv-blog/e7dbd9d6a518 … View summary Reply Retweet Favorite More Olivier DA COSTA ?@olivierdacosta Oct 10Why Are There Still So Few Women in Science? ¦ NYT - Meg Urry, professor of physics and astronomy at Yale http://nyti.ms/18ROWK9 View summary Reply Retweet Favorite More Physics ?@Physics360 Oct 10Women: Life Sciences v. the Lifeless Sciences: My current Taki's article reflects upon an impassioned New York... http://bit.ly/19jPruC Expand Reply Retweet Favorite More James Holloway ?@grasshapa Oct 9“Data Mining Reveals the Emotional Differences in Emails Written by Men and Women” by @arxivblog https://medium.com/the-physics-arxiv-blog/e7dbd9d6a518 … View summary Reply Retweet Favorite More Matthew Feickert ?@HEPfeickert Oct 9For those applying to grad school in physics, you should seriously consider a department's Female Friendliness. | http://www.aps.org/programs/women/female-friendly/index.cfm …Expand Reply Retweet Favorite More


8

Working with Twitter data

•Twitter data needs a framework or structure•Generalizing conclusions is tricky territory

Completeness Representativeness

•BUT there is much to be learned


9

Data Structure

•First goal: transform the data into a usable form

Text 1 url 1 Text 2 url 2 Text 3


10

Some basic numbers

•Dataset had 1894 lines, which collapsed down to 251 tweets

66 no url 185 with url


11

Groom the data

•Isolate relevant tweets Some don’t reference survey data or relevant

articles


12

Grooming text data is challenging

•I only want references to pieces that report survey data

but how?


13

Some Tweets are easy to remove


14

Some are harder to judge


15

Automating is the way to go

•In a larger scale data set, manual investigations are impossible

Start with a sample, develop a strategy, hone and measure its effectiveness


16

Structure the data

survey data

Original source link auto text

Auto link handle Tweet text date

1 0

http://www.nytimes.com/2013/10/06/magazine/why-are-there-still-so-few-women-in-science.html

Why Are There Still So Few Women in Science?

http://nyti.ms/18ROWK9

@SandraAusmaPEng

Only 20% of physics PhDs are awarded to women. And only 14% of US physics professors are women. #STEM #persevere 10/14


17

Some metrics

•40% of the tweets containing links led to survey data (n=74)

Only 6 of those tweets linked to original sources


18

Looking for a starting point

•How to group Tweets or sources that belong together?


19

Link duplication

•Many different ways to look at links Link in Tweet (lowest # of dupes) Full link of referred url Autolink from url


20

Link duplication

•By Autotext: 52 of 74 Tweets were in duplicate sets


21

Largest set: 25 Tweets


22

NY Times article

•Date range of Tweets October 3-20

Oct 3 Oct 5 Oct 7 Oct 9 Oct 13 Oct 15 Oct 200

1

2

3

4

5

6

7


23

The Viral Myth and Justin Bieber Effect

Source: http://www.technologyreview.com/view/512271/researchers-peek-at-the-structure-of-the-viral-internet/Original paper: http://research.microsoft.com/pubs/176494/diffusion.pdf

http://www.technologyreview.com/view/512271/researchers-peek-at-the-structure-of-the-viral-internet/

http://www.technologyreview.com/view/512271/researchers-peek-at-the-structure-of-the-viral-internet/

http://research.microsoft.com/pubs/176494/diffusion.pdf

http://research.microsoft.com/pubs/176494/diffusion.pdf


24

Second largest set: 13 Tweets


25

Let’s Talk about Autotext


26

Why Are There Still So Few Women in Science?Long but interesting. Why there are fewer women in Physics.Why are their so few women in science (and especially physics)? An amazing longform piece by Eileen Pollack.Physics grad ponders, "Why so few #womeninscience?"Women and science still don't mix, and this former physics student wants to know whyAt the Solvay Conference on Physics in 1927, the only woman in attendance was Marie Curie.Before @EileenPollack had an MFA & led workshops in Tent: Creative Writing, she studied physics. #womeninscienceTho useful, this piece tells only part of the story. RT @AliciaMorga My high school didn't even have a physics classFormer top physics pupil at Yale seeks out former classmates and professors to figure out why there are still so...Fascinating read on why, for ex, only 1/5 of Physics PhDs go to women "@nytimes: Why are so few women in science?As one of *very* few women in the physics program @UTAustin in the mid-80s, this hits 2 close 2 home.Excellent review by the NYT of the physics world for women... Challenges we have all faced with stereotypesMy HS biology, chemistry & physics teachers were women. Unusual and fortunate for me. #stem #edu11 girls out of 85 in my college physics class. Trying hard to recruit moreWe need content rich teachers, but no mention of as a career for Yale Physics majors? #WhatitTakes #EducationNationWomen in science: one-fifth of physics PhD's in the US are awarded to women and only half of those are Americans.Interesting read. Why are there still so few women in science? More women in medical research than physics, luckily.Only 14% of US physics professors are #women. Is a change in culture the key to parity?My @Penn physics PhD class was 50% female. #goupenn Why Are There Still So Few Women in Science?Why Are There Still So Few Women in Science?If only one person had said, "You can do this."Only 20% of physics PhDs are awarded to women. And only 14% of US physics professors are women. #STEM #persevereMostly, though, I didn’t go on in physics because not a single professor encouraged me to go to graduate school.Female Physics Professor @Yale discusses the barriers for women in scienceWell that's alarming: "Of all the physics professors in the United States, only 14 percent are women."


27

Tweets come from a variety of sources

•Text comes from: Autotext Title photo caption article content from the user themselves


28

Tweets use a variety of strategies

•Strategies include Summarizing the story Personalizing the story Pulling out key points Commentary about the article


29

Women and science still don't mix, and this former physics student wants to know why

Women and science still don't mix, and this former physics student wants to know why: It's been more tha...


Women and science still don't mix, and this former physics student wants to know why - It’s been more than...


Women and science still don't mix much & this former physics student wants to know why -



Women and science still don't mix, and this former physics student wants to know why | The Verge

Yahoo News Tech : Women and science still don't mix, and this former physics student wants to know why

Women and science still don't mix, and this former physics student wants to ... - The Verge




30

And yet only one Tweet used the autolink:

http://cur.lv/3vzwlhttp://bit.ly/16l2E82http://flip.it/p3hy9http://tmblr.co/Ze3LpvwhZlC4http://vrge.co/GBeUYbhttp://www.theverge.com/2013/10/3/4798754/why-more-women-dont-work-in-scienceshttp://dlvr.it/44ZZqzhttp://bit.ly/1758iI2http://www.theverge.com/2013/10/3/4798754/why-more-women-dont-work-in-scienceshttp://dlvr.it/44ZFq4http://dlvr.it/44ydyHhttp://dlvr.it/44ydwnhttp://bit.ly/19nUqyh


31

None of the autotext included stats


32#USA: #Women earn 60% of B.A.'s - but only 20% in computer #science, 20% in physics & 18% in engineering@Physicsupdate20: All-Male Physics Departments Are Not Proof of Bias Against Hiring Women11 girls out of 85 in my college physics class. Trying hard to recruit moreAll-Male Physics Departments Are Not Proof of Bias Against Hiring Women ... - Lab Manager Laboratory NewsAll-male physics departments are not proof of bias against hiring women, analysis findsAs one of *very* few women in the physics program @UTAustin in the mid-80s, this hits 2 close 2 home.At the Solvay Conference on Physics in 1927, the only woman in attendance was Marie Curie. Fascinating read on why, for ex, only 1/5 of Physics PhDs go to women "@nytimes: Why are so few women in science?Girls in communities with women in #STEM are more likely to take Physics —a key indicator of interest in engineeringGirls who grow up in communities with many women working in #STEM fields are more likely to take Physics classes:In communities with large numbers of women employed in #STEM, more females take high school #physics.Interesting read. Why are there still so few women in science? More women in medical research than physics, luckily.MT @ASCETweets: Girls in cities w/ women in #STEM more likely to take Physics—an indicator of engineering interestMT @SkanskaUSA @ASCETweets Girls in communities w/ women in #STEM are more likely to take Physics.MT @skanskausa: MT @ASCETweets Girls in communities w /#STEM women more likely 2take Physics- interest in engineeringMy @Penn physics PhD class was 50% female. #goupenn Why Are There Still So Few Women in Science?My HS biology, chemistry & physics teachers were women. Unusual and fortunate for me. #stem #eduMy retweets by gender: 40% women, 60% men. #tweeqOnly 14% of US physics professors are #women. Is a change in culture the key to parity?Only 20% of physics PhDs are awarded to women. And only 14% of US physics professors are women. #STEM #perseverePer the chart with this article, only physics has fewer female PhDs than philosophy :RT @ASCETweets Girls in communities w/ women in #STEM are more likely to take Physics — interest in engineeringRT @ThePublicSquare: Why women earn only 39% of chemistry, 34% of economics and 20% of physics PhDs.The American Physics Society released ranking of 145 most female-friendly depts.Tho useful, this piece tells only part of the story. RT @AliciaMorga My high school didn't even have a physics classWell that's alarming: "Of all the physics professors in the United States, only 14 percent are women."Why Don't Girls Grok Physics?: I am from India and went to a high school where 60 percent of the girls ...Women earn 60% of bach deg but 20% of comp sci deg, 20% of physics deg, 18% percent of eng degWomen in science: one-fifth of physics PhD's in the US are awarded to women and only half of those are Americans.Women who study science less likely than men to end up working in physics, maths & eng but much more likely to teach


33

Accuracy

•Easy to spot large scale misinterpretations

•But how to catch small? What do misinterpretations look like?

Case study? Corpus? Comment streams or a variety of searches can

provide more data


34

People of Twitter

•Tweeters are independent content curators We can’t control what they say or how they

say it or even necessarily be aware of all of it•But maybe we can afford the kind of talk we want


35

In summary

•Twitter behavior patterned, but far less streamlined than we might have assumed


36

In summary

•What are the key metrics?* Timeline of Tweets Twitter handles (counts, networks)

Source of text


37

Some guidelines•Consider your goals:

To be credited with analysis To spread correct information

•Make sharing easy Link to specific article, not a dynamic page

stream Prime headlines, captions, autotext, and links

for sharing•Be aware of key players


38

Potential areas for future work

Monitor Tweets over time Set up API & web crawler Generate and check custom metrics (e.g.

dashboard)•Store whole articles and compare text to Tweet

Isolate & compare citations of stats?


39

Potential areas for future work

•Network structure of dissemination for stories Find key nodes in your network


40

Questions? Comments? Suggestions?

•Email me: Casey Langer Tesfaye: [email protected]


41

Extra slides start hereReally? There’s more?I’m not amused.


42

Questions

•Can we know our networks?•What kinds of searches can or should we monitor and how?•How can we set up our research results in the most shareable way?


43

Talk abstract

•In the Fall of 2013 the persistently low proportion of women in physics became a hot topic of discussion. This discussion was in part fueled by a series of reports that grew additional lives once they were published, echoing among individual blog posts, news sites such as the Huffington Post and the New York Times, and reverberating into scientific magazines. The published pieces generated countless comments and tweets among readers and interested parties. What follows is an analysis of the interpretations, misinterpretations and trajectories of published findings, anchored in the “women physics” keyword search on Twitter. This goal of this analysis is to generate helpful, data-driven guidelines for researchers who are now forced into a social media space and hoping to stem misinformation and misreports of their results.


44


45

Research Questions

•Research questions can evolve from the data Timeline of dissemination Network of dissemination Use of autotext Original sources? Correct interpretations?


46

Sharelines


47

Network analysis?•Only one account tweeted links to survey data more than once


48

Read this:

•http://computationalculture.net/article/the-algorithmization-of-the-hyperlink

http://computationalculture.net/article/the-algorithmization-of-the-hyperlink



Date post:	25-Feb-2016
Category:	Documents
Upload:	paxton
View:	40 times
Download:	0 times

Reporting Data in the Social Media World Panel Title: Practical Applications for Social Media in...

Documents