+ All Categories
Home > Documents > Insight demo 2 16-15

Insight demo 2 16-15

Date post: 19-Jul-2015
Category:
Upload: cariden
View: 225 times
Download: 1 times
Share this document with a friend
21
more matildas katherine yoshida
Transcript
Page 1: Insight demo 2 16-15

more matildaskatherine yoshida

Page 2: Insight demo 2 16-15

Central Characters in Children’s Books

Gender in 20th century children’s books (McCabe et al., 2011)

Page 3: Insight demo 2 16-15
Page 5: Insight demo 2 16-15

User Query

Term Ranking

Gender Ranking

Overall Ranking

Page 6: Insight demo 2 16-15

Term Ranking

Gender Ranking

Overall Ranking

Tokenize & remove irrelevant information

Lowercase, lemmatize, stopword removal

Terms database

User Query

Page 7: Insight demo 2 16-15

User Query

Term Ranking

Gender Ranking

Overall Ranking

Genderize proper names

Count pronounse.g., her, his, she, he

Social Security DB of names

Naive Bayes classifier

F (PNs + pronouns) - M (PNs + pronouns)

length of description

Page 8: Insight demo 2 16-15

Katherine Yoshida

▷ PhD in cognitive science (UBC)▷ UX research & consulting

Page 9: Insight demo 2 16-15

thank you!

Page 10: Insight demo 2 16-15

Stack

MySQLPython• NLTK

AWS

Page 11: Insight demo 2 16-15

Gendered pronounsfemale +1: she, her, hers

male +1: he, his, him

Naive Bayes classifier

Proper namesNLTK entities bigram parser (‘people’)

Social Security database of names

Naive Bayes classifier for other names

Page 12: Insight demo 2 16-15

Social security database: Vast majority of proper names

Three features:

● Last letter of name● Last two letters of name● Is last letter a vowel (aeiouy)

Trained on 80% of names from Social Security names database

Validated on 20% holdout sample

Accuracy = 80%

Naive Bayes classifier

Page 13: Insight demo 2 16-15

Average Gender Counts

Female Male

Pronouns 4.7 5.1

Proper Names 2.8 4.6

Total 7.5 9.7

Page 14: Insight demo 2 16-15

Frequency x Female proportion

Page 15: Insight demo 2 16-15
Page 16: Insight demo 2 16-15
Page 17: Insight demo 2 16-15
Page 18: Insight demo 2 16-15
Page 19: Insight demo 2 16-15
Page 20: Insight demo 2 16-15
Page 21: Insight demo 2 16-15

Recommended