Looking For Steam Players - Insight Project

Post on 15-Aug-2015

41 views 1 download

Tags:

transcript

Now Looking for Playersโ€ฆ By: Margery (Midge) Hines

Now Looking for Playersโ€ฆ By: Margery (Midge) Hines

Now Looking for Playersโ€ฆ By: Margery (Midge) Hines

Now Looking for Playersโ€ฆ By: Margery (Midge) Hines

Measuring Similarity

๐‘ข๐‘ ๐‘’๐‘Ÿ๐‘ 

๐‘”๐‘Ž๐‘š๐‘’๐‘ 

๐‘ข1 ๐‘ข2 ๐‘ข3 ๐‘ข4 โ€ฆ

๐‘ข1

๐‘ข2

๐‘ข3

๐‘ข4

โ‹ฎ

1

๐‘š32

๐‘š42

๐‘š12

๐‘š21

๐‘š41

1

1

๐‘š23

1

๐‘š31

๐‘š13 ๐‘š14

๐‘š42 ๐‘š43

๐‘š34

Rank to find top user matches!

๐‘ข1 ๐‘ข2 ๐‘ข3 ๐‘ข4 โ€ฆ

๐‘”1

๐‘”2

๐‘”3

๐‘”4

โ‹ฎ

๐‘11

๐‘32

๐‘42

๐‘12

๐‘21

๐‘41

?

?

?

?

?

?

?

?

๐‘23

๐‘42

๐‘ข1 ๐‘ข2 ๐‘ข3 ๐‘ข4 โ€ฆ

๐‘”1

๐‘”2

๐‘”3

๐‘”4

โ‹ฎ

๐‘Ÿ11

๐‘Ÿ32

๐‘Ÿ 42

๐‘Ÿ12

๐‘Ÿ21

๐‘Ÿ 41

?

?

?

?

?

?

?

?

๐‘Ÿ23

๐‘Ÿ 42

Compute Cosine

Similarity

Compute Cosine

Similarity

ValidationUser Similarity

Distribution Profile Types

Obscure Gamers

AAA Gamers

Broad Gamers

ValidationUser Similarity

Distribution Profile Types

Obscure Gamers

AAA Gamers

Broad Gamers

ValidationUser Similarity

Distribution Profile Types

Obscure Gamers

AAA Gamers

Broad Gamers

Margery (Midge) Hines

PhD Electrical Engineering from Northeastern University

Dissertation: Autonomous landmine detection using GPR for humanitarian demining

Extra Slides

Improved Matching System: User Playtime Scores

โ€ข Score each userโ€™s game by relative playtime compared to the set of people who own that game using deciles

Improved Matching System: Results

โ€ข On average all similarity scores are lowerโ€ข Random Pairing < Friend Pairing < Algorithm Pairing

Similarity Matrix

Future ImprovementsAdditional User Matching Features โ€ข Number and/or type of steam achievements for each game

โ€ข Match based on features using SVD after filtering database for specific game of choiceโ€ข Before matching filter by location (low ping, time-zones)Site Enhancementโ€ข Include video game recommendations โ€ข Add Steam open-id support

Play Style

SkillLevel

Similarity Metric Visualization๐‘ข๐‘ ๐‘’๐‘Ÿ๐‘ 

๐ด ยฟ๐‘‚๐‘Ÿ๐‘–๐‘”๐‘–๐‘›๐‘Ž๐‘™๐‘†๐‘–๐‘š๐‘–๐‘™๐‘Ž๐‘Ÿ๐‘–๐‘ก๐‘ฆ ๐‘€๐‘Ž๐‘ก๐‘Ÿ๐‘–๐‘ฅ ๐ต ยฟ ๐ด h๐‘ค๐‘–๐‘ก ๐‘†๐‘œ๐‘Ÿ๐‘ก๐‘’๐‘‘๐‘…๐‘œ๐‘ค๐‘  ๐ถ ยฟ๐ต h๐‘ค๐‘–๐‘ก ๐‘…๐‘œ๐‘ค๐‘ ๐‘…๐‘Ž๐‘›๐‘˜๐‘’๐‘‘

0 1

Note: The strong similarity in the diagonal of A and first column of B and C is due to users match with themselves

Alternative Method for Feature Matching: SVD ๐‘ข1 ๐‘ข2 ๐‘ข3 ๐‘ข4 โ€ฆ

๐‘”1

๐‘”2

๐‘”3

๐‘”4

โ‹ฎ

๐‘ 11

๐‘ 32

๐‘ 42

๐‘ 12

๐‘ 21

๐‘ 41

?

?

?

?

?

?

?

?

๐‘ 23

๐‘ 42

Compute SVD

๐‘“ 1 ๐‘“ 2 โ€ฆ

๐‘ข1

๐‘ข2

๐‘ข3

๐‘ข4

โ‹ฎ

๐‘ข11

๐‘ข32

๐‘ข12

๐‘ข21

๐‘ข41

๐‘ข31

๐‘ข22

๐‘ข42

๐‘ข13

๐‘ข33

๐‘ข43

๐‘ข23

๐‘“ 1 ๐‘“ 2 โ€ฆ

๐‘“ 1

๐‘“ 2

โ‹ฎ

๐‘ค11

0

0

0

0

0

0

๐‘”1 ๐‘”2 ๐‘”3 โ€ฆ

๐‘“ 1

๐‘“ 2

โ‹ฎ

๐‘”11

๐‘”32

๐‘”12

๐‘”21

๐‘”31

๐‘”22

๐‘”13

๐‘”33

๐‘”23

๐‘ข1 ๐‘ข2 ๐‘ข3 ๐‘ข4 โ€ฆ

๐‘ข1

๐‘ข2

๐‘ข3

๐‘ข4

โ‹ฎ

1

๐‘š32

๐‘š42

๐‘š12

๐‘š21

๐‘š41

1

1

๐‘š23

1

๐‘š31

๐‘š13 ๐‘š14

๐‘š42 ๐‘š43

๐‘š34

Match Userโ€™s

Features

๐‘ค22

๐‘ค33

Validation

So why not SVD?

โ€ข Feature matching doesnโ€™t guarantee that matched users will own or play the same games

๐‘ข๐‘– (๐‘ƒ ๐‘—)=ยฟ๐‘œ๐‘“ h๐‘Ÿ๐‘ ๐‘œ๐‘›๐‘” ๐‘—

๐‘ก๐‘œ๐‘ก๐‘Ž๐‘™ยฟ๐‘œ๐‘“ h๐‘Ÿ๐‘  ยฟ

Userโ€™s Game Preference

Distribution of Userโ€™s Maximum Game Preferences

Some users spend all playtime on

Steam on Dota 2

Few users spend all playtime on Steam

on Portal

User 1: Looking For PlayersBest Match:

70% Compatibility 69% Compatibility

Suggestion: You might enjoy Borderlands !

Worst Match: 0.01% Compatibility

Actual Friend of User 1!

Example Comparison of User Match Result

Video Game Recommendations

Steamโ€™s Current Game Recommendations: Personal Experience

Games Steam Recommends Me

My Playtime by Title

Usersโ€™ Playtime for โ€œTiny and Big: Grandpaโ€™s Leftoversโ€

โ€ข Compared to my other games, my playtime of this game seems small

โ€ข Compared to other people who own this game my playtime is small (lowest decile)

Implying User Scores Based on Playtime

โ€ข Score each userโ€™s game by relative playtime compared to the set of people who own that game using deciles

Game Recommendations Using SVD ๐‘ข1 ๐‘ข2 ๐‘ข3 ๐‘ข4 โ€ฆ

๐‘”1

๐‘”2

๐‘”3

๐‘”4

โ‹ฎ

๐‘ 11

๐‘ 32

๐‘ 42

๐‘ 12

๐‘ 21

๐‘ 41

?

?

?

?

?

?

?

?

๐‘ 23

๐‘ 42

Compute SVD

๐‘“ 1 ๐‘“ 2 โ€ฆ

๐‘ข1

๐‘ข2

๐‘ข3

๐‘ข4

โ‹ฎ

๐‘ข11

๐‘ข32

๐‘ข12

๐‘ข21

๐‘ข41

๐‘ข31

๐‘ข22

๐‘ข42

๐‘ข13

๐‘ข33

๐‘ข43

๐‘ข23

๐‘”1 ๐‘”2 ๐‘”3 โ€ฆ

๐‘“ 1

๐‘“ 2

โ‹ฎ

๐‘”11

๐‘”32

๐‘”12

๐‘”21

๐‘”31

๐‘”22

๐‘”13

๐‘”33

๐‘”23

๐‘“ 1 ๐‘“ 2 โ€ฆ

๐‘“ 1

๐‘“ 2

โ‹ฎ

๐‘ค11

0

0

0

0

0

0๐‘ค22

๐‘ค33

Train SVD with 80% of Data

Test SVD with 20% of Data๐‘ข1 ๐‘ข2 ๐‘ข3 โ€ฆ

๐‘”1

๐‘”2

โ‹ฎ

๐‘ 11 ๐‘ 12

๐‘ 21 ?

?

๐‘ 23Predict SVD

๐‘ข1 ๐‘ข2 ๐‘ข3 โ€ฆ

๐‘”1

๐‘”2

โ‹ฎ

๏ฟฝฬ‚๏ฟฝ11 ๏ฟฝฬ‚๏ฟฝ12

๏ฟฝฬ‚๏ฟฝ21 ?

?

๏ฟฝฬ‚๏ฟฝ23Calculate

RMSE

RMSE = 2.7NRMSE = 0.31Netflixโ€™s NRMSE = 0.21

๐‘…๐‘€๐‘†๐ธ=โˆš 1๐‘›โˆ‘๐‘– ๐‘—โ‘

( ๏ฟฝฬ‚๏ฟฝ๐‘–๐‘—โˆ’๐‘ ๐‘–๐‘— )2

More Exploratory Analysis!

Independent Game Development is on the Rise!

Only 31% of Steam games are rated on Metacritic

124 games have been purchased but never been played!

Not all games are played; Not all games are rated

Strictly Single Player

Multiplayer

The playtime on only 6 games is equal to the total playtime on all others

Multiplayer games tend to have greater playtime than strictly single-player games

Steam Games by Genre

โ€ข MMOs account for few games on Steam, but have high playtime per title

โ€ข Over half of Steamโ€™s game are Indie, but Indie games have very little playtime per title

Steam Games by Genre

โ€ข Sports games have the highest average cost, and MMOs have the lowest (note subscriptions not included)

โ€ข MMOs and Action games have the best โ€œbang-for-the-buckโ€ in terms of hours of playtime/dollar