Date post: | 14-Aug-2015 |
Category: |
Data & Analytics |
Upload: | rgn216 |
View: | 206 times |
Download: | 0 times |
Data channels
Member
Member ID visited
bio
country, city state, lat,lon
name
Member ID
topics
topic name
topic
topic IDURL key
created
event ID
lat,lon
comments
event name
event
event IDtopic nameevent URL
group ID
group
event name
group
event ID
group ID
RSVP
response
Goal : Assess similarity between users
Rich will meetup with Wine Lovers in Phillie in Philadelphia, PA
Jake will meetup with Wine Lovers in Phillie in Philadelphia, PA
Wine Lovers
Rich Jake
RSVP’d RSVP’d
Friends??
Query : Have Rich and Jake attended common meetup events ?How many ?
Data transformation : JSON to CSV
name rating city state ...
SF PHP 4.3 San Franciso CA ...
... ... ... ... ...
[{"rating": 4.3, "topics": [{"name": "PHP", "urlkey": "php", "id": 455}, {"name": "Software Development", "urlkey": "softwaredev", "id": 3833}, {"name": "LAMP", "urlkey": "lampsoftware", "id": 10164}, {"name": "Web Technology", "urlkey": "web", "id": 10209}, {"name": "Technology", "urlkey": "technology", "id": 10579}, {"name": "Web Development", "urlkey": "web-development", "id": 15582}, {"name": "Programming", "urlkey": "programming", "id": 17627}], "timezone": "US/Pacific", "organizer": {"name": "Mike Tougeron", "member_id": 2267793}, "id": 120903, "category": {"shortname": "tech", "name": "tech", "id": 34}, "city": "San Francisco", "lon": -122.4000015258789, "state": "CA", "utc_offset": -25200000, "name": "SF PHP” , ….
API
Data Pipeline
Local File System
PREPROCESSING
JSON CSV HBASE TABLE
BATCH LAYER
QUERIESDATA PRODUCT
recommendations