Walnut aiWhat we learnt from processing 100k job postings with NLP and WordEmbedding Methods

beta

Evolution

Peak Hanging-in Barely

skill relevance of professionals

Opportunity

Most people don't

know how they

can do better

Does this problem exist

ask for advice

friendsmentors

managers

groups

How do we solve this problem

what are people

talking about

What are

companies

asking for

What are

companies hiring

for

Data

CommunitiesJob Postings Resumes

Product Manager

[Masked Company Name], Inc. - Redwood City, CA 94063

[Masked Company Name] connects people globally around shared video content. Think online

living room - watch together, completely in sync, and group video chat at the same time. We’re

looking for a Product Manager to help us grow the product, our user base and ultimately,

[Masked Company Name].

You will work directly with a team of engineers and designers to improve existing products and

develop new ones. You need to be able to think holistically about user challenges across

multiple platforms, develop that into an actionable roadmap and execute.

Our lean team is growing quickly, and you’ll have the opportunity to make a huge impact at

Rabbit.

Who we’re looking for:

3+ years product management experience in consumer products or applications

Proven analytical skills and the ability to make data-driven decisions

A test-measure-iterate approach

A creative problem solver with a “get it done” attitude

Excellent communication and project management skills

Bonus points: experience managing web and Android applications, design or marketing

experience, an appreciation for puns, growth team experience

Job Type: Full-time

Required experience:

product management: 3 years

Lets look at some data

Product Manager

[Masked Company Name], Inc. - Redwood City, CA 94063

[Masked Company Name] connects people globally around shared video content. Think online

living room - watch together, completely in sync, and group video chat at the same time. We’re

looking for a Product Manager to help us grow the product, our user base and ultimately,

[Masked Company Name].

You will work directly with a team of engineers and designers to improve existing products

and develop new ones. You need to be able to think holistically about user challenges

across multiple platforms, develop that into an actionable roadmap and execute.

Our lean team is growing quickly, and you’ll have the opportunity to make a huge impact at

Rabbit.

Who we’re looking for:

3+ years product management experience in consumer products or applications

Proven analytical skills and the ability to make data-driven decisions

A test-measure-iterate approach

A creative problem solver with a “get it done” attitude

Excellent communication and project management skills

Bonus points: experience managing web and Android applications, design or marketing

experience, an appreciation for puns, growth team experience

Job Type: Full-time

Required experience:

product management: 3 years

How do we read data

How to compute text

the quick brown fox jumped over the lazy dog

([the, brown], quick), ([quick, fox], brown), ([brown, jumped], fox), ...

Cat 010000110110000101110100

01101011011010010111010001110100011001010

1101110Kitten

Text Decimal

CBOW SkipGram

https://www.tensorflow.org/tutorials/word2vec/

Data Sources

Cleanse, Remove Stop Words

Generate Bigrams/Trigrams ..

UnSupervised Learning

Plot Phrases

cvUnSuper

vised

Lear

ning

cvUnSuper

vised

Lear

ning

cvUnSuper

vised

Lear

ning

cvUnSuper

vised

Lear

ning

develop new products

data-driven decision

'to','of','by','for','will','w

0.5474381446838379

Lets crunch thisScrapy, Python, Beautifulsoup

Nltk, Python

Gensim, Nltk, Python

Gensim Word2Vec

TensorFlow

Matplotlib, Sklearn

What the !!!

yeah that makes sense

Core

Product mgmt

Skills

Experience Years

Noise

Lets get a pen and paper

Refine Keywords

Keyword freq/region

Merge

Publish

cvUnSuper

vised

Lear

ning

cvUnSuper

vised

Lear

ning

cvUnSuper

vised

Lear

ning

Meta data +

Placing this in context

Early ResultsProduct Managers

Backend Engineers Software Engineers

Software Engineering Mgrs

Make this data work

https://m.me/Walnutbot

Summary

• What did we learn

• Know what you intend to learn

• Know your data sources [Open, Free, Paid]

• Unigrams are useless unless they are proper nouns

• Reuse learnt n-grams, continuously add to stop words phrases

• Ask real people if data makes sense

• Whats next

• More data sources+ Meta data

• Multiple Models exist for the same role, discover them

• Delta between models, insights lie in delta

• Combine insights with Meta data

Evolution

skill relevance of professionals

Stay Relevant

Progress

Transform

Thank You

Chandan Maruthi

https://www.linkedin.com/in/chandanmaruthi

WalnutAI