Delivering Fast.Then Faster.No Retreat. No Surrender.No QA.Gil Wasserman Fiverr VP R&DAgile Israel 2016
About Fiverr
Quick Facts
About Fiverr
• Founded: 2010
• Funding: $110M
• Team: 250
• Dev team: 70
• Offices: Tel Aviv, NYC, SF, Chicago, Miami
Fiverr is the world’s largest marketplace for creative and
professional services with millions of buyers and sellers
around the world.
Logo Design, Illustration & Caricatures, Video & Animation, Copywriting and more! Work Created on Fiverr
Creative Goldmine
190 Countries
150 Categories
25 Million Orders
Order processed every 4 seconds; Over 1M orders per month
CD Daily
Production Deploys
Deploys Done by
Developer
Task Force: PM, BE, FE,
BA, Designer
20 TFsMicro Tasks, Large
Projects
Team X 5
Millions LOC
No QA !
NoQA - WhyQA in The
Critical
Path
Is a Drag Is a Drug
Is a
Barrier to
Self
Growth
Software Development is a Knowledge Game
NoQA - For WhatRemoving
QA from The
Critical Path
Faster
DeliveryEfficient Effective
Better
Quality
Does It Fit All ?
Section A
First Steps: Learn to walk
Think smallNo context switch.
QA not a Gatekeepera Team Member
QA StarvationUse your judgement
No Bugz Manag.
15 → 50→ 70 Dev2 → 2 → 0 QA
Learn to
Forget
Hey...What About Automation?• UT vs Integration vs full system tests ?
• Environment - Local, staging, p-likes
• DOM load vs full rendering?
• UT - Essential quality tool or a waste?
• Automated testing development - a bottleneck or not?
• Successful run - a condition to merge?
• Cross Browsers?
• Refactoring?
Guiding Principles• Company Vision and Mission
• Dev Mission: Quality Impact, Fast!
• Nothing is perfect. Everything is imperfect. Grow within uncertainties.
• Minimal policy setting
• Trust → Autonomy → Ownership → Accountability
• Fear is no option. Be Responsible. Use your judgement
• Continuous learning
• Continuous goal setting
HubSpot
So... What About Automation?• UT vs Integration vs full system tests ?
• Environment - Local, staging, p-likes
• JS or full rendering?
• UT - Essential quality tool or a waste?
• Automated testing development - a bottleneck or not?
• Successful run - a condition to merge?
• Cross Browsers?
Own the Journey
Own the FeatureUnderstand the user
Own the FeatureLive in Production
Own the Business
Production Health
Own the BusinessFollowup
- Graphite, Grafana- Kibana- Graylog- Seyren- CircleCI- Slack- Docker, Consul- Impala- SiSense- P-Likes- New Relic- Rollout- Feature flags- AB tests
MVR, MVA
Rule Your Domain• Tech and Product ownership
○ Teamwise
○ Enabler not a Tyrant
○ Managing tech debt
○ Code health
○ Production health
“Devs know their code best and should test it.”Large project retrospect
Our Current Quality Pyramid Cup
Manual Local Testing
UT
Manual P-Like Testing
Rollout Strategy
Production Monitoring/AlertsQuick
Turnaround
Judgement Call
Is It Right For Me?
Thank you