SCALA in CY 2014:

Gaining Business Momentum

by

Russ Hertzberg

Agenda• Rapid Growth Phase for the Platform Ecosystem &

Developer Community• Spawning A Popular Early Stage Hadoop Sub-system

• Spark, Databricks, and Spark-ups (Spark Based Startups)

• A Successful Relationship: Scala in a Java World• Developments to Monitor:

• The Future of Typesafe and Databricks• Scala Platforms & ‘New Data Management’ Ecosystems• Game Changing Applications

• Opportunities and Actions in Scala for Ukraine Software Developers

Growth Indicators: Conferences and User Groups

• Spark Summit December 2013…450 Attendees, 2 Days

• Spark Summit July 2014…1200 Attendees, 3 Days

• Scala By the Bay (San Francisco): 1983 Members

• New York Scala: 1935 Members

Growth Indicators: Code Contribution

* Github, Summer 2014

Growth Indicators: Application Diversification

• Genomic Analysis @ UC Berkely AMPLab (Spark Based)

• Real Time Online Advertising Auctions (Sharethrough)

• Middleware Platform (J9)

• Integrated Online Ticketing and Event Mgmt. (Ticketfly)

• Next Generation Email Anti-Spam Service (Heluna)

Growth Indicators: Professional Investors

• Typesafe: Greylock Partners, Juniper Networks, Shasta Ventures

• Databricks: New Enterprise Associates, Andreeson Horowitz

• Other Startup Investors: a16z, Sierra Ventures, Mission Ventures, UMC Capital, Bosch Venture Capital, Artiman Ventures, Sofinnova Ventures, Intel Capital, SingTel Innov8, Investor Growth Capital, QuestMark Partners, TransLink Capital, Goldman Sachs

• Early Stage Big $$ Example: $107M @

http://www.guavus.com/

Big Data InvestorsHave Big Bucks for Scala Related

Software Ventures

Apache Spark

• Launched in January of 2010

• New Hadoop Component up to 100X Faster than Map Reduce, with Stream Processing

• Written in Scala with Scala, Java, and Python APIs

• Latest Release on May 30, 2014 with 110 Contributors

Spark and Databricks

• ‘Creators’ of Spark

• Spin Out Company from Berkeley AMPLab

• Just raised $33M B Round

• Dozens of Production Deployments as of July 2014

• Moving the New Platform Quickly:• More SQL Connectors• MLLIB R Integration• Flume Streaming

Spark Ups…Startups Creating a ‘Spark’ Ecosystem

• Adatao

• Alpine

• Graphflow

• Guavus

• Sharethrough

Spark Ups…Startups Creating a ‘Spark’ Ecosystem, and More!

• Adatao

• Alpine

• Graphflow

• Guavus

• Sharethrough

• Plus the Hadoop Disti Integrations:• Cloudera• Hortonworks• MapR• IBM

• SAP Hanna Integration and SAP Certified Spark Distribution

Scala in a Java World

Cooperation

• Run on JVMs

• Use with Existing Java Libraries

• Support for Java Generics in Scala

• Use Java Data Structures As Is in Scala

Competition

• The Full Typesafe Platform• Akka and Actors• Play Framework

• Big Momentum for Scala in Next Gen Data Management

• Java 8 Oracle Reaction

Competition is Good!

The Future (or end game) of Typesafe

• Gamify It!

• Acquisition in 1, 3, 5, or n years?

• If Acquired, By Whom?

• Private Forever?

• Initial Public Offering and a Long Term Platform ISV?

The Future (or end game) of Databricks

• Gamify It!

• Acquisition in 1, 3, 5, or n years?

• If Acquired, By Whom?

• Private Forever?

• Initial Public Offering and a Long Term Platform ISV?

Scala Platforms and Evolving Data Management Ecosystems

• Processing Enough Data to Create Radical New Knowledge and Value is the Goal

• Scala and Scala Platforms are a Strategic Driver in this High Growth Software Segment Attracting Big Bucks

• Harness and Harvest More Data for Useful Purposes!

Game Changing Applications

• Healthcare Genome Processing…New Frontiers in Mind/Body Knowledge & Disease Treatment

• Mobile Device Behavioral Insight…to Create Autonomic Life Improvement

• Mining Social Network Data…a billion API requests per day!

Opportunities and Potential Action Items in Scala for Ukraine Software Developers

1. In Projects with Architecture Control, Evaluate Scala Fairly! (do not default to Java because you have body count)

2. Leap into Spark or Others Will Beat You

3. Think About Platform Technologies You Can Build Yourself to Make Your Own Services More Valuable and Efficient. Invest Intellectual Energy in Your Own Intellectual Property

4. Educate and Certify More Scala Developers

Some Link References• http://www.typesafe.com/company/casestudies• http://databricks.com/• http://blog.mikiobraun.de/2014/01/apache-spark.html• http://radar.oreilly.com/2013/11/how-companies-are-using-

spark.html• https://amplab.cs.berkeley.edu/benchmark/• https://github.com/twitter/scalding• http://

www.theserverside.com/feature/The-Scala-debate-demystified-Balancing-the-rants-with-the-raves

• http://boldradius.com/blog-post/UwO3nQEAAA3xKXiL/five-tips-for-onboarding-scala-developers