+ All Categories
Home > Technology > Intuit: Reporting from the Trenches: Using Cassandra Effectively

Intuit: Reporting from the Trenches: Using Cassandra Effectively

Date post: 13-Apr-2017
Category:
Upload: datastax-academy
View: 470 times
Download: 0 times
Share this document with a friend
27
Rekha Joshi Intuit, Inc. Reporting From Trenches: Using Cassandra Effectively!
Transcript
Page 1: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Rekha JoshiIntuit, Inc.

Reporting From Trenches: Using Cassandra Effectively!

Page 2: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Who Am I?

Staff Engineer at Intuit Inc.

Oreilly Certified Apache Cassandra Professional

Page 3: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Good Software?

Page 4: Intuit: Reporting from the Trenches: Using Cassandra Effectively

And a Truly Successful Software?

Page 5: Intuit: Reporting from the Trenches: Using Cassandra Effectively

All This Data!!!!!!!!!!

Page 6: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Can I Lift This Alone?

Page 7: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Need For Speed

Page 8: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Cassandra,who?

Cassandra is a Java based NoSQL, linearly scalable, best in class tunable performance, fault tolerant, distributed, masterless, time series database.

Page 9: Intuit: Reporting from the Trenches: Using Cassandra Effectively

DynamoDB(Amazon)

Big Table(Google)

Cassandra

Inherits data distribution Inherits data model

Masterless ArchitectureLinear Scalability Tunable Consistency/Performance

ApplicationQuery Access Patterns

influencing influencing

Cassandra: The Hybrid Kid has the Edge!

Page 10: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Intuit And Cassandra

Cassandra = Intuit Technology Standard of Choice for NoSQL Distributed Database

Page 11: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Intuit On Mission

Page 12: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Personalized AB Testing Platform

Page 13: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Advanced Security

Analytics Options

Advanced Tools

Cassandra And DataStax Enterprise

Page 14: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Your Worries?

Page 15: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Fantasy And Engineering Fantasy

Page 16: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Application live on internal network

Blank Slate

Application live on AWSSecurity approvedData Security, Encryption

System happy, load tested, multiple releases, customers happy

Learnings – How? Why?

Successful Mini Peak Traffic, Paranoid Monitoring

Application releases use cases, Refactoring Data Model,

Excellent Peak Tax season!!!

Oct Start

Oct End

Nov Dec AprMarFebJan

Trusting -> Paranoid -> Seasoned

Page 17: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Garbage Collection Issue

Page 18: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Clock Issue

Page 19: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Understand the Node Ring

Nodetool statusNodetool ringNodetool infoNodetool cfstatsNodetool tpstats

Repeat after me: Cassandra is a Java based NoSQL linearly scalable, best in class tunable performance, fault tolerant, distributed, masterless, time series database.

Page 20: Intuit: Reporting from the Trenches: Using Cassandra Effectively

What If A Node Goes Down?

Page 21: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Tuning The Application

Refactor data modelRevisit the usage access patternsParanoid Monitoring

Repeat after me: Cassandra is a Java based NoSQL linearly scalable, best in class tunable performance, fault tolerant, distributed, masterless, time series database.

Page 22: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Tuning For Reads

Page 23: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Tuning For Writes

Page 24: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Tuning The System

Page 25: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Little Talked Aspect Of The Pareto Principle!

Page 26: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Heavy Lifting? Easy!

Page 27: Intuit: Reporting from the Trenches: Using Cassandra Effectively

Thank You!https://www.linkedin.com/in/rekhajoshm

https://twitter.com/rekhajoshm


Recommended