1

Inside a modern RIA powered by Solr

Andrew MontalentiCo-Founder &

Technology Leadandrew@cogtree.com

22

Mainstream

30,000

3

Blogs

900,000

1From Technorati’s 2008 State of the Blogosphere

1

But,

4

What about your interests?4

your interests,

your web

55

your web

6

What is ?

• Your unique interests

• … create a filtered, prioritized, and personalized news feed

• … built just for you!

• 120K+ news and blog sources tracked

• The most personally relevant items at the top

• Bottom line:

You spend less time skimming headlines,

and more time reading relevant content.

7

Demo!

(if possible)

9

Let’s pop open the hood!

The RIA

ExtJS + jQuery

JS REST Binding

1010

REST API

django-piston

Solr Postgres

11

Batch size

Per-Doc Processing

12

IO-bound work

size

13

Solr in the Real World

• Storage of "canonical data“

• Relational vs. Search Index

• Complexity of custom relevancy scoring

• "Near-Real-Time" updates• "Near-Real-Time" updates

• Solr in a pipeline

• Pushing bits and marshalling cost

• Index size, corruption, and stability

• Administrability

14

Scaling Up Parse.ly

• Custom scoring

• Multicore

• Distributed search

• Celery / Disco

1616

•

• User-Article Binding Problem

17

Basic

solr.py

Almost There

collective.solr

Comprehensive

haystack

18

pysolr

solrpy

json/py output

solango python-solr

19

BatchingContext Lib

Caching

20

Comprehensive.

Pythonic.

Solr.

MulticoreProxies

Web Framework

Django

PaginationIterators

CachingMemoization

21

powered by

Andrew

DidierSachin

22

Quick Plug

Does your company or enterprise

need our services?

23

2424

Andrew Montalenti

andrew@cogtree.com

25

Twitter

@amontalenti

Product Twitter

@parse_ly

25

andrew@cogtree.com

Website

http://parse.ly

Team Blog

http://blog.cogtree.com

Sign up now!

It’s Free!

Promo Code

SLIDES