Meet Solr for the first time again Varun Thacker

Apache Solr has a huge install base and tremendous momentum

most widely used search solution on the planet. 8M+

total downloads

Solr is both established & growing

250,000+monthly downloads

Solr has tens of thousands of applications in production.

You use Solr everyday.

2500+open Solr jobs.

Activity Summary30 Day summary

Aug 18 - Sep 17 2014

• 128 Commits • 18 Contributors

via https://www.openhub.net/p/solr

12 Month Summary Sep 17, 2013 - Sep 17, 2014

• 1351 Commits • 29 Contributors

Search - Until recently

• Large organizations (Enterprise)

• Expensive

• Complex

• $$$$$

New Age Search• Everyone… startups, websites

• Special use cases

• E-commerce

• Mails and personal data

• Personal data - Across devices

• Social and Local!

• Analytics

Decision making!

• Short time frame

• Confidence measure:

• Getting started quick

• Configure and see the tip of the iceberg

• Issues only uncover later in the story

Until recently…• Getting started:

• Download

• java -jar start.jar

• SolrCloud, getting started….

• Download

• Copy example directory ‘x’ times over.

• java -Dbootstrap_confdir=./solr/collection1/conf -Dcollection.configName=myconf -DzkRun -DnumShards=2 -jar start.jar

• java -Djetty.port=7574 -DzkHost=localhost:9983 -jar start.jar

• It runs!

Times… they are a changin…

• Download

• cd solr

• Standalone: bin/solr start

• SolrCloud, example, interactive:

• bin/solr start -e cloud (< 2 minutes!)

Let’s index some data

• Flexible JSON Indexing - Solr supports any JSON document and the document can be indexed in the required format in Solr

• More reading: https://lucidworks.com/blog/indexing-custom-json-data/

Managed Schema

• Solr is the schema owner

• REST APIs - Hide the implementation details

• Schema-less mode

• Update and Addition of Fields and FieldTypes

• More reading: https://lucidworks.com/blog/schemaless-solr-part-1/

Configuration APIs

• Configure Solr using APIs

• solrconfig.xml… What did you say?

Solr Scale Toolkit

• Easily deploy SolrCloud clusters

• Live patching and rolling restarts

• Dependency on AWS soon to go away

• Chef or Puppet still are valid approaches

• More reading: http://lucidworks.com/blog/introducing-the-solr-scale-toolkit/

Talking about the Admin UI…

• Already improved from 3.x

• Uploading documents

• Collections API is coming soon

Collection Actions

Recently Added Features• Document expiration and Time To Live (TTL)

• Cursors: Efficient Deep Paging

• Export Sorted Result Sets

• SSL support in SolrCloud

• Distributed Pivot Faceting

• Suggester v2

• CollapsingQParserPlugin

• ReRankingQParserPlugin

• Collections API improvements

There’s so much more coming up…

• Schema Bulk API

• Distributed IDF

• Query DSL

• Cross Data-center replication

• Cluster Backup and Restore

• SOLR - Make an application, not ‘war’.

It’s easy.. and stable!

• Benchmarking

• Tons of users testing it

• Evolving test framework

Solr scalability is unmatched.

• 10TB+ Index Size • 10 Billion+ Documents • 100 Million+ Daily Requests

Where is it headed?• Download

• See that server directory?

• Use start scripts

• Send a document, or a few…

• Things don’t really look the way they should?

• Use the schema APIs

• Add fields… not enough?

• Add field types and then add fields

• Configure Solr using REST APIs

For Production:

• Use Solr Scale Toolkit to deploy, patch and manage!

• Configure Solr using REST APIs

Lucidworks Fusion

Intelligent Search Services/API

Recommendation Module Signal Processing Analytics Service

Discovery Engine

Analytics StoreEnrichment Services⚒

Analyst Workbench

eCommerce Solution

Admin/ Management

SiLK Log Analysis

Search/ Discovery

Partner Solutions

Connector Framework

Connect @

https://twitter.com/varunthacker

http://in.linkedin.com/in/varunthacker

varun.thacker@lucidworks.com