The Apache Solr search engine at Allopneus

CEDRIC ULMER, PRESIDENT - FRANCE LABSSEBASTIEN BARTHELEMY, CTO - ALLOPNEUS

LIB’DAY, MARSEILLE, OCTOBER 2014

Agenda

Allopneus

• Business

• Desired functionalities

• Technical requirements

Apache Solr: Why and how ?

• Why

• How

• Project execution

Allopneus: next steps

France Labs – Our activities

Training Consulting

Installation

Software maker

France Labs – Notre présence

European customers, LTE as well as SMBs and startups.

Active participation to the Open Source and Search ecosystem

• Locale : Open source group at Telecom Valley, Tech Confs, RE:Conf

• National : Organizing Enterprise Search Meetup in Paris, talking at Search Day

• International: Talking at Enterprise Search Europe.

Datafari – our packaged search solution – is available as open source, under Apache license

Search and eCommerce

27 % visitors of an eCommerce site are starting their visits using the internal search engine.

73 % visitors of an eCommerce site are leaving after 2 minutes if they don’t find what they are looking for.

96 % visitors say that search is an important functionality in their buying process.

Source: Marketing Sherpa

Allopneus – The pros for tires

Company 100% French, founded in Dec. 2004 by Didier BLAISE.

Approx. 180 employees, HQ in Aix-en-Provence and a 41.000 m2 warehouse in Oignies.

French leader for sales and and mounting of tires on the web, with more than 50% market share.

Allopneus – A few figures

15 millions pages displayed / month

1,5 millions unique visitors / month

Revenue > 200 millions € in 2013

Approx. 600.000 tires in the warehouse

Allopneus –Search in the “wheel rim” universeApprox. 30.000 products in the catalog

Approx. 5 millions connections wheel rims/vehicles

Approx. 10 millions associations tire dimensions / connections

Search index about 2 GB

Near real time updates (modifications price/availability)

Duration of complete indexing: 30 min for wheel rims, 2h30min for tires

Time to take into account a new product: < 20 min

Current number of shards: 3 shards with tripe replications on 3 machines

Average response time per query: < 10ms

Allopneus – Search functionalities

Products search

Products faceting

Products pagination / sort

Full text search (not released yet)

Auto-completion (not released yet)

Spellchecker (not released yet)

Suggestion engine (not released yet)

Allopneus – Products search

Allopneus – Products Faceting

Apache Solr – The reference open source search engine

Apache Solr – The reference open source search engine

Property of the Apache foundation

Layer on top of the Lucene search java API

Easy-to-use horizontal scalability (clustering)

Compatible with Hadoop (default search engine in Hadoop distros)

Highly configurable

Schemaless

REST APIs

Apache Solr – Aucompletion illustration

Apache Solr – Spellchecker illustration

Apache Solr: Suggestions illustration

Data Sources

Search Engine

Front end

Admin UI

IndexingPipeline

DB1

DB2

Comments

Web

Apache Solr 4 (SolrCloud)

Allopneus – Architecture

Solarium

Node1

Node3

Search engine

Front end

Apache Solr 4 (SolrCloud)

Allopneus – Architecture – Zoom sur SolrCloud

Node 1Shard1Shard2Shard3

Node 3Shard1Shard2Shard3

Node 2Shard1Shard2Shard3

Shard2 ShardLeader, randomly picked

Zookeeper

Instance 1

Instance 2

Instance 3

Zookeeper

Instance 1

Instance 2

Instance 3

Indexingpipeline

Solarium

Apache Solr – Project execution

“First the search engine, then the functionalities”

Migration towards SolrCloud started in July 2014

Tests in September 2014

Official release in November 2014

Navigation speed much faster that “standard sql”

Future work: full text search, autocomplete, search for categories/vehicles, suggestions, …

QUESTIONS ? (what does the France Labs logo represent ?!)

AVAILABLE DURING THE LIBDAY CONFERENCE TO ANSWER YOUR QUESTIONS

CEDRIC.ULMER@FRANCELABS.COM@FRANCELABS