FreeEed

Open source eDiscovery with Hadoop

Background of eDiscovery

• Preservation• Discovery request• Production

EDRM

What does FreeEed do now?

Processing: 

• Text extraction• Metadata extraction• Culling • Deliver load file• Deliver native documents

What will FreeEed do soon?

 •Review•Analysis•Production•Presentation

What else can FreeEed do?

 •Preservation•Collection

Why can FreeEed do all of that?

 • Big Data technologiesoStorageoProcessing

• Open source toolsoText/metadata extractionoOCR

Advantages of open source approach

 • Easy reach• Modern technologies• Sharing spirit• Community support• Integrate or use any way you

want

Three ways to run FreeEed

 1.Standalone on Linux–Private Linux cluster–Amazon cloud, controlled from

your laptop (Windows, Mac, or Linux) - coming soon

FreeEed Architecture

 • Staging (zip files)• Text/metadata extraction• Culling• TIFFing or PDF• Post-processing

Staging

 

• One zip file per node (computer/server)

• Size controls load balancing• Big enough to make sense• Small enough to tolerate failure

Text and Metadata

 • Tika• Umbrella for extractors• Hundreds of file formats• Just one line of code: String text = tika.parseToString(inputStream, metadata);

Culling

 

• Selecting only responsive documents• Lucene - open source search • Flexible search queries • Search in memory• Two lines of code:

        Searcher searcher = new IndexSearcher(idx);        isResponsive = search(searcher, queryString);

TIFF/PDF

 • OpenOffice• LibreOffice• Admittedly, TIFFing is hard• Open source answer: it is what it is• Perfectionist answer: commercial

filters

Database use (HBase or Cassandra)

For example, find all authors

1.Document -> Author–Key = Author, Value = None–Author can be overwritten–The "Authors" row has all Authors

So, practically

Command-line

java -jar dist/FreeEed.jar -param_file my.freeeed.properties

or GUI

1-2-3

 • Install Ubuntu• Download FreeEed• Run the program• Ask for more features

Install Ubuntu

 

Download and unzip FreeEed

 

Enjoy