CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 1
www.orfeo-toolbox.c-s.fr
GeoCap – Taormina 19th November 2009
Orfeo Tool Box
Orfeo ToolBox:An open source tool for high resolution image processing.
Eric Guzzonato - Cyrille Valladeau – Jordi IngladaCS Communication and Systems - CNES
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 3
The OTB in few wordsContext & Aims
• ORFEO (Optical and Radar Federated EarthObservation):
Dual earth observation satellite system:Optic: CNES, France (Pléiades, HR)Radar: ASI, Italy (Cosmo-Skymed)
• ORFEO Accompaniment Program:Goals:
make easier the development of new algorithmstheir validation and capitalisationfill the gap between researchers and ORFEO users
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 4
The OTB in few wordsContext & Aims
Thematic part:User’s needs (extracted information)Product definitionValidation
Methodologic part: Coordination of research activities in image processing:
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 5
The OTB in few wordsContext & Aims
• Orfeo ToolBox (OTB):Designed to prepare, support and promote the use of imagesOpen source software for image processing (for labs, ORFEO users and the industry)1 major and 3 or 4 minor releases each year
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 6
The OTB in few wordsWhat
• Technical factsA C++ image processing library All Open source under french CECILL licenseFully Based on ITK (Insight ToolKit), C++ library for medical image processingA set of GUI applications for remote sensing images processing and information extraction: OTB-ApplicationA generic image processing application dedicated to end-users: MonteverdiBindings with Python, Java and IDL/Envi language
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 7
The OTB in few wordsWhat
• Used LibrariesITK: library for medical image processingOpenGL: graphical displayGDAL: image readingFLTK: GUIsLibSVM (Support Vector Machine): supervised classificationOpenJpeg: Jpeg2000 formatlibKML: Google vector data format6S: Radiometric processingOSSIM: sensor modelling and map projections…
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 8
The OTB in few wordsWhat
• The OTB frameworksApplication Domains: remote sensing, medical imaging, robotics, vision, …Algorithm families:
Filters: optical/SAR, morphological operators, denoising, ...Segmentation: watersheds, Hough, …Image registration: transforms, interpolators, ...Learning and classification: Markov, K-means, SVMMeasure of similarities: correlations, mutual information, K-means, Kullback, …Geometric corrections: with sensor model and common map projectionsChange detection: multi-temporal/sensors series…
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 9
The OTB in few wordsWhat
Data type : Images
N dimensionsMono/Multi channelReal/Complex
RasterVector dataGraphsMeshes Label object map (RLE)
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 10
The OTB in few wordsWho
• OTB is designed and funded by the CNES
• Mainly developed by CS, since 2006
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 11
The OTB in few wordsWho
• International community (09-01)
OTB documentation download
OTB download
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 13
The OTB AdvantagesGeneral Advantages
• Multiple plateforms supportedDaily tested on multiple configurations
(Windows, Linux/Unix, MacOS)
• GenericityUse template ⇒ open and evolving architecture
• PipelineAutomatic input and output management
ReaderImage
FileFilter
Image Writer File
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 14
The OTB AdvantagesGeneral Advantages
• Multiple image formatsstandard and remote sensing formats
(scalar, complex, mono or multi channels types)
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 15
The OTB AdvantagesStreaming/Threading
• High performances:Multi-threading:
Use every available processor ⇒ Parallelize computations
Division4
Division3
Division2
Division1
Division4
Division3
Division2
Division1
PU4
PU3
PU2
PU1
Output ImageInput Image
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 16
The OTB AdvantagesStreaming/Threading
• High performances:Streaming:
Deal with areas in image ⇒ Process huge image.
Reader StreamingWriter
OutputImage
Filter
Update()Update() Update()
Image Region
Image Region
Image RegionImage Region
N times
InputImage
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 17
The OTB AdvantagesGIS
• Read/write vector format (KML and shapefile)• On the fly projections: vector data on remote sensing
image using image geometry (OSSIM based):Raw: using sensor model and digital elevation modelOrtho: using cartographical projections
• Vector rendering, layer management, …• Registration (application)
Image/ImageImage/Vector DataVector Data/Vector Data: Incoming
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 19
Some Application ExamplesAvailable modules
• OTB-Applications (≈ 20 applications)• Monteverdi (≈ 15 new modules)
OTB
OTBApplications Monteverdi
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 20
Some Application ExamplesViewer
Allows:
• Image visualization and navigation,
• Histogram manual adaptation,
• Vector Data display, cares the projection.
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 21
Some Application ExamplesStereoscopy visualization
Allows:• Visualization of stereoscopic image pair
• Zoom, navigation.
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 22
Some Application ExamplesOrtho rectification
Allows:
• Selection of an extract (in physicalcoordinates),
• Orthorectification.
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 23
Some Application ExamplesOrtho fusion
Allows:• Selection of an extract (in physicalcoordinates),
• Orthorectifications,
• Pan sharpening.
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 24
Some Application ExamplesRegistration
Allows:• Vector Data/Image
• Image/Image
•Vector Data/Vector Data (Incoming)
Pireo ImageToDBRegistraion Application
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 25
Some Application ExamplesSupervised Classification
Allows:
• Multiple classes selection,
• Classification using SVM,
• Result export (image or vector data).
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 26
Some Application ExamplesUrban Area Extraction
Allows:
• Urban Area Extraction using radiometric indexes and edge density,
• Result export (image or vector data).
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 27
Some Application ExamplesFeature Extraction
Allows:• Compute features (textures, radiometric
indexes, etc.)
• Save image result (each channel is 1 feature).
NDVI radiometric index
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 28
Some Application ExamplesAnd…
• In OTB-ApplicationsImage type convertorImage extractorRadiometric calibrationSAR polymetric analysis tool,Object counting, …
• In MonteverdiRegistration using homologous point selectionSensor model creation using GCPs selectionSurimpositionReprojectionBand mathComplex image transformation (log-modulus), …
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 30
CS and the OTBExperience
• CS has been developed OTB since 2006• CS participates to the OTB users mailing list• CS delivers OTB training courses• CS contributes to the OTB as all user can do • CS uses OTB for other project:
InternshipsCNES funding R&Ts:
Object detection:Dynamic format for risk management productsMaritime surveyCompressed sensing...
Project
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 31
CS and the OTBExperience
CNES funding R&Ts:Object detection:
Focusing chain for region of interest extractionObject Recognition by template registrationSpatial ReasoningAutomatic object detection and recognition
Dynamic format for risk management productsMaritime surveyCompressed sensing...
Project Venµs (CNES-ISA)
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 32
CS and the OTBPublications
• CS participates to many publications based on OTB
“Reference algorithm implementation in OTB: Textbook cases”, IGARSS 2009, J. Michel (CS), J. Inglada (CNES)“Focus pre-processing chain for object detection in high resolution remote sensing images”, IGARSS 2009, J. Michel (CS), C. Valladeau (CS), J. Inglada (CNES)“Assesment of interest points detection algorithms in OTB”, IGARSS 2009, O. Lahlou (CS), J. Michel (CS), J. Inglada (CNES)...
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 34
Enter the OTBGet Informations
• An users list: [email protected]• A blog: http://blog.orfeo-toolbox.org• A wiki: http://wiki.orfeo-toolbox.org• A bug tracker: http://bugs.orfeo-toolbox.org• Online documentation: http://www.orfeo-
toolbox.org/otb/documentation.htmlClasses documentation: DoxygenOTB Guide: SoftwareGuide
www.orfeo-toolbox.org
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 35
Enter the OTBHow to start
• Compile your own OTB, OTB-Application or Monteverdi
Downlaod sources:Lastest release: http://sourceforge.net/projects/orfeo-toolbox/files/orfeo-toolbox/OTB-3.0Current development version using Mercurial (http://www.selenic.com/mercurial) and
hg clone http://hg.orfeo-toolbox.org/OTB
hg clone http://hg.orfeo-toolbox.org/OTB-Applications
hg clone http://hg.orfeo-toolbox.org/Monteverdi
Follow the compilation procedure according to the SoftwareGuide documentation.
CS Communication and Systems
The Orfeo ToolBox – GeoCap 09-11 36
Enter the OTBHow to start
• Download OTB-Applications Windows executable: http://sourceforge.net/projects/orfeo-toolbox
• Use the live CD: www.orfeo-toolbox.org/otblive
Don’t hesitate to contact the OTB community:[email protected]