Liberating government data with FME CloudAdrian LaurenziLead Developer of Integration

Who are you?

Our customers

Open

Data

Portals

Financial Transparency Apps

Core Challenge

Customer data systems are heterogeneous

FME Socrata Writer

Data on source system

Socratadataset

Performs Extraction,

Transformation, and Loading

Liberating gov’t data with FME Cloud

FME Cloud

• Apps• Data portal

Multitenant ETL services

Permits Standard - Zillow

Custom ETLs• Apps schema correction• FTP to Socrata

Version Control on FME Cloud

FME Cloud

FME Server REST API

Why is version control sooo COOL?!?

Versioning / code reviews for Python code in workflows

Not useful understanding changes in .fmw files,but…

“Oh NOOO I broke their data!”

Rollback to the rescue

git checkout 7b12120 .

git commit

git push

YESSSS!!! Smooth sailing again

Git/BitBucket Hook Integration Demo

Show example publishing via BitBucket workflow that uses PythonCaller

Thank You!

Questions?

For more information:

Adrian Laurenzi <adrian.laurenzi@socrata.com>

Socrata, Inc.

socrata.com

FME/Socrata Connector Templates

FME Socrata Writer Resources

FME Connector Templates

Towards more “plug-in-play” ETLs