Open data, scraping e thacks com Software Livre

transcript

Open Data com Software Livre

Como fazer?

Friday, May 20, 2011

http://papers.consegi.gov.br/pub/programacao/483

Dados(o que de fato importa)

#opendata

PDFDOCXLS

PDFDOCXLS HTML

PDFDOCXLS HTML CSV

XMLJSON

PDFDOCXLS HTML CSV

XMLJSON RDF

PDFDOCXLS HTML CSV

XMLJSON RDF

Scraping

PDFDOCXLS HTML CSV

XMLJSON RDF

Scraping API

ScrapingFriday, May 20, 2011

Nokogiri 鋸

http://nokogiri.org/

An HTML, XML, SAX, & Reader parser with the ability to search documents via XPath or

CSS3 selectors… and much more

codigo

http://hpricot.com/

A swift, liberal HTML parser with a

fantastic library

http://www.crummy.com/software/BeautifulSoup/

Beautiful Soup is a Python HTML/XML parser designed for quick turnaround

projects like screen-scraping.

http://jquery.com/Friday, May 20, 2011

APIFriday, May 20, 2011

PDFDOCXLS HTML CSV

XMLJSON RDF

Scraping API

Service Oriented ArchitectureSOA

What is YQL?The Yahoo! Query Language is an expressive SQL-like language that lets you query, filter, and join data across Web services.

http://api.tcm.ce.gov.br/Friday, May 20, 2011

Data Visualization

http://estadao.com.br/especiais/a-nova-assembleia-legislativa-de-sao-paulo,133312.htm

http://tables.googlelabs.com/Friday, May 20, 2011

http://www.informationisbeautiful.net/Friday, May 20, 2011

http://oreilly.com/catalog/9780596157128Friday, May 20, 2011

@alegomes

Technology