Date post: | 02-Apr-2018 |
Category: |
Documents |
Upload: | gautham-logaraj |
View: | 215 times |
Download: | 0 times |
of 54
7/27/2019 Data Acess From Interent
1/54
7/27/2019 Data Acess From Interent
2/54
Objectives/Agenday
what is data?y data formats used on the Web
y finding data
y downloading data
y using that data
y
working with downloaded datay distributing data
y data quality issues
7/27/2019 Data Acess From Interent
3/54
Defining Datay data is here defined as statistical information
generally stored in a database or analyzed andoutput in a variety of formats
y data results from research, studies, surveys anddata collection efforts
y data can be found on the Web in a variety of
formatsy as raw data (as in databases or spreadsheets) ory as processed data in the form of tables, graphs and maps
7/27/2019 Data Acess From Interent
4/54
How Are Data Made Available?yNarrative - reports
y tables
y databases (possibly
including documentation)y raw data
y figures and graphs
y Comma or tab delimited
y maps
y multiple formats
(including facts)y metadata
y questionnaires
7/27/2019 Data Acess From Interent
5/54
7/27/2019 Data Acess From Interent
6/54
What File Formats Are Being Used?y ASCII, HTML, DOC, XLS or WKS
y PDF, EXE, MTW (Minitab), DAT
y many others from graphic formats to GIS formats to
database formats
7/27/2019 Data Acess From Interent
7/54
Explanations of File Extensionsy ASCII - plain text with no boldings or control
characters
y HTML - HyperText Markup Language format
y usually tablesy DOC - Microsoft Word format
y RTF - Rich Text Format (output from MS Word)
y PDF - Adobe (proprietary)
7/27/2019 Data Acess From Interent
8/54
Database and Spreadsheety DBF - Dbase format
y used by dBASE III, dBASE I, Vfoxbase, Foxpro
y Quattro - database format
y Paradox - database formaty XLS - Microsoft Excel spreadsheet format
y WKS - Lotus 123 spreadsheet format
7/27/2019 Data Acess From Interent
9/54
File Extensions, continued...y EXE - an executable file which you click on and
the file opens up the compressed data into a formatyou can use
y MTW - Minitab format
y DAT files are basically text files formatted for usewith SAS and contain data only
y uuencoded
y TAR - tar files (UNIX) -several files compactedand output as one file
y
ZIP - zipped
7/27/2019 Data Acess From Interent
10/54
Common Graphics Formatsy BMP - bitmap file format
y GIF - Graphical Interchange Format
y JPG - Joint Photographic Experts Group (after group
which created the standard)y TIF - another graphics format
y WMF (Windows Metafont)
7/27/2019 Data Acess From Interent
11/54
GIS Formatsy *.TAB - MapInfo
y *.GCM - Geo Concepty *.AGF - Atlas GIS/Pro
y
*.E00 - Arc/Infoy *.DXF - AutoCAD
y *.MIF/*.MID - ArcView
y *.MIF/*.MID, *.DXF - Maptitudey *.BNA - Atlas Mapmaker
y *.BNA - MapViewer
7/27/2019 Data Acess From Interent
12/54
Production Mediumybits and bytes
ypaper (e.g., summary data: press releases, memos,reports)
y HTML
y 9 track tapes
y cartridges
y CD-ROMSyNote: formats go out of fashion as new technology
comes along
7/27/2019 Data Acess From Interent
13/54
Standardsy will establishing standards help the problem of too many
formats?
y yes, no, maybe
y
we still need to deal with the data which has already beenproduced
y new formats are being developed all the time
7/27/2019 Data Acess From Interent
14/54
Standards, continued...y knowing which format the data is in helps IF we know
how to use that format
y knowing how to move from one format to another is also
useful
7/27/2019 Data Acess From Interent
15/54
Finding Data
Wh D Y Fi dD t th
7/27/2019 Data Acess From Interent
16/54
Where Do You Find Data on the
Web?y Government at all levels
y Foundations and Think Tanks
y Pharmaceutical companies
y Disease specific Associations (e.g., American HeartAssociation)
y Textbooks, Reports and other documents
y other sites - search on: health data
7/27/2019 Data Acess From Interent
17/54
Use Search Engines to Find Datay robots which search across the entire Web
y use the term: health data to turn up quite a few Websites
y use site specific search engines to locate information
within one site
7/27/2019 Data Acess From Interent
18/54
Use Guidesy guides are hierarchical arrangements of Websites usually
organized by subject
y several very good sites on statistics appear on the Web
P f tt dD t (T bl
7/27/2019 Data Acess From Interent
19/54
Preformatted Data (Tables or
Figures)y this is often data which is requested time and time again
y e.g., Bureau of Labor Statistics -http://stats.bls.gov/top20.html and http://146.142.4.24/cgi-
bin/surveymost?bls
y e.g., White House Briefing Room
7/27/2019 Data Acess From Interent
20/54
Interactivityy look for sites which enable you to retrieve data
according to your needs
y usually searchable databases where you type in the
population and variables you want data ony sites which enable you to retrieve data according to
your needs are most often found at government sites
such as at CDC WONDER
7/27/2019 Data Acess From Interent
21/54
7/27/2019 Data Acess From Interent
22/54
Downloading Data -
Graphicsy click on the image with right mouse button | then save file
to disk
y insert graphics into your document with the sourceinformation appended
7/27/2019 Data Acess From Interent
23/54
HTML Tablesy go to a Website which has an HTML table
y In Netscape: File | Save as File (in HTML format)y Netscape will save the whole page
y delete out what you dont want
y In Excel: File | Open File | change file format usingdown arrow | click on file
y Excel will turn the page from HTML to aspreadsheet
7/27/2019 Data Acess From Interent
24/54
ASCII Texty copy and paste
7/27/2019 Data Acess From Interent
25/54
Excel (XLS) Filesy click on file and either open, view and save the file, OR
click on the file and save directly to disk
7/27/2019 Data Acess From Interent
26/54
Word Tables or Figuresy for tables, copy and paste; for figures, click once to select,
then Edit | Copy | Edit | Paste
7/27/2019 Data Acess From Interent
27/54
Databasesy will depend on the database format and whether you can
search the database for information
y or download the data in tab- or comma-delimited format
PDF Moving Tables and
7/27/2019 Data Acess From Interent
28/54
PDF - Moving Tables and
Graphs into Office 97y what you can and cannot do
y you can bring a PDF table or graph into Word andPowerPoint
y you can make the graph or table larger or smaller
y you cannot edit the contents of the graph
y a PDF document created from Word cannot be convertedback into Word
7/27/2019 Data Acess From Interent
29/54
Moving Tables from PDF...y open the Adobe Viewer and the document you wish to
view
y highlight the text or graphic
y
from the Tools menu, select Select Graphics
7/27/2019 Data Acess From Interent
30/54
Moving Tables from PDF...y the cursor changes to a cross-hair
y draw a rectangle around the text or graphic by clickingonce in the upper left-hand corner of the text and drawingat a diagonal to the other corner
7/27/2019 Data Acess From Interent
31/54
Moving Tables from PDF...y click on Edit | Copy, switch to the receiving document
and hit Edit | Paste
y the selected material is copied as a WMF (WindowsMetaFont) graphic
y note the WMF is a space hog
y change the format to GIF or JPG using a graphics programlike Paint Shop Pro
UuencodedData -What todowith
7/27/2019 Data Acess From Interent
32/54
Uuencoded Data What to do with
it?y data sent to you in uuencoded format needs to be
uudecoded
y format is uudecode FILENAME.EXT (the file name isoften in caps)
y sometimes the uudecoding doesnt work
7/27/2019 Data Acess From Interent
33/54
Raw Datay Information that has not been organized, formatted, or
analyzed
y raw data can be imported into SPSS if its organized incolumns
y import tab and comma delimited ASCII files into Excel aswell
7/27/2019 Data Acess From Interent
34/54
Other Formatsybinary - A format for representing data used by some
applications including EXE files and numerical data
7/27/2019 Data Acess From Interent
35/54
7/27/2019 Data Acess From Interent
36/54
Retrieving Data through FTPy some sites make their data available on anonymous
(public) FTP subdirectoriesy you FTP to the site, log in as anonymous, give your login
address as your password, locate the file, select it and havethe server send you the data
7/27/2019 Data Acess From Interent
37/54
Retrieving Data via Gophery use a gopher menu or gopher on your browser to burrow
down the menu to get the data you wanty when you reach the data it will be in ASCII format (most
of the time)
y Gopher format on the Web:gopher://site.address.edu/subdirectory/subdirectory/filename.ext
HTTPingData to YourDesktop, or,
7/27/2019 Data Acess From Interent
38/54
HTTPing Data to Your Desktop, or,
Get Data from a Web Sourcey look at Excel Help for Get data from a Web Source
7/27/2019 Data Acess From Interent
39/54
Using Data
So, Now We Have the Data,
7/27/2019 Data Acess From Interent
40/54
, ,
Now What?y What tools can we use?
y Excel
y Access
y Statistical Software
y other software
OneExample ofConvertingData from
7/27/2019 Data Acess From Interent
41/54
One Example of Converting Data from
One Format to Anothery you may need to convert a tab or comma delimited file to
Excely in Excel, use the Import command: File | Open | Type of
File | Text Files | select file you wish to import (double-
click)y the Text Import Wizard will help you specify into which
column you want to put your text
7/27/2019 Data Acess From Interent
42/54
File Translation Utilityy DataImport Version 5 - $189/single user
y http://www.spaldingsoft.com/di/dataimpt.htmypulls data from virtually any computer report and converts
it into nearly 40 spreadsheet and database formatsy e.g., conversion of hospital financial and admissions data for
analysis
7/27/2019 Data Acess From Interent
43/54
What is an Excel Web Query?y A query that can retrieve data from several locations
y Internet (World Wide Web)
y Intranet
y Hard drive
y using HTTP, FTP, Gopher
7/27/2019 Data Acess From Interent
44/54
Web Queries -Basic Processy open a new workbook in Excel
y create a Web query or use an existing queryy queries are located in the Queries folder on your installation
disk
y you may need to install them
y activate MS Internet Explorer / NetscapeCommunicator
y connect to the Internet through your ISP
y run the query
y
examine the data
Create Your Own Web Query (.iqy)
7/27/2019 Data Acess From Interent
45/54
y qy
filesy open a new workbook in Excel
y you can create your own Web Queries
y read the Excel Help Documentation to get details
y
look under Web Queries, then Create a Web Query
7/27/2019 Data Acess From Interent
46/54
Quality Issues
7/27/2019 Data Acess From Interent
47/54
Data Qualityy how do you evaluate the quality of data on a site?
y consider who is the author (government agency?pharmaceutical company, interested layperson, who?)
yis complete documentation available?y variables defined and located on media
y is the data in a format you can easily used?
7/27/2019 Data Acess From Interent
48/54
Data Quality, continued...y How current is the data?
y is the source of the data made clear?
y what is the sample size?
y weighting and other statistical necessities?
y is it easily transported to a statistical package such as EpiInfo, SAS, SPSS?
7/27/2019 Data Acess From Interent
49/54
Data Quality, continued...y what format is the data in? AND do you have the
hardware to work with the datay 9-track tape? Is the tape medium old or has it been
refreshed? Old tapes sometime cause data loss when you try
to read them
y cartridge?
y CD-ROM?
y why was the data collected?
y Does the data collected reflect real life
Data Quality -Role of
7/27/2019 Data Acess From Interent
50/54
Documentation and Metadatay documentation helps the viewer of the data understand
how the data was created and how to use ity metadata is data about the data
7/27/2019 Data Acess From Interent
51/54
Distributing Data
7/27/2019 Data Acess From Interent
52/54
Making Data Availabley email attachments
y Web using Excel and HTML
y diskette and Zip cartridges
y
CD-ROM
Convert an Excel Spreadsheet to
7/27/2019 Data Acess From Interent
53/54
HTMLy File | Save as HTML
y the HTML wizard will appear and will ask you tospecify a range of cells and charts to convert
y
you decide if you wish to create a whole new HTMLpage or just a table which is then inserted into anotheHTML page
y tell Excel where you want to put the filey then click Finish
Really Easy Distribution of Data via
7/27/2019 Data Acess From Interent
54/54
Emaily data can be sent as ASCII text in the body of an email
or in other formats as attachmentsypeople can create data in one format but might have to
change it to another format to send it over the Internety e.g., create a graph in Excel and send in a uuencoded format
or as an attachment
y attachments are preferred to uuencoding a filey unless you know the secret of uudecoding the file, how can
you retrieve the graph?