Building Frameworks of Organizational Intelligence
Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries
Sample Data Structure I: Data Farm Funds Report - Biology
Building Frameworks of Organizational Intelligence
Building Frameworks of Organizational Intelligence
Sample Data Structure I: Data Farm Funds Report - Casalini Libri
Sample Data Structure II - Data Farm Table - Funds Process
Building Frameworks of Organizational Intelligence
Sample Data Structure III - Voyager Funds Schema
Invoice_line_item
invoice_status
purchase_order
line_item
invoice_line_item_funds
fund
invoice
vendor
bib_master
bib_text
Building Frameworks of Organizational Intelligence
Information Loop
Data Farm Environment
Clean | Anonymize Normalize
Data Streams
Integrate Inform
Report Builder
Dashboard
Data Bureau
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
People and Network Data
Ref|Instruct
Working with data structures
Building Frameworks of Organizational Intelligence
E-Resource Use Reference ContactCirculation
Acquisitions Funds
Holdings
Copier | Printer Use
Gate Swipes
Resolve Resource
Resolve People
Resolve Places
Web Analytics
Image Collection Use
Data Farm Oracle Space-Overview
30+ gb, in 162 tables, for collecting and disseminating management info
Staff Census
LDAP
Tech Processing Workflow
Digital Library
Voyager-Supported Services
Building Use
Resolution Services
Administration
Reference & Instruction (dynamic)
Building Frameworks of Organizational Intelligence
Consortia ILL/DocDel
70-Member ILL Coop.
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
Ref|Instruct
Data Farm Silos
funds
Building Frameworks of Organizational Intelligence
A different take on a management information framework
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
xxx.xx.xxx.xxx (ip address) = .edu | on-campus | Van Pelt Library | staff office
July 26, 2007: 3:41 p.m.
Device= Mac | OSX Browser= Safari
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
zucca [Penn authentication key] = Provost cntr | LIBRARY | staff
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
SessionID 10335905=PsycInfo (resource identifier 7014)
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
sfx_session_id=Journal of Experimental Child Psychology,
“Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children.”
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F
TRANSLATION:
• Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.
• Logged into PsychInfo (CSA)
• Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library
• A library staff (Provost’s center affiliate)
• July 26, 2007 at 3:41 pm
and in the same session,
Sample Data Structure: EZ-Proxy Log
Building Frameworks of Organizational Intelligence
EVENT
Org|ProgramStaff
ServiceGenre
LibraryProgram
CampusLocation
Date|Time
IP-Domain
Environment
URL
Budget
Restricted
Unrestricted
Expnd Amt
Fund Code
Events: a Structure for Library Decision Metrics
Dept
SchoolClient
Rank
Major
Biblio-graphicContent
School
Reqmnt
Dept
Dept
LevelCourseDescriptor
ClientProgram
Building Frameworks of Organizational Intelligence
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
Ref|Instruct
Data Farm Silos
funds
Building Frameworks of Organizational Intelligence
DATA STORE
query (xsql)parse, resolve,
anonymize,secure!
store asmetridoc.xml
Data Farm Framework
oracle
logs
oracle
XML
Sources
Repository processes
Analysis
perl
XL
Service Environment
Catalog
Funds
Circulation
ERED
DYNIX BorrowDirect
SFX | ERM?
WEBApacheezproxy
Ref|Instruct
Building Frameworks of Organizational Intelligence
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
METRIDOC
Building Frameworks of Organizational Intelligence
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
Building Frameworks of Organizational Intelligence
CampusLocation
Date|Time
IP-Domain
Environment
URL
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
METRIDOC
Building Frameworks of Organizational Intelligence
Dept
School
Client
Rank
Major
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
METRIDOC
Building Frameworks of Organizational Intelligence
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
Org|Program
Staff
Service Genre
LibraryProgram
METRIDOC
Building Frameworks of Organizational Intelligence
<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>
</ENVIRONMENTAL>
<CLIENT><school><dept><rank>
</CLIENT>
<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>
</LIBRARY PRGRM>
<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>
</CONTENT>
Event Elements Articulated in an XML Schema
EVENT
LibraryProgram
EnvironmentClient
Content
ClientProgram
Budget
Biblio-graphicContent
METRIDOC
Building Frameworks of Organizational Intelligence
Data Source
instructions
Eventschema
metridoc.xml
voyager
Penn Community
Staff db
Java-based
processes
Data Store
<ENVIRONMENTAL><van_pelt><p.location><26-jul-2007><15:41:01><10335905>< http://www.csa… >< http://www.library.upe..><macOSX><safari2.0.4>
</ENVIRONMENTAL>
<CLIENT><LIB><admin><staff>
</CLIENT>
<LIBRARY PRGRM><urs><olson><5035><colldev>
</LIBRARY PRGRM>
<CONTENT><psycinfo><CSA><1017-7041><1901-3425><1452845903>< http://www.csa… ><sfx_id>
</CONTENT>
Schematic Workflow
Building Frameworks of Organizational Intelligence
Building Frameworks of Organizational Intelligence
MEDNURS
SAS-Sci
SAS-SSci
ENGNR
VETSAS-H
um
WHRTN
DENTAL
SOC WRK
EDUCOMMN
Total
Percen
t
Health Science 11,101 1,736 304 340 55 251 59 45 249 161 42 55 14,398 66.55%Chemistry 2,193 195 334 61 158 54 6 5 68 9 2 0 3,085 14.26%Arts & Humanities 323 87 39 124 13 27 228 26 4 68 177 29 1,145 5.29%Engineering 437 10 49 21 89 7 7 11 8 0 0 0 639 2.95%Business & Econ 101 50 11 38 20 0 17 249 0 15 12 12 525 2.43%Agriculture 202 16 131 11 3 69 0 0 4 0 1 0 437 2.02%Library & Info Sci 288 4 50 12 4 6 0 0 7 0 0 0 371 1.71%Physics 54 8 14 26 13 0 31 8 0 38 34 12 238 1.10%Enivronmental Sci 130 21 34 6 5 10 2 0 4 6 0 2 220 1.02%Life Science 107 2 38 1 5 3 0 0 4 0 0 0 160 0.74%Social Sciences 20 5 1 17 3 1 45 13 0 17 19 6 147 0.68%Info Tech 21 1 23 9 17 1 2 3 0 0 0 0 77 0.36%Material Science 3 0 25 0 27 0 0 0 0 0 0 0 55 0.25%Math Science 9 0 10 0 34 0 0 2 0 0 0 0 55 0.25%Law 6 0 1 5 0 0 20 1 0 9 2 0 44 0.20%Earth Science 4 0 27 2 4 0 0 1 0 0 0 0 38 0.18%
14,999 2,135 1,091 673 450 429 417 364 348 323 289 116 21,634 100.00%69.33% 9.87% 5.04% 3.11% 2.08% 1.98% 1.93% 1.68% 1.61% 1.49% 1.34% 0.54% 100.00%
Faculty Use of Electronic Journals: School by Journal Topic 21,634 article views]
Building Frameworks of Organizational Intelligence
Faculty Use of Electronic Journals: School by Journal Topic – Aggregated [21,634 article views]
Subjects
Faculties
Science Social Sci Humanities
Science 94.5% 51.8% 27.2%
Social Sci 3.0% 24.2% 15.0%
Humanities 2.5% 24.0% 57.9%
100.0% 100.0% 100.0%
Building Frameworks of Organizational Intelligence
Faculty Use of Electronic Journals: Correlation by School [pearson r | 21,634 article views]
MED NURS ENGRNG WHRTN EDUCN SOC WRK DENTAL VET COMMN SAS-HUM SAS-SSci SAS-SCI
MED 1.000
NURS 0.995 1.000
ENGRNG 0.337 0.258 1.000
WHRTN 0.082 0.114 -0.011 1.000
EDUCN 0.142 0.178 -0.088 0.084 1.000
SOC WRK 0.884 0.910 0.113 0.155 0.532 1.000
DENTAL 0.997 0.985 0.393 0.066 0.120 0.863 1.000
VET 0.965 0.961 0.291 0.044 0.184 0.861 0.962 1.000
COMMN 0.829 0.863 0.060 0.272 0.604 0.986 0.802 0.810 1.000
SAS-HUM 0.152 0.189 -0.085 0.082 0.991 0.535 0.131 0.190 0.603 1.000
SAS-SSci 0.943 0.953 0.267 0.173 0.455 0.972 0.931 0.924 0.954 0.462 1.000
SAS-SCI 0.745 0.687 0.722 -0.052 0.020 0.521 0.789 0.783 0.448 0.018 0.661 1.000
10-1-2
Dimension 1
1.0
0.5
0.0
-0.5
-1.0
-1.5
-2.0
Dim
ensi
on 2
SAS_SCI
SAS_SS
SAS_HUM
ANBERG
VET
DENTAL
SOCIAL_WORKEDUCATION
WHARTON
ENGINEERING
NURSINGMEDICAL
Euclidean distance model
Building Frameworks of Organizational Intelligence
Faculty Use of Electronic Journals: Multi-Dimensional Scaling Model
0200400600800
100012001400160018002000
2002 2003 2004 2005 2006 2007
Coun
t of R
eque
sts
Consortial Borrowing Activity: Class PN1993-1999, Motion Pictures 2002-2007
Building Frameworks of Organizational Intelligence
Pct o
f Req
uest
Pct of Titles
20% of titles account for nearly 50% of requests
Building Frameworks of Organizational Intelligence
Consortial Borrowing Activity: Class PN1993-1999, Motion Pictures [7,512 requests, 1999-Dec 2008]
Borrower Lender Req DateCornell Dartmouth 2003Brown Penn 2003Princeton Dartmouth 2003Brown Cornell 2003Princeton Dartmouth 2003Princeton Dartmouth 2003Princeton Cornell 2003Yale Dartmouth 2003Princeton Penn 2004Penn Dartmouth 2004Yale Brown 2004Penn Yale 2004Cornell Dartmouth 2004Columbia Dartmouth 2005Princeton Columbia 2005Yale Dartmouth 2005Penn Dartmouth 2005Dartmouth Columbia 2005Brown Dartmouth 2006Columbia Dartmouth 2006Princeton Dartmouth 2006Penn Yale 2006Penn Princeton 2006Columbia Brown 2006Cornell Yale 2006Princeton Columbia 2007Cornell Columbia 2007
Building Frameworks of Organizational Intelligence
The Emergence of Cinematic Time
PN1995.5 T55 D63 2002
Summary:
Exploring new frameworks that enrich organizational intelligence.
Taking advantage of xml extensibility to increase the descriptive power of library data resources.
Aligning management information technology with the broader direction in digital library design.
Evaluating the potential for shared, open-source solutions thatmight promote collaborative data gathering and assessment.
Building Frameworks of Organizational Intelligence
Joe [email protected] 215-573-4643
University of Pennsylvania Library Office of Planning and Communication
Questions?
Building Frameworks of Organizational Intelligence