INTERNATIONAL POLAR YEAR 2007-08INTERNATIONAL POLAR YEAR 2007-08

P.A. Berkman - Science 301:1669 (19 September 2003)

How can digital technologies How can digital technologies enhance information enhance information

management and knowledge management and knowledge discovery in our global society?discovery in our global society?

5000 4000 3000 2000 1000 0 FUTURE

CLAY

PAPYRUS

PAPER

DIGITAL

TIME (years before present)

INF

OR

MA

TIO

N T

RA

NS

PO

RT

INF

OR

MA

TIO

N I

NT

EG

RA

TIO

N

INFORMATION VOLUME

STONE

HISTORY OF INFORMATION THRESHOLDSHISTORY OF INFORMATION THRESHOLDS

INFORMATION ERASINFORMATION ERAS

© 2005 EvREsearch LTD© 2005 EvREsearch LTD

FUTURE0100020003000400050006000

EFFECTIVELY INFINITE INFORMATIONEFFECTIVELY INFINITE INFORMATION

More than 20,000 petabytes of digital information is stored in various media in our world every year – and the rate is growing exponentially

240 terabytes/year

627,000 terabytes/year

427,000 terabytes/year

Print Print MediaMedia

Magnetic Magnetic (Server) (Server)

MediaMedia

Optical Optical (CD –DVD) (CD –DVD)

MediaMedia

Data Source: http://www.sims.berkeley.edu/research/projects/how-much-info/

Film Film Media Media

83 terabytes/year

1,066,000 terabytes/year

Magnetic Magnetic (PC and Tape) (PC and Tape)

MediaMedia

INSTANTANEOUS INFORMATIONINSTANTANEOUS INFORMATION

Data Source: http://www.intel.com

Speed of computer microprocessors is increasing exponentially.

THE CHALLENGE OF OUR DIGITAL ERA THE CHALLENGE OF OUR DIGITAL ERA

Information ResourcesInformation Resources

Relational SchemaRelational Schema

RESPOND TO THE FLOOD OF INFORMATIONRESPOND TO THE FLOOD OF INFORMATION

>80%>80%

<20%<20%

INTEGRATIONINTEGRATION IS PROPORTIONAL TOIS PROPORTIONAL TO GRANULARITYGRANULARITY

PermutationsPermutations

33

1515

ppii=n!/p=n!/pii!(n-p!(n-pii)!)!

255255

A model of the exponentially increasing volume of metadata by simply doubling the number of information granules (data), each of which is half its original size, while the volume of metadata per granule is fixed independent of granule size.

CONCEPT OF INTEGRATIONCONCEPT OF INTEGRATION

OBSERVATIONSOBSERVATIONSInformation has content, context and structure. The notion of Information has content, context and structure. The notion of “unstructured” really means information that is “unmanaged”“unstructured” really means information that is “unmanaged” with conventional technologies (i.e., metadata, markup and with conventional technologies (i.e., metadata, markup and databases). databases).

Databases, metadata and markup provide control for managing Databases, metadata and markup provide control for managing digital information, but they are not convenient. This is why less digital information, but they are not convenient. This is why less than 20% of the available digital records are managed with these than 20% of the available digital records are managed with these technologies (i.e., technologies (i.e., cconventional technologies are not scaleableonventional technologies are not scaleable).).

Search engines are extremely convenient, but provide limited Search engines are extremely convenient, but provide limited control for managing digital information (i.e., long lists of ranked control for managing digital information (i.e., long lists of ranked results conceal relationships within and between digital records). results conceal relationships within and between digital records). The search engine problem is that accessing The search engine problem is that accessing more information more information does not equal more knowledge.does not equal more knowledge.

We already have effectively infinite and instantaneous access to We already have effectively infinite and instantaneous access to digital information. The challenge is no longer access, but being digital information. The challenge is no longer access, but being able to able to objectively integrate information based on user-defined objectively integrate information based on user-defined criteria independent of scale to discover knowledge.criteria independent of scale to discover knowledge.

BORROMEAN RINGSBORROMEAN RINGSThree interlinked circles that Three interlinked circles that represent inseparable parts of represent inseparable parts of the whole. Remove any one the whole. Remove any one ring and the other two fall ring and the other two fall apart. Because of this apart. Because of this property, Borromean Rings property, Borromean Rings have been used as a symbol have been used as a symbol of unity in many fields.of unity in many fields.

THE PHYSICS OF INFORMATIONTHE PHYSICS OF INFORMATION

•Information has three indivisible ingredients – Information has three indivisible ingredients – content,content, context context and and structure. structure. •The ability to automatically utilize the inherent The ability to automatically utilize the inherent structure of information is the threshold in information structure of information is the threshold in information management from hardcopy to digital media. management from hardcopy to digital media.

© 2005 EvREsearch LTD© 2005 EvREsearch LTD

EvREsearch©EvREsearch©

GRANULARITY GRANULARITY MODULEMODULE

INDEX INDEX MODULEMODULE

INTEGRATION INTEGRATION MODULEMODULE

AGGREGATION AGGREGATION MODULEMODULE

DIGITAL DIGITAL RECORDSRECORDS

Digital Integration SystemDigital Integration SystemTMTM – DIGIN – DIGIN®®

Operates by first utilizing the inherent structure or patterns in digital information (text, binary data, or other symbolisms) without requiring an a priori understanding of the content (i.e., content agnostic);

Automatically creates, comprehensively indexes and objectively integrates sets of information (i.e., automated granularity);

Uniquely generates objective relational schema that automatically turn qualitative information into quantitative information without markup, metadata or databases; and,

Provides both convenience and control to manage all types of digital information (“structured” as well as “unstructured”) independent of scale.

INTERNATIONAL APPLICATIONSINTERNATIONAL APPLICATIONS

After Invited Presentation at After Invited Presentation at the Scientific Committee on the Scientific Committee on Antarctic Research (SCAR) Antarctic Research (SCAR) Meeting in Tokyo, Japan - Meeting in Tokyo, Japan - July 2000July 2000

"I really appreciate the "I really appreciate the work you have put in the work you have put in the with the [Antarctic Treaty] with the [Antarctic Treaty] database. I use it almost database. I use it almost weekly. It is a brilliant weekly. It is a brilliant resource that should be resource that should be used by SCAR, COMNAP, used by SCAR, COMNAP, CEP etc. In fact, all output CEP etc. In fact, all output from Treaty groups should from Treaty groups should be in such a system." be in such a system."

Dr. Lee BelbinDr. Lee BelbinConvenor, Joint Committee on Convenor, Joint Committee on Antarctic Data Management Antarctic Data Management

Scientific Committee on Scientific Committee on Antarctic Research (SCAR)Antarctic Research (SCAR)

Council of Managers of Council of Managers of National Antarctic Programs National Antarctic Programs (COMNAP)(COMNAP)

FOR FURTHER READING:FOR FURTHER READING:

http://www.sdsc.edu/NARA/Publications.htmlhttp://www.sdsc.edu/NARA/Publications.html

““Knowledge Knowledge is the is the

common common wealth of wealth of

humanity.”humanity.” Adama SamassekouAdama Samassekou

Convener of the United Nations World Convener of the United Nations World Summit on the Information SocietySummit on the Information Society

RECOMMENDATION

eGY acknowledges that information management with digital technologies still is in its infancy in comparison to the paper, papyrus, clay and stone media that each had been used for millennia to transfer knowledge in our civilization.

eGY identifies that conventional technologies with metadata, markup and databases do scale to the increasing volume of digital information that is being produced.

eGY recognizes that information traditionally has been managed based on its content and context.

eGY further recognizes that all information has inherent structure, which has not been possible to utilize for information management purposes with hardcopy media.

eGY supports innovations that seek to utilize the inherent structure of digital information to automate information management and facilitate discovery of objective relationships within and between information resources.