The Deep Web -- From Spooky to Creepy

Wisconsin Union DirectorateThe Deep Web—From Spooky to

CreepyPresented by Nicholas Davis, CISSP,

CISA

This presentation contains explicit content, which some people may find

offensive.The examples shown do not represent

my views or opinions, and are used for demonstration only.

I do not endorse the use of the Deep Web for unethical or illicit activities.

04/13/23 UNIVERSITY OF WISCONSIN 2

Session OverviewSession OverviewIntroduction and WarningThe Deep Web DefinedDynamic ContentUnlinked ContentPrivate WebContextual WebLimited Access ContentScripted ContentNon-HTML ContentDeep Web Search Engines & Tor ClientExamples of what can found on the Deep WebExciting Documentary VideoQuestion and Answer session


Some DefinitionsSome DefinitionsDeep Web, Deep Net, Invisible Web, or Hidden Web is not part of the Surface Web (that which is normally accessed).Do not confuse it with the Dark Internet, which refers to computers which can no longer be reached over the InternetSome people think that the Deep Web is a haven for serious criminality, and I agree with them


Normal Web SearchNormal Web Searchvs. Deep Web Searchvs. Deep Web Search

Searching on the Internet today can be compared to dragging a net across the surface of the ocean: a great deal may be caught in the net, but there is a wealth of information that is deep and therefore missed


Normal Web SearchNormal Web Searchvs. Deep Web Searchvs. Deep Web Search

Traditional search engines cannot see or retrieve content in the deep Web—those pages do not exist until they are created dynamically as the result of a specific search. As of 2001, the deep Web was several orders of magnitude larger than the surface Web


Deep Web SizeDeep Web SizeIt is impossible to measure or put estimates onto the size of the deep web because the majority of the information is hidden or locked inside databases. Early estimates suggested that the deep web is 4,000 to 5,000 times larger than the surface web04/13/23 UNIVERSITY OF WISCONSIN 7

Deep Web ResourcesDeep Web ResourcesDynamic ContentDynamic Content

Dynamic pages which are returned in response to a submitted query or accessed only through a form, especially if open-domain input elements (such as text fields) are used; such fields are hard to navigate without domain knowledge.


Deep Web ResourcesDeep Web ResourcesUnlinked ContentUnlinked Content

Unlinked content: pages which are not linked to by other pages, which may prevent Web crawling programs from accessing the content. This content is referred to as pages without backlinks (or inlinks).


Deep Web ResourcesDeep Web ResourcesPrivate WebPrivate Web

Private Web: sites that require registration and login (password-protected resources).


Deep Web ResourcesDeep Web ResourcesContextual WebContextual Web

Contextual Web: pages with content varying for different access contexts (e.g., ranges of client IP addresses or previous navigation sequence).


Deep Web ResourcesDeep Web ResourcesLimited Access ContentLimited Access ContentLimited access content: sites that limit access to their pages in a technical way (e.g., using the Robots Exclusion Standard or CAPTCHAs, or no-store directive which prohibit search engines from browsing them and creating cached copies


Deep Web ResourcesDeep Web ResourcesScripted ContentScripted Content

Scripted content: pages that are only accessible through links produced by JavaScript as well as content dynamically downloaded from Web servers via Flash or Ajax solutions.


Deep Web ResourcesDeep Web ResourcesNon HTML ContentNon HTML Content

Non-HTML/text content: textual content encoded in multimedia (image or video) files or specific file formats not handled by search engines.


Accessing the Deep WebAccessing the Deep Web

While it is not always possible to discover a specific web server's external IP address, theoretically almost any site can be accessed via its IP address, regardless of whether or not it has been indexed.


Accessing the Deep WebAccessing the Deep WebCertain content is intentionally hidden from the regular internet, accessible only with special software, such as Tor. Tor allows users to access websites using the .onion host suffix anonymously, hiding their IP address. Other such software includes I2P and Freenet.


The Onion Router (Tor)The Onion Router (Tor)Tool For the Deep WebTool For the Deep WebTor is software that installs into your browser and sets up the specific connections you need to access dark Web sites. Critically, Tor is an encrypted technology that helps people maintain anonymity online. It does this in part by routing connections through servers around the world, making them much harder to track.


Who Invented Tor?Who Invented Tor?Oddly enough, Tor is the result of research done by the U.S. Naval Research Laboratory, which created Tor for political dissidents and whistleblowers, allowing them to communicate without fear of reprisal.


Tor Client AvailableTor Client AvailableFor DownloadFor Download


Accessing the Deep WebAccessing the Deep Web.onion.onion

.onion is a pseudo-top-level domain host suffix designating an anonymous hidden service reachable via the Tor network. Such addresses are not actual DNS names, and the .onion TLD is not in the Internet DNS root, but with the appropriate proxy software installed, Internet programs such as Web browsers can access sites with .onion addresses by sending the request through the network of Tor servers. 04/13/23 UNIVERSITY OF WISCONSIN 20

Accessing the Deep WebAccessing the Deep WebTor2web


What Deep Web LinksWhat Deep Web LinksLook LikeLook Like

Deep Web links appear as a random string of letters followed by the .onion TLD. For example, http://xmh57jrzrnw6insl followed by .onion, links to TORCH, the Tor search engine web page.


Searching the Deep WebSearching the Deep WebTo discover content on the Web, search engines use web crawlers that follow hyperlinks through known protocol virtual port numbers. This technique is ideal for discovering resources on the surface Web but is often ineffective at finding Deep Web resources.


Give the People What TheyGive the People What TheyCame Here For, Tonight!Came Here For, Tonight!

Just like general web search, searching the Invisible Web is also about looking for the needle in the haystack. Only here, the haystack is much bigger. The Invisible Web is definitely not for the casual searcher. It is a deep but not dark because if you know what you are searching for, enlightenment is a few keywords away.


Deep Web SearchDeep Web SearchEnginesEngines


Deep Web SearchDeep Web Searchinfomineinfomine

http://infomine.ucr.edu/Infomine has been built by a pool of libraries in the United States. Some of them are University of California, Wake Forest University, California State University, and the University of Detroit. Infomine ‘mines’ information from databases, electronic journals, electronic books, bulletin boards, mailing lists, online library card catalogs, articles, directories of researchers, and many other resources.


Deep Web SearchDeep Web SearchThe WWW Virtual LibraryThe WWW Virtual Library

http://vlib.org/This is considered to be the oldest catalog on the web and was started by started by Tim Berners-Lee, the creator of the web. So, isn’t it strange that it finds a place in the list of Invisible Web resources? Maybe, but the WWW Virtual Library lists quite a lot of relevant resources on quite a lot of subjects.


Deep Web SearchDeep Web SearchComplete PlanetComplete Planet

http://aip.completeplanet.com/Complete Planet calls itself the ‘front door to the Deep Web’. This free and well designed directory resource makes it easy to access the mass of dynamic databases that are cloaked from a general purpose search. The databases indexed by Complete Planet number around 70,000 and range from Agriculture to Weather. Also thrown in are databases like Food & Drink and Military.For a really effective Deep Web search, try out the Advanced Search options where among other things, you can set a date range.04/13/23 UNIVERSITY OF WISCONSIN 28

Deep Web SearchDeep Web SearchDeepPeepDeepPeep

http://www.deeppeep.org/DeepPeep aims to enter the Invisible Web through forms that query databases and web services for information. Typed queries open up dynamic but short lived results which cannot be indexed by normal search engines. By indexing databases, DeepPeep hopes to track 45,000 forms across 7 domains.The domains covered by DeepPeep (Beta) are Auto, Airfare, Biology, Book, Hotel, Job, and Rental. Being a beta service, there are occasional glitches as some results don’t load in the browser.


Deep Web SearchDeep Web SearchIncyWincyIncyWincy

http://www.incywincy.com/IncyWincy is an Invisible Web search engine and it behaves as a meta-search engine by tapping into other search engines and filtering the results. It searches the web, directory, forms, and images. With a free registration, you can track search results with alerts.


Deep Web SearchDeep Web SearchDeepWebTechDeepWebTech

http://www.deepwebtech.com/DeepWebTech gives you five search engines (and browser plugins) for specific topics. The search engines cover science, medicine, and business. Using these topic specific search engines, you can query the underlying databases in the Deep Web.


Deep Web SearchDeep Web SearchScirusScirus

http://www.scirus.com/srsapp/Scirus has a pure scientific focus. It is a far reaching research engine that can scour journals, scientists’ homepages, courseware, pre-print server material, patents and institutional intranets.


Deep Web SearchDeep Web SearchTechXtraTechXtra

http://www.techxtra.ac.uk/index.htmlTechXtra concentrates on engineering, mathematics and computing. It gives you industry news, job announcements, technical reports, technical data, full text eprints, teaching and learning resources along with articles and relevant website information.


Bitcoin, The Currency of theBitcoin, The Currency of theDeep WebDeep Web

• While not completely anonymous, when used correctly, it is very difficult to track down the true owner/identity

• Not regulated by any government or corporate entity


Be Careful of What YouBe Careful of What YouSearch For, You Might Just Search For, You Might Just

Find ItFind It


Deep WebDeep WebDangerous WebDangerous Web




Deep Web, Dangerous WebDeep Web, Dangerous WebSteganographySteganography

(ste-g&n-o´gr&-fē) (n.) The art and science of hiding information by embedding messages within other, seemingly harmless messages


















Deep Web Short Deep Web Short DocumentaryDocumentary

https://www.youtube.com/watch?v=HJOSm9Bg7WY


Question and AnswerQuestion and AnswerSessionSession

Happy Halloween!Please Make it Fun and Please

Make it Safe!

I can be reached by email:[email protected], on Facebookhttps://www.facebook.com/nicholas.a.davis



Date post:	17-Jun-2015
Category:	Documents
Upload:	nicholas-davis
View:	434 times
Download:	0 times

The Deep Web -- From Spooky to Creepy

Documents