Date post: | 22-Apr-2015 |
Category: |
Technology |
Upload: | wcu-webometrics-institute |
View: | 1,212 times |
Download: | 0 times |
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Understanding WeboNaver: API-based search tool for the Naver search engine
Han Woo PARKAssociate Professor
Dept of Media & Communication, YeungNam University, S.KoreaDirector of WCU Webometrics Institute
http://english-webometrics.yu.ac.kr [email protected]
http://www.hanpark.net
Se Jung ParkPh.D. Student, Dept of Media and Communication, YeungNam University. S.Korea
David StuartHonorary Research Fellow, Statistical Cybermetrics Research Group, University of Wolverhampton, Wulfruna Street, Wolverhampton, UK.
Seung Wook LeeMA Student, Dept of Information and Communication of Engineering, YeungNam University, S.Korea
박한우 , 박세정 , David Stuart, 이승욱 (2010). API 를 활용한 검색 프로그램 WeboNaver 의 이해와 적용 : 18 대 국회의원의 웹 가시성 분석 . Journal of the Korean Data Analysis Society. 11 권 6 호 (B).
2
The purpose of this paper is to introduce the API-based webometrics tool created for the Korean search engine Naver
This non-commercial software is designed to collect large amounts of data automatically and can easily distinguish between different types of information on the web, which was impossible before.
(Image Source: Newsweek, 5 Nov 2007)
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Webonaver (Webometrics Tool for Naver)Webonaver (Webometrics Tool for Naver)
3
Rationale for the Naver
• “Republic of Naver” (Kim & Sohn, 2007)
• CEO Google, 30 May 2007)• “Korea is a great laboratory of the digital age.”
(Eric Schmidt,
• “Korea’s Naver is now the world’s 5th search service provider, behind Google, Yahoo, Baidu and Microsoft.” (The AP, 9 Oct 2007)
(Image Source: Newsweek, 5 Nov 2007)
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
4
Rationale for the Naver
• “Google left behind as Koreans Naver-gate the internet” (Financial Times, 2 Jan 2008)
• “IN SOUTH KOREA People who want to looksomething up on the internet don’t “Google it”. Instead they “ask Naver”. (Economist, 30 Feb 2009)
• Yeon-Ok Lee and Park. H. W., (2008). "The Importance of Search Engines in Digital News Consumption A Comparative Study Between South Korea and the UK". refereed paper presented at the Workshop “Gatekeepers in a Digital Asian-European Media Landscape: The rising structural power of Internet search engines”(2008).
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
5
Component of Naver
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Log-in
The articles title (changing automatically)
The press linkedToday’s issues
Quick menubrowser window
6
Terms of Use
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
7
Interface
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
The interface is fairly self-explanatory:
-Tick or untick to collect either only hit number or the title, URL, and description of the results
- Select which of the search options you want to include
- Click on the '...' button to select the text file that contains the queries you wish to run
- Click 'Run Queries'
The interface is fairly self-explanatory:
-Tick or untick to collect either only hit number or the title, URL, and description of the results
- Select which of the search options you want to include
- Click on the '...' button to select the text file that contains the queries you wish to run
- Click 'Run Queries'
8
Getting an API key
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
URL : http://dev.naver.com/openapi/register**This page need the Login
9
Search query limit
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
API Key
Search query limit per day: 25,000
10
Input file
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
*.txt file must encoded by UTF-8 type
11
Output file
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
When you tick it to collect only hit number, it shows the number of web pages containing search query
Pilot comparison between API and Manual Webpage search
12
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Comparison was done using randomly selected Korean politicians as of 12 Aug 2009
13
• There are always differences between the
API’s results and the normal search results, but these are miniscule differences in comparison with the APIs of Google, Yahoo and Bing
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Pilot comparison between API’s and Manual
14
Output file
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
When you tick it to parse the title, URL, and description of theresults (except for images which doesn’t have) the number of web pages containing search query
15
Issues in multiple hits
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
The multiple hits reflect the numbers displayed in pages of the Naver. It’s not program error. The Webonaver show actual different numbers of the results from the Naver. The last hits show actual results Webonaver can extract. It’s not the only case of the Naver, but also other search engines such as yahoo display different results as an each webpage.
16
Issues in multiple hits example
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
17
Issues in multiple hits example
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
18
Issues in multiple hits example
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
19
Output file
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
The Naver API doesn't provide the real URL. Rather it supplies a 'Naver API’. But, user can visit an actual site when they put the api-based URL to the window browser of the Naver.
•
There are programming and time issues, but there are also issues regarding how service provider responds.
Naver is more protective of handing out API keys, in comparison with yahoo or Bing which provide Open APIs.
It is important that services are not abused.
20
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Ethical issues
Korean National Assembly Members’ web presence
• Web presence of Korean 18th congressman between 27th August and 24th September is automatically collected using WeboNaver at an interval of a week.
• 20 members’ web presence including blog, scholar, news and web documents is visualized.
21
22
• web presence of the term H1N1 is examined using Webonaver. We tested the usability and reliability of this tool.
Queres: 신종플루 (A virus subtype H1N1) 신종 인플루엔자 (Influenza A virus subtype H1N1) 신종인플루엔자 (Influenza A virus subtype H1N1)
• Users can get same results from certain words containing space character and the one without space using WeboNaver.
• But, it can not assume similar words as same. Users should consider which specific data they want to extract before using this tool.
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS Web presence of the term H1N1
23
24
• API-based search tool such as WeboNaver enables researchers to capture massive web data automatically and systemically.
• This software can help researchers improve efficiency of data analysis within a specified timeframe.
• Web data gathered using this tool can also be visualized to describe online trend.
25
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Conclusion
• Mayr, Philipp; Tosques, Fabio (2005).
Google Web APIs - An instrument for webometric analyses? pp. 677-678. In: Ingwersen, Peter; Larsen,Birger (eds.): 10th International Conference of theInternational Society for Scientometrics and informetrics.Stockholm (Sweden)
http://www.ib.hu-berlin.de/~mayr/arbeiten/ISSI2005_Mayr_Toques.pdf
• The project site with the APIs demos is offline thesedays. But they are recovering the demos soon. http://bsd119.ib.hu-berlin.de/%7Eft/
26
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
Reference (Web APIs)
WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS
This tool is publicly available. Please check out WWI official website.http://english-webometrics.yu.ac.kr
27