Date post: | 09-May-2015 |
Category: |
Technology |
Upload: | jim-geovedi |
View: | 14,443 times |
Download: | 1 times |
WALUKUANSWERING ASTRONOMY QUESTIONS THROUGH SOCIAL MEDIAYAMANI / GEOVEDI / SOEGIJOKO
langitselatanBandung, Indonesia. Near the Bosscha observatory.
Premiere online Astronomy media house since 2007.Astronomy news, answering hoaxes and providing, basic astronomy, educational resources and fun science
Social media in Indonesia• Facebook and Twitter the numbers matter.
• Internet in Indonesia is nearly there with its penetration at 50% and growing.
• Mobile telephony is at 100% of population with 40% of mobiles are internet capable.
Social media by numbers
Waluku
WalukuSummary: Twitter chatbot that heavily uses natural language equipped with closed-domain (Astronomy) knowledge.Why? Because asking questions is one of the most basic human norm. Because social media is cool. Because astronomy is cool. Because artificial intelligence is cool. Because giving answer “Google it” is considered rude.
WalukuWaluku Q&A chatbot runs on Twitter platform.
System overview
Knowledge Base
Input Analysis Module
Response Generator
Q&A Module
Unstructured Documents
User Input
Response
Crowdsourcing Framework
User inputChallenge: People do not check whether their question has been asked before therefore they will ask the same question using different wording.
User input
challenge: same question, different wording
Input analysisInput Extracted keywords Ranks
Bagaimana bulan sabit dapat terjadi? bulan sabit, bulan 0.89212
Apa penyebab terjadinya bulan sabit? bulan sabit, bulan, penyebab 0.75419
Apakah wajah bulan akan selalu sama? wajah bulan, bulan 0.64021
Jelaskan proses terjadinya bulan sabit? bulan sabit, proses 0.65993
Phrase similaritybagaimana mengapa planet galaksi bulan twitter
mengapa kenapa mars galaxy neil amstrong twit
apa penyebab apa venus andromeda bulan sabit tweet
apa yang menyebabkan knapa jupiter bima sakti bulan
purnama tuit
proses terjadinya ngapa merkurius milky way bulan merah
jambu ngetwit
Response generationSources: langitselatan’s Tanya Jawab website section, astronomy-related Wikipedia articles and volunteer provided question and answer.
Raw unstructured contents will be automatically summarized (factoid extraction) by NLP (Natural Language Processing) engine and will be saved to the database as utterance pair (question and answer).
Response formats: Summarized factoids (less than 500 characters and contain URLs) and Twitter-friendly messages (140 characters or less).
Unstructured documents
Unstructured documents
Factoid extraction
Periode rotasi Bulan tidak sama dengan periode rotasi Bumi. Periode rotasi Bumi adalah 24 jam (1 hari), sementara periode rotasi Bulan adalah 27.3 hari.
Wajah bulan yang dilihat oleh seluruh manusia di Bumi, baik di Indonesia maupun di belahan Bumi lainnya selalu nampak sama.
Periode rotasi Bumi adalah 24 jam (1 hari), sementara periode rotasi Bulan adalah 27.3 hari.
Wajah bulan selalu nampak sama.
Raw text
Extracted factoids
Utterance pairA Concept fase bulan
B Question • Mengapa bulan berbentuk sabit?• Bagaimana bulat sabit bisa terjadi?• Bagaimana bulan sabit dapat terjadi?• Apa penyebab terjadinya bulan sabit?• Apakah wajah bulan akan selalu sama?• Jelaskan proses terjadinya bulan sabit?
C Answer (long)
Fase Bulan (sabit maupun yang lain) terjadi karena kita di Bumi mengamati sinar Matahari jatuh ke Bulan pada sudut pandang yang berbeda-beda.
Lebih lanjut, lihat http://langitselatan.com/2012/05/27/apakah-wajah-bulan-selalu-sama/
D Answer (short)
Itu terjadi karena kita di Bumi mengamati pada sudut pandang yang berbeda-beda. http://goo.gl/i5MrxA
CrowdsourcingTechnology limitation. NLP is still considered a hard task (to make long sentences short, to extract factoids, etc). Constant training and tweaking are required.
Quality improvement. Help find an adequate response to user input.
Design limitationWaluku is a factoid chatbot.It will not be able to handle casual chat input.
NLP is language dependent.Indonesian NLP initiatives and support are very limited. We have to roll our own approach.
StatusStill work in progress.
Thank You!