1
3. Signals Diversity Social Signals: Any Impacts in Search? Information Retrieval, Social Signals, Popularity, Reputation, Freshness, Diversity, Ranking ► Context: Exploiting social signals to enhance a search. Do the quality, temporality and diversity of signals matter to capture relevant documents? ► Research Questions: How to estimate the popularity and reputation of a resource using social signals? What is the impact of signals diversity and signals freshness on IR system? How to normalize signals with resource age? 1. Introduction Temporality Diversity Origin Nature Rating 5 4 3 2 1 Signification Ismail Badache and Mohand Boughanem IRIS Team - IRIT - Paul Sabatier University, Toulouse {Badache, Boughanem}@irit.fr ► Signals freshness in a resource ► Signals normalization with resource age 4. Time-Aware Signals 2. Signals and Properties 5. Experimental Evaluation Baselines 0,0487 0,0517 0,05 Lucene Solr BM25 ML.Hiemstra Facebook 0,0689 0,0711 0,0678 0,0559 0,0531 Like Share Comment Rating Tag Social Signals Individually +23% +27% +21% +11% +5% Social Signals Grouped 0,0791 0,078 0,0801 0,0787 0,0888 TotalFB Popularity Reputation AllCriteria AllProperties +55% +41% +41% +38% +43% Reputation AllProperties Resource Age 0,0708 0,0796 0,0711 0,0695 0,058 Like Share Comment Rating Tag +5% +19% +4% +12% +3% Date of Signal 0,0732 Rating +31% 0,1223 0,11 0,1114 0,1301 Naïve Bayes (CFS) Naïve Bayes (WRP) SVM (SVM) J48 (RLF) +132% +99% +96% +118% Machine Learning (Signals) Time-Aware Signals 0,084 0,0862 0,0891 0,0915 0,0976 TotalFB Popularity Reputation AllCriteria AllProperties Signals Diversity +11% +10% +16% ► Dataset: - INEX Social Book Search 2015. - 208 INEX SBS Topics and their relevance judgments. Property Social signal Social Network Popularity Number of Comment Facebook Number of Share Facebook Number of Tag Amazon/LT Reputation Number of Like Facebook Number of Rating Amazon/LT Table 1. Exploited social signals in quantification
