I2R-NUS-MSRA at TAC 2011: Entity Linkingyanchuan.sg/assets/papers/zhang2011nus-slides.pdf · A Two...

A Two Tier Framework for Context-Aware Service Organization & Discovery

Wei Zhang1, Jian Su2, Bin Chen2,WentingWang2, Zhiqiang Toh2, Yanchuan Sim2, Yunbo Cao3, Chin Yew Lin3 and Chew Lim Tan1

1 National University of Singapore

Text Analysis Conference, November 14-15, 2011

I2R-NUS-MSRA at TAC 2011: Entity Linking

2 Institute for Infocomm Research

3 Microsoft Research Asia


Outline

Text Analysis Conference, November 14-15, 2011 2


Ø I2R-NUS team at TAC Ø incorporate the new technologies proposed in our recent papers (IJCAI 2011, IJCNLP 2011)

Ø Acronym Expansion Ø Semantic Features Ø Instance Selection

Ø Investigate three algorithms for NIL query clustering Ø Spectral Graph Partitioning (SGP) Ø Hierarchical Agglomerative Clustering (HAC) Ø Latent Dirichlet allocation (LDA) Ø  Combination system

Ø Offline Combination with the system of MSRA team at KB linking step


Outline






Ø Combine with the system of MSRA team at KB linking step


Acronym Expansion - Motivation



Ø Expanding an acronym from its context to reduce the ambiguities of a name Ø  E.g.TSE in Wikipedia refers to 33 entries Vs. Tokyo Stock Exchange is unambiguous.


Step 1 – Find Expansion Candidates



Identifying Candidate Expansions (e.g. for ACM)


Step 2 – Candidate Expansions Ranking



Ø Using SVM classifier to rank the candidates Ø Our SVM based acronym expansion

Ø can handle link acronyms and full strings in the different sentences in the articles

Ø Number of common characters between acronym and leading character of the expansion.

Ø  can handle acronym with swapped letters. Ø E.g. Communist Party of China Vs. CCP Ø Sentence distance between acronym and expansion


Outline








Related Work on Context Similarity

The 5th International Joint Conference on Natural Language Processing, November 8-13, 2011, Chiang Mai, Thailand 8

A Wikipedia-LDA Model for Entity Linking with Batch Size Changing Instance Selection ��

Ø  Zhang et al., 2010; Zheng et al., 2010; Dredze et al., 2010 Ø  Term Matching Ø However, 1) Michael Jordan is a leading researcher in machine learning

and artificial intelligence. 2) Michael Jordan is currently a full professor at the University

of California, Berkeley. 3) Michael Jordan (born February, 1963) is a former American

professional basketball player. 4) Michael Jordan wins NBA MVP of 91-92 season.

No Term Match


Our System - A Wikipedia-LDA model



1) Michael Jordan is a leading researcher in machine learning and artificial intelligence.

2) Michael Jordan is currently a full professor at the University of California, Berkeley.

3) Michael Jordan (born February, 1963) is a former American

professional basketball player. 4) Michael Jordan wins NBA MVP of 91-92 season. Topic:

Basketball

Topic: Science


Wikipedia – LDA Model



P( word i | category j)

Document P( category i | document j)

Document

0

0.2

0.4

0.6

0.8

1

…

…


Wikipedia – LDA Model



1) Michael Jordan is a leading

researcher in machine learning and artificial intelligence.

2) Michael Jordan is currently a full professor at the University of California, Berkeley.

3) Michael Jordan (born February, 1963) is a former American professional basketball player.

4) Michael Jordan wins NBA MVP of 91-92 season.


Outline








Related Work



Ø Vector Space Model Ø Difficult to combine bag of words (BOW) with other features. Ø Performance needs to be improved

Ø Supervised Approaches Ø Using manual annotated training instances

Ø Dredze et al., 2010; Zheng et al., 2010

Ø Using automatically generated training instances Ø Zhang et al. 2010


Related Work



Ø Auto-generate training instance (Zhang et al., 2010)

(News Article) Obama Campaign Drops The George W. Bush Talking Point …


Related Work



Ø From “George W. Bush” articles

Ø No positive instances for “George H. W. Bush” “George P. Bush” and “George Washington Bush” generated Ø No negative instances for “George W. Bush” generated

Ø Such positive negative training instance distributions may not be the same with the original ambiguous cases in the raw text collection

Ø The distribution of the unambiguous mentions may not be the same in test data


The Approach in Our System



Ø An instance selection approach Ø Select an informative, representative, and diverse subset from the auto-generated data set. Ø Reduce the effect of the distribution differences


Instance Selection



Small Initial data set

training SVM Classifier

Test on auto-generated

data set

2-D data set Illustration

SVM hyperplane

Select Informative, representative and diverse Instances

Add these selected instances to Initial data set


Outline








Ø Advantages over other clustering techniques Ø Globally optimized results Ø Efficient in time and space Ø Generally, produce a better result

Ø Success in many areas Ø Image segmentation Ø Gene expression clustering

Spectral Clustering


Spectral Clustering

A = QɅQ-1

Ø Eigen Decomposition on Graph Laplacian Ø Dimensionality Reduction Ø  (Luxburg, 2006)

George W. Bush

George H.W. Bush


Hierarchical Agglomerative Clustering



Ø Convert a doc into a feature vector: Wikipedia concepts, bag-of-words and named entities.

Ø Estimate the weight of each feature using Query Relevance Weighting Model (Long and Shi, 2010):

Ø  this model shows good performance in Web People Search Ø In our work, original query name, its Wikipedia redirected names and its coreference chain mentions are all considered as appearances of the query name in the text.

Ø Similarity scores : cosine similarity and overlap similarity.


Hierarchical Agglomerative Clustering



Ø Docs referred to the same entity are clustered according to doc pair-wise similarity scores. Ø Start with singleton: each doc is a cluster Ø If there are two docs D and D' in clusters Ci and Cj respectively:

Two clusters Ci and Cj are merged to form a new cluster Cij

if Sim(D,D' ) > γ

Calculate the similarity between the new cluster Cij and all remaining

clusters

γ = 0.25


Latent Dirichlet Allocation (LDA)



Ø LDA has been applied to many NLP tasks such as: summarization and text classification

Ø  In our approach, the learned topics can represent the underlying entities of the ambiguous names

Ø Generative story:



I2R-NUS-MSRA at TAC 2011: Entity Linking ��

Ø Three classes SVM classifier to decide which system to be trusted

Ø Features: scores given by the three systems

Three Clustering Systems Combination

Combine with the system of MSRA team at KB linking step

Ø Binary SVM classifier to decide which system to be trusted Ø Features: scores given by the two systems


Experiment for Three Clustering Algorithms



Algorithms Eval 09 Eval 10 Eval 10+

SGP 0.745 0.954 0.809

HAC 0.666 0.950 0.789

LDA 0.782 0.981 0.841

Combination 0.795 0.982 0.852


Submissions



Systems Acc. Precision Recall F1

Full 0.863 0.815 0.849 0.831

Partial 0.844 0.797 0.829 0.813

Highest - - - 0.846

Median - - - 0.716


Conclusion



Ø Incorporate the new technologies proposed in our recent papers (IJCAI 2011, IJCNLP 2011)


Ø Investigate three algorithms for NIL query clustering

Ø Spectral Graph Partitioning (SGP) Ø Hierarchical Agglomerative Clustering (HAC) Ø Latent Dirichlet allocation (LDA)

Date post:	26-Dec-2019
Category:	Documents
Upload:	others
View:	0 times
Download:	0 times

I2R-NUS-MSRA at TAC 2011: Entity Linkingyanchuan.sg/assets/papers/zhang2011nus-slides.pdf · A Two...

Documents