Date post: | 24-Dec-2015 |
Category: |
Documents |
Upload: | harinisanthosh |
View: | 233 times |
Download: | 3 times |
Self-organizing Self-organizing MapsMapsKevin PangKevin Pang
GoalGoal
Research SOMsResearch SOMs Create an introductory tutorial on Create an introductory tutorial on
the algorithmthe algorithm Advantages / disadvantagesAdvantages / disadvantages Current applicationsCurrent applications Demo programDemo program
Self-organizing MapsSelf-organizing Maps
Unsupervised learning neural Unsupervised learning neural networknetwork
Maps multidimensional data onto a 2 Maps multidimensional data onto a 2 dimensional griddimensional grid
Geometric relationships between Geometric relationships between image points indicate similarityimage points indicate similarity
AlgorithmAlgorithm
Neurons arranged in a 2 dimensional gridNeurons arranged in a 2 dimensional grid Each neuron contains a weight vectorEach neuron contains a weight vector
Example: RGB valuesExample: RGB values
Algorithm (continued…)Algorithm (continued…)
Initialize weightsInitialize weights RandomRandom PregeneratedPregenerated
Iterate through inputsIterate through inputs For each input, find the “winning” For each input, find the “winning”
neuronneuron Euclidean distanceEuclidean distance
Adjust “winning” neuron and its Adjust “winning” neuron and its neighborsneighbors GaussianGaussian Mexican hatMexican hat
Optimization TechniquesOptimization Techniques
Reducing input / neuron Reducing input / neuron dimensionalitydimensionality Random Projection methodRandom Projection method
Pregenerating neuron weightsPregenerating neuron weights Initialize map closer to final stateInitialize map closer to final state
Restricting “winning” neuron searchRestricting “winning” neuron search Reduce the amount of exhaustive Reduce the amount of exhaustive
searchessearches
ConclusionsConclusions
AdvantagesAdvantages Data mapping is easily interpretedData mapping is easily interpreted Capable of organizing large, complex data Capable of organizing large, complex data
setssets DisadvantagesDisadvantages
Difficult to determine what input weights to Difficult to determine what input weights to useuse
Mapping can result in divided clustersMapping can result in divided clusters Requires that nearby points behave Requires that nearby points behave
similarlysimilarly
Current ApplicationsCurrent Applications
WEBSOM: Organization of a Massive WEBSOM: Organization of a Massive Document CollectionDocument Collection
Current Applications Current Applications (continued)(continued)
Phonetic Phonetic TypewriterTypewriter
Current Applications Current Applications (continued)(continued)
Classifying World PovertyClassifying World Poverty
Demo ProgramDemo Program
Written for Windows with GLUT Written for Windows with GLUT supportsupport
Demonstrates the SOM training Demonstrates the SOM training algorithm in actionalgorithm in action
Demo Program DetailsDemo Program Details
Randomly initialized mapRandomly initialized map 100 x 100 grid of neurons, each 100 x 100 grid of neurons, each
containing a 3-dimensional weight containing a 3-dimensional weight vector representing its RGB valuevector representing its RGB value
Training input randomly selected Training input randomly selected from 48 unique colorsfrom 48 unique colors
Gaussian neighborhood functionGaussian neighborhood function
ScreenshotsScreenshots
Questions?Questions?