of 20
8/3/2019 Management Support Systems- Advanced Intelligent Systems
1/20
Page 1
Advanced Intelligent Systems
Prof. Rushen Chahal 12-1
Prof. Rushen Chahal
8/3/2019 Management Support Systems- Advanced Intelligent Systems
2/20
Page 2
Learning Objectives
Understand second-generation intelligentsystems.
Learn the basic concepts and applications ofcase-based systems.
Understand the uses of artificial neural networks.
Examine the advantages and disadvantages ofartificial neural networks.
Learn about genetic algorithms.
Examine the theories and applications of fuzzyknowledge.
Prof. Rushen Chahal 12-2
8/3/2019 Management Support Systems- Advanced Intelligent Systems
3/20
Page 3
Household Financials Vision Speeds Loan
Approvals With Neural Networks Vignette
Loan product regulation varies in each state
Develop an object-oriented loan approval system Neural network-based
Fed risk, interest rate variables, customer data
Estimates credit worthiness, potential for fraud
Pattern recognition
Integrates all loan approval phases
Uses intelligent underwriting engine
Reduced training time and administrative overhead
Decreased managed basis efficiency ratio Upgradeable to web-based architecture
Prof. Rushen Chahal 12-3
8/3/2019 Management Support Systems- Advanced Intelligent Systems
4/20
Page 4
Machine Learning
Acquisition of knowledge through historical
examples
Implicitly induces expert knowledge from history
Different from the way that humans learn
Implications of system success and failure
unclear
Manipulates of symbols instead of numbers
Prof. Rushen Chahal 12-4
8/3/2019 Management Support Systems- Advanced Intelligent Systems
5/20
Page 5
Methods
Supervised learning Induce knowledge from known outcomes
New cases used to modify existing theories
Statistical methods
Rule induction Case based and inference
Neural computing
Genetic algorithms leading to survival of fittest
Unsupervised learning
Determine knowledge from data with unknown outcomes Clustering data into similar groups
Neural computing
Genetic algorithms leading to survival of fittest
Prof. Rushen Chahal 12-5
8/3/2019 Management Support Systems- Advanced Intelligent Systems
6/20
Page 6
Case Reasoning
Inductive
Case base used for decision-making
Effective when rule-based reasoning is not Case
Primary knowledge element Ossified
Paradigmatic Stories
Prof. Rushen Chahal 12-6
8/3/2019 Management Support Systems- Advanced Intelligent Systems
7/20
Page 7Prof. Rushen Chahal 12-7
8/3/2019 Management Support Systems- Advanced Intelligent Systems
8/20
8/3/2019 Management Support Systems- Advanced Intelligent Systems
9/20
Page 9Prof. Rushen Chahal 12-9
8/3/2019 Management Support Systems- Advanced Intelligent Systems
10/20
8/3/2019 Management Support Systems- Advanced Intelligent Systems
11/20
Page 11
Human Brain
50 to 150 billion neurons in brain
Neurons grouped into networks Axons send outputs to cells
Received by dendrites, across synapses
Prof. Rushen Chahal 12-11
8/3/2019 Management Support Systems- Advanced Intelligent Systems
12/20
Page 12
Neural Networks
Attempts to mimic brain functions
Analogy, not accurate model
Artificial neurons connected in network Organized by topologies Structure
Three or more layers
Input, intermediate (one or more hidden layers), output Receives modifiable signals
Prof. Rushen Chahal 12-12
8/3/2019 Management Support Systems- Advanced Intelligent Systems
13/20
8/3/2019 Management Support Systems- Advanced Intelligent Systems
14/20
8/3/2019 Management Support Systems- Advanced Intelligent Systems
15/20
Page 15
Network Learning
Learning algorithms Supervised
Connection weights derived from known cases
Pattern recognition combined with weighting changes
Back error propagation Easy implementation
Multiple hidden layers
Adjust learning rate and momentum
Known patterns compared to output and allows for weight adjustment
Established error tolerance
Unsupervised
Only stimuli shown to network Humans assign meanings and determine usefulness
Adaptive resonance theory
Kohonen self-organizing feature maps
Prof. Rushen Chahal 12-15
8/3/2019 Management Support Systems- Advanced Intelligent Systems
16/20
Page 16
Development of Systems
Collect data The more, the better
Separate data into training set to adjust weights
Divide into test sets for network validation
Select network topology Determine input, output, and hidden nodes, and hidden layers
Select learning algorithm and connection weights
Iterative training until network achieves preset error level
Black box testing to verify inputs produce appropriate outputs Contains routine and problematic cases
Implementation Integration with other systems User training
Monitoring and feedback
Prof. Rushen Chahal 12-16
8/3/2019 Management Support Systems- Advanced Intelligent Systems
17/20
Page 17
Genetic Algorithms
Computer programs that apply processes ofevolution Viability of candidate solutions
Self-organized
Adaptable
Fitness function Measured by objective obtained
Iterative process Candidate solutions combine to produce generations
Reproduction, crossover, mutation
Prof. Rushen Chahal 12-17
8/3/2019 Management Support Systems- Advanced Intelligent Systems
18/20
Page 18
Genetic Algorithms
Establish problem Parameters
Number of initial solutions, number of offspring, number of parentsand offspring for each generation, mutation level, probabilitydistribution of crossover point occurrence
Generate initial set of solutions Compute fitness functions
Total all fitness functions
Compare each solutions fitness function to total
Apply crossover
Apply random mutation
Repeat until good enough solution or no improvement
Prof. Rushen Chahal 12-18
8/3/2019 Management Support Systems- Advanced Intelligent Systems
19/20
Page 19Prof. Rushen Chahal 12-19
8/3/2019 Management Support Systems- Advanced Intelligent Systems
20/20
Page 20
Fuzzy Logic
Mathematical theory of fuzzy sets
Imprecise thinking
Describes human perception
Continuous logic Not 100% true or false, black or white
Fuzzy neural networks Fuzzification
Fuzzy logic applied to input and output used to create model
Defuzzification Model converted back to original input, output scales
Output becomes input for another intelligent system
Prof. Rushen Chahal 12-20