+ All Categories
Home > Documents > A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d...

A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d...

Date post: 25-Apr-2020
Category:
Upload: others
View: 3 times
Download: 0 times
Share this document with a friend
74
A tifi i l I t lli A It d ti A tifi i l I t lli A It d ti Artificial Intelligence: An Introduction Artificial Intelligence: An Introduction Revised September 2008 Revised September 2008 Byoung-Tak Zhang School of Computer Science and Engineering School of Computer Science and Engineering Graduate Programs in Cognitive Science, Brain Science, and Bioinformatics Seoul National University Seoul National University E-mail: [email protected] http://bi snu ac kr/ http://bi.snu.ac.kr/
Transcript
Page 1: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

A tifi i l I t lli A I t d tiA tifi i l I t lli A I t d tiArtificial Intelligence: An IntroductionArtificial Intelligence: An Introduction

Revised September 2008Revised September 2008

Byoung-Tak Zhang

School of Computer Science and EngineeringSchool of Computer Science and EngineeringGraduate Programs in Cognitive Science, Brain Science,

and BioinformaticsSeoul National UniversitySeoul National University

E-mail: [email protected]://bi snu ac kr/http://bi.snu.ac.kr/

Page 2: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Can Machines Think?Can Machines Think?Can Machines Think?Can Machines Think?

Th T i TThe Turing TestComputing Machinery and Intelligence [Turing, 1950]

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 3: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Chess PlayingChess PlayingChess PlayingChess Playing

G K d D Bl © 1997

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Garry Kasparov and Deep Blue. © 1997

Page 4: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Mars Rover Sojourner:Mars Rover Sojourner: M P hfi d Mi iM P hfi d Mi iMars Rover Sojourner: Mars Rover Sojourner: Mars Pathfinder MissionMars Pathfinder Mission

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 5: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Natural Language ProcessingNatural Language ProcessingNatural Language ProcessingNatural Language Processing

Polysemy4 I keep the money in the bank.4 I walk along the bank of the river4 I walk along the bank of the river.

Ambiguity4Time flies like an arrow4Time flies like an arrow.4 I saw a man with a telescope.

Diversityy4She sold him a book for five dollars.4He bought a book for five dollars from her.

Related Knowledge4Lexical, Grammatical, Situational, Contextual

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 6: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Expert SystemsExpert SystemsExpert SystemsExpert Systems

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 7: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Web Information RetrievalWeb Information RetrievalText Data

Classification System

Cl ifi i

Preprocessing and Indexing

Text Classification

Information Extraction

I f ti Filt i S t

DB Template Filling& InformationExtraction System

Information Filtering

Information Filtering System

questionuser profile

LocationDate

DB Record

Extraction System

question

feedback

answerfiltered data

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

feedbackDB

Page 8: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

What Is Artificial Intelligence (AI)?What Is Artificial Intelligence (AI)?What Is Artificial Intelligence (AI)?What Is Artificial Intelligence (AI)?

Branch of computer science that is concerned with the automation of intelligent behavior.Design and study of computer programs that behave intelligentlyes g a d study o co pute p og a s t at be ave te ge t yStudy of how to make computers do things at which, at the moment, people are better.Designing computer programs to make computers smarterDesigning computer programs to make computers smarter.Develop programs that respond flexibly in situations that were not specifically

) h l i beg.) - house-cleaning robots- perceive its surroundings- navigate on the floor- respond to events- decide what to do next- space exploration (Fig. 1.1)p p ( g )

Synonyms of AI: machine intelligence

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 9: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

What is Artificial Intelligence?What is Artificial Intelligence?What is Artificial Intelligence?What is Artificial Intelligence?AI i ll i f h d bl hi h b l d bAI is a collection of hard problems which can be solved by humans and other living things, but for which we don’t have good algorithms for solving.g g g4e. g., understanding spoken natural language, medical diagnosis,

circuit design, learning, self-adaptation, reasoning, chess playing, proving math theories etcproving math theories, etc.

Definition from R & N book: a program that4Acts like human (Turing test)4Thinks like human (human-like patterns of thinking steps)4Acts or thinks rationally (logically, correctly)

Some problems used to be thought of as AI but are nowSome problems used to be thought of as AI but are now considered not4e. g., compiling Fortran in 1955, symbolic mathematics in 1965,

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

pattern recognition in 1970

Page 10: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Research GoalsResearch GoalsResearch GoalsResearch Goals

Making machines more usefulg

U d t di i t lliUnderstanding intelligence

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 11: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

History of AIHistory of AIHistory of AIHistory of AIEarly enthusiasm (1950’s & 1960’s)4 Turing test (1950)4 1956 Dartmouth conference4 Emphasize on intelligent general problem solvingp g g p g

Emphasis on knowledge (1970’s)4 Domain specific knowledge4 DENDRAL, MYCIN

AI became an industry (late 1970’s & 1980’s)AI became an industry (late 1970 s & 1980 s)4 Knowledge-based systems or expert systems4 Wide applications in various domains

Searching for alternative paradigms (late 1980’s - early 1990’s)44 AI’s Winter: limitations of symbolic/logical approaches4 New paradigms: neural networks, fuzzy logic, genetic algorithms, artificial life

Resurge of AI (mid 1990’s – present)4 Internet Information retrieval data mining bioinformaticsInternet, Information retrieval, data mining, bioinformatics4 Intelligent agents, autonomous robots

Recent trends:4 Probabilistic computation4 Biological basis of intelligence

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

4 Biological basis of intelligence4 Brain research, cognitive science

Page 12: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Artificial Intelligence (AI)Artificial Intelligence (AI)g ( )g ( )

S b li AISymbolic AI Rule-Based Systems

Connectionist AI Neural Networks

Evolutionary AI Genetic Algorithms

Molecular AI:

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Molecular AI: DNA Computing

Page 13: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Research Areas and ApproachesResearch Areas and ApproachesppppLearning AlgorithmsInference Mechanisms

ResearchInference MechanismsKnowledge RepresentationIntelligent System Architecture

Intelligent AgentsInformation RetrievalElectronic Commerce

ArtificialIntelligence Application

Electronic CommerceData MiningBioinformaticsN t l L P

R ti li (L i l)

Natural Language Proc.Expert Systems

Rationalism (Logical)Empiricism (Statistical)Connectionism (Neural)Paradigm

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Evolutionary (Genetic)Biological (Molecular)

Page 14: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Intelligent AgentsIntelligent AgentsIntelligent AgentsIntelligent Agents

Autonomous Agents

Biological Agents Robotic Agents Computational Agents

Software Agents Artificial Life gAgents

EntertainmentAgents

Task-specificAgents

Viruses

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 15: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Applications of Intelligent Agents (1)Applications of Intelligent Agents (1)Applications of Intelligent Agents (1)Applications of Intelligent Agents (1)

E il AE-mail Agents4Beyond Mail, Lotus Notes, Maxims

h d liScheduling Agents4ContactFinder

Desktop Agents4Office 2000 Help, Open Sesame

Web-Browsing Assistants4WebWatcher, Letizia

Information Filtering Agents4Amalthaea, Jester, InfoFinders, Remembrance agent,

PHOAKS Sit S

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

PHOAKS, SiteSeer

Page 16: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Applications of Intelligent Agents (2)Applications of Intelligent Agents (2)Applications of Intelligent Agents (2)Applications of Intelligent Agents (2)

N i ANews-service Agents4NewsHound, GroupLens, FireFly, Fab, ReferralWeb,

NewTNewTComparison Shopping Agents4Mysimon BargainFinder Bazzar Shopbor Fido4Mysimon, BargainFinder, Bazzar, Shopbor, Fido

Brokering Agents4P lL i B K b h J Y t4PersonalLogic, Barnes, Kasbah, Jango, Yenta

Auction Agents4A ti B t A ti W b4AuctionBot, AuctionWeb

Negotiation Agents4D t D t t T@T

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

4DataDetector, T@T

Page 17: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Computers Meet BiosciencesComputers Meet BiosciencesComputers Meet BiosciencesComputers Meet Biosciences

BT IT

Bioinformation Technology(BIT)

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

( )

Page 18: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

AI in Life SciencesAI in Life SciencesAI in Life SciencesAI in Life Sciences

S l iS l iSequence analysisSequence analysis4 Sequence alignment4 Structure and function prediction

Structure analysisStructure analysis4 Protein structure comparison

4 Gene finding

p4 Protein structure prediction 4 RNA structure modeling

Expression analysisExpression analysis4 Gene expression analysis4 Gene clustering

Pathway analysisPathway analysis

4 Gene clustering

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

4Metabolic pathway4 Regulatory networks

Page 19: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Bi l i l A li tiBi l i l A li tiBiological ApplicationBiological Application

&

120 l f

&

120 samples from60 leukemia patients

Gene expression data Class: ALL/AML

Di iTraining with

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Diagnosis

[Cheok et al., Nature Genetics, 2003]

6-fold validation

Page 20: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Evolutionary ComputationEvolutionary Computation: : y py pNature as ComputerNature as Computer

“Owing to this struggle for life, any variation, however slight and from whatever cause proceeding, if it be in any degree profitable to an individual of any species, in its infinitely complex relations to other organic beings and to external nature, will tend to the preservation of that individual, and will generally be inherited by its offspring.” p g

Origin of Species “Charles Darwin (1859)”

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 21: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Genetic AlgorithmsGenetic AlgorithmsGenetic AlgorithmsGenetic Algorithms110010 1010

crossovercrossover

solutions

1100101010

1011101110 110010 1110

101110 1110

encodingchromosomes

solutions0011011001

1100110001

mutationmutation

101110 1010

00110 10011

00110 10010

evaluationevaluationselectionselectionnew population 00110 10010

1100101110

1011101010

0011001001

roulette

solutions

fitness

roulettewheel

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

fitnesscomputation

Page 22: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Hot Water Flashing Nozzle (1)Hot Water Flashing Nozzle (1)Application Example 1Application Example 1

Hot Water Flashing Nozzle (1)Hot Water Flashing Nozzle (1)Hans-Paul Schwefel

Start

Hot water entering Steam and droplet at exit

performed the original experiments

Hot water entering Steam and droplet at exit

At throat: Mach 1 and onset of flashingg

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 23: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Concrete Shell RoofConcrete Shell RoofApplication Example 3Application Example 3

Concrete Shell RoofConcrete Shell Roof

under own and outer load (snow and wind)

Optimal shape

Height 1.34m

Spherical shapep p

Half span 5.00m

S i 36% h ll thi ki

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Savings : 36% shell thickness

27% armation

max min

Orthogonal bending strength

→ϕm

Page 24: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Cooperating Robots (3)Cooperating Robots (3)Application Example 13Application Example 13

Cooperating Robots (3)Cooperating Robots (3)

Cooperating Autonomous Robots

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 25: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

CC l i S S ftb t (1)l i S S ftb t (1)Application Example 14Application Example 14

CoCo--evolving Soccer Softbots (1)evolving Soccer Softbots (1)CoCo evolvingevolvingCoCo--evolvingevolvingSoccer Softbots Soccer Softbots With Genetic With Genetic P iP i

At R b C th t "l " th " l" b t

ProgrammingProgrammingAt RoboCup there are two "leagues": the "real" robot league and the "virtual" softbot leagueHow do you do this with GP?How do you do this with GP?4GP breeding strategies: homogeneous and heterogeneous4Decision of the basic set of function with which to evolve players

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Decision of the basic set of function with which to evolve players4Creation of an evaluation environment for our GP individuals

Page 26: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

CoCo evolving Soccer Softbots (2)evolving Soccer Softbots (2)Application Example 14Application Example 14

CoCo--evolving Soccer Softbots (2)evolving Soccer Softbots (2)

Initial Random Population

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 27: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

CoCo evolving Soccer Softbots (3)evolving Soccer Softbots (3)Application Example 14Application Example 14

CoCo--evolving Soccer Softbots (3)evolving Soccer Softbots (3)

Kiddie Soccer

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 28: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

CoCo evolving Soccer Softbots (4)evolving Soccer Softbots (4)Application Example 14Application Example 14

CoCo--evolving Soccer Softbots (4)evolving Soccer Softbots (4)

Learning to Block the Goal

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 29: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

CoCo evolving Soccer Softbots (5)evolving Soccer Softbots (5)Application Example 14Application Example 14

CoCo--evolving Soccer Softbots (5)evolving Soccer Softbots (5)

Becoming Territorial

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 30: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

10001000--Pentium BeowulfPentium Beowulf--Style Style yyCluster Computer for Parallel GPCluster Computer for Parallel GP

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 31: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Computing Power and Memory Capacity of Computing Power and Memory Capacity of p g y p yp g y p yComputers and Organisms [Moravec, 1988]Computers and Organisms [Moravec, 1988]

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 32: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Von Neumann’s Von Neumann’s The Computer The Computer ppand the Brain (1958)and the Brain (1958)

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

John von Neumann (1903-1957)

Page 33: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

The Computer and the BrainThe Computer and the BrainThe Computer and the BrainThe Computer and the Brain

- 10 billion neurons(100 trillion synapses)

- Less than 1 million processors (10 –9 sec each, neuron: 10-3 sec) ( y p )

- Distributed processing- Nonlinear processing- Parallel processing

(10 sec each, neuron: 10 sec)- Central processing- Arithmetic operation (linearity)

Sequential processing

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

- Parallel processing- Carbon-based (wet)

- Sequential processing- Silicon-based (dry)

Page 34: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

From Biological Neurons to From Biological Neurons to ggArtificial NeuronsArtificial Neurons

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 35: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Multilayer Perceptron (MLP)Multilayer Perceptron (MLP)Error Backpropagation

Multilayer Perceptron (MLP)Multilayer Perceptron (MLP)

E∂Output Comparison

Information Propagation ∑ −≡ kkd otwE 2)(1)(i

iiii wEwwww

∂∂

−=ΔΔ+← η ,

p g

Input x1 Weights∑

≡outputsk

kkd otwE )(2

)(

Input x2 Outputx )(xfo =

Input x3

Activation FunctionScaling FunctionInput Layer Hidden Layer Output Layer

Activation Function

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 36: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Application Example:Application Example:pp ppp pAutonomous Land Vehicle (ALV)Autonomous Land Vehicle (ALV)

NN learns to steer an autonomous vehicle.960 input units, 4 hidden units, 30 output units p pDriving at speeds up to 70 miles per hour

ALVINN System

Weight values

Image of aforward -mounted

for one of the hidden units

mountedcamera

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 37: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Neural Nets for Face RecognitionNeural Nets for Face Recognition

960 x 3 x 4 network is trained on gray-level images of faces to predict

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

960 x 3 x 4 network is trained on gray level images of faces to predict whether a person is looking to their left, right, ahead, or up.

Page 38: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

New Directions: New Directions: BiointelligenceBiointelligence

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 39: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Humans and ComputersHumans and ComputersHumans and ComputersHumans and Computers

The Entire Problem Space

What Kind ofHuman Computers What Kind of Computers?

Human Computers

Current Computers

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 40: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Humans and MachinesHumans and MachinesHumans and MachinesHumans and Machines

Humans are 4creative

Humans are ♦ imprecise, creative,

4compliant, 4attentive to change

p ,♦ sloppy, ♦ distractable, attentive to change,

4resourceful, and 4multipurpose

,♦ emotional, and ♦ illogical4multipurpose

To achieve human-level intelligence these

♦ illogical

To achieve human-level intelligence theseproperties should be taken into account.

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 41: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Toward HumanToward Human Level IntelligenceLevel IntelligenceToward HumanToward Human--Level Intelligence Level Intelligence

Human intelligence develops situated in a multimodal environment [Gibbs, 2005].[ , ]The human mind makes use of multiple representations and problem-solving strategies [Fuster, 2003]. ]The brain consists of functional modules which are localized in subcortical areas but work togetheron the whole-brain scale [Grillner et o e w o e b sc e [G e eal., 2006]. Humans can integrate the multiple tasks into a coherent solution [Jones, 2004].2004]. Humans are versatile and come up with many new ideas and solutions to a given problem [Minsky, 2006].

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 42: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

What is What is the information the information i i i li i i l d l id l iprocessing principleprocessing principle underlying underlying

human intelligence?human intelligence?human intelligence?human intelligence?

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 43: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Mind Brain Cell MoleculeMind Brain Cell MoleculeMind, Brain, Cell, MoleculeMind, Brain, Cell, MoleculeMindMindMind

Brain

C llCell

M l l∞ Molecule

1011 cells

∞ memory

0 ce s

1010 mol.

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 44: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Molecular Basis of Learning and Memory Molecular Basis of Learning and Memory g yg yin the Brainin the Brain

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 45: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Principles of Learning: Modern ConceptsPrinciples of Learning: Modern ConceptsPrinciples of Learning: Modern ConceptsPrinciples of Learning: Modern Concepts

Types of learning: Accretion, tuning, restructuring (e grestructuring (e.g., Rumelhart & Norman, 1976)Encoding specificityEncoding specificity principle (Tulving, 1970’s)Cellular and molecular basis of learning andbasis of learning and memory (Kandel et al., 1990’s) Conceptual blend andConceptual blend and chemical scramble (e.g., Feldman, 2006)

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

45

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 46: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Principles of Information Processing in thePrinciples of Information Processing in thePrinciples of Information Processing in the Principles of Information Processing in the BrainBrain

The Principle of Uncertainty4Precision vs. predictionp

The Principle of Nonseparability “UN-IBM”4Processor vs. memoryy

The Principle of Infinity4Limited matter vs. unbounded memory

The Principle of “Big Numbers Count”4Hyperinteraction of 1011 neurons (or > 1017 molecules)

The Principle of “Matter Matters”4Material basis of “consciousness” [Zhang, 2005]

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 47: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Unconventional ComputingUnconventional ComputingUnconventional ComputingUnconventional Computing

Quantum Computing4Atoms4Superposition, quantum entanglements

Chemical ComputingChemical Computing 4Chemicals4Reaction diffusion computing4Reaction-diffusion computing

Molecular Computing4M l l4Molecules4“Self-organizing hardware”

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 48: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Molecular Computing: Molecular Computing: p gp gBioMolecules as ComputerBioMolecules as Computer

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

011001101010001 ATGCTCGAAGCT

Page 49: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

DNA Molecules for Information DNA Molecules for Information Storage and ProcessingStorage and Processing

Writing: make DNA sequences

DNA

a t c g g t c a t ag c a c t

0 0 0DNAmemory strands

1 0 1

t a g c c c g t g a

t c a t a

t a g c c c g t g a

a t c g g t c a t a

Reading: hybridization and readout

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

g y

Page 50: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

x1=1

x2=0

x3=0

x4=1

x5=0

x6=0

x7 =0

x8=0

x9=0

x10=1

x11=0

x12=1

x13=0

x14=0

x15=0

y= 1

x1=0

x2=1

x3=1

x4=0

x5=0

x6=0

x7 =0

x8=0

x9=1

x10=0

x11=0

x12=0

x13=0

x14=1

x15=0

y= 0

1

2

Learningx1=0

x2=0

x3=1

x4=0

x5=0

x6=1

x7 =0

x8=1

x9=0

x10=0

x11=0

x12=0

x13=1

x14=0

x15=0

y=1

4 Data Items3

x1=0

x2=0

x3=0

x4=0

x5=0

x6=0

x7 =0

x8=1

x9=0

x10=0

x11=1

x12=0

x13=0

x14=0

x15=1

y=1

4

x1x2 x15

x4 x10 y=1x1Round 1Round 2Round 3

x3 x144 10 y1

x4 x12 y=1x1

x10 x12 y=1x4

1

x12

x4 x13x3 x9 y=0x2

x3 x14 y=0x22x12

x5x9 x14 y=0x3

x6 x8 y=1x3

x6 x11x6 x13 y=1x3

x8 x13 y=1x6

3

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

50x8 x9

x7x10x11 x15 y=0x84

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 51: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Hypernetwork of DNA Molecules

[Zhang, DNA-2006](c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 52: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

““학습학습 추론”하는추론”하는 DNADNA 컴퓨터컴퓨터““학습학습 추론”하는추론”하는 DNA DNA 컴퓨터컴퓨터

MP4.avi

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 53: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

M l l C Sili CM l l C Sili CMolecular Computers vs. Silicon ComputersMolecular Computers vs. Silicon Computers

Molecular Computers Silicon Computers

Processing Ballistic HardwiredMedium Liquid (wet) or Gaseous (dry) Solid (dry)Communication 3D collision 2D switchingCommunication 3D collision 2D switchingConfiguration Amorphous (asynchronous) Fixed (synchronous)Parallelism Massively parallel Sequentialy p qSpeed Fast (millisec) Ultra-fast (nanosec)

Reliability Low High

Density Ultrahigh Very high

Reproducibility Probabilistic Deterministic

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 54: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

B h k P bl Di it IB h k P bl Di it IBenchmark Problem: Digit ImagesBenchmark Problem: Digit Images

• 8x8=64 bit images (made from 64x64 scanned gray images)• Training set: 3823 images• Test set: 1797 images

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

• Test set: 1797 images

Page 55: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Pattern Information ProcessingPattern Information ProcessingPattern Information ProcessingPattern Information Processing

0.7

0.8

0.9

1

ate

0 2

0.3

0.4

0.5

0.6

Cla

ssifi

catio

n ra

Order 1Order 2

0

0.1

0.2

1 7 13 19 25 31 37 43 49 55 61 67 73 79 85 91 97

epoch

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 56: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Cognitive Learning and MemoryCognitive Learning and Memory

Page 57: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Toward HumanToward Human--Level Machine Learning: Level Machine Learning: M l i d l M G (MMG)M l i d l M G (MMG)Multimodal Memory Game (MMG)Multimodal Memory Game (MMG)

But, I'm getting married tomorrowBut, I'm getting married tomorrowBut, I'm getting married tomorrowBut, I'm getting married tomorrowBut, I'm getting married tomorrowBut, I'm getting married tomorrowWell, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.But, I'm getting married tomorrowW ll b IBut, I'm getting married tomorrowW ll b IBut, I'm getting married tomorrowW ll b IBut, I'm getting married tomorrowW ll b I

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.g g g pAre you thinking about me?But if you are, call me tonight.

g g g pAre you thinking about me?But if you are, call me tonight.

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.A thi ki b t ?

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.A thi ki b t ?

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.A thi ki b t ?

Well, maybe I am...I keep thinking about you.And I'm wondering if we made a mistake giving up so fast.A thi ki b t ?

g g g pAre you thinking about me?But if you are, call me tonight.

g g g pAre you thinking about me?But if you are, call me tonight.

g g g pAre you thinking about me?But if you are, call me tonight.

g g g pAre you thinking about me?But if you are, call me tonight.

Are you thinking about me?But if you are, call me tonight.Are you thinking about me?But if you are, call me tonight.Are you thinking about me?But if you are, call me tonight.Are you thinking about me?But if you are, call me tonight.

Image Sound Text

Text HintHint Image

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/Image-to-Text Generator Text-to-Image GeneratorMachine Learner

Page 58: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Text Generation Game (from Image)Text Generation Game (from Image)Text Generation Game (from Image)Text Generation Game (from Image)

Image SoundSound Text

LearningLearningby ViewingT

I2T T2IGameManager

Text HintT

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

58

g

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 59: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Image Generation Game (from Text)Image Generation Game (from Text)Image Generation Game (from Text)Image Generation Game (from Text)

TextImage SoundSound

LearningLearningby ViewingI

I2T T2IGameManager

Hint ImageI

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

59

g

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 60: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Three ExperimentsThree ExperimentsThree ExperimentsThree Experiments

S G iSentence Generation4Learn: a linguistic recall memory from a sentence corpus4Given: a partial or corrupt sentencep p4Generate: a complete sentence

Image-to-Text Translation4 i j i d l f i i4Learn: an image-text joint model from an image-text pair corpus4Given: an image (scene)4Generate: a text (dialogue of the scene)( g )

Text-to-Image Translation4Learn: an image-text joint model from an image-text pair corpus4Gi (di l )4Given: a text (dialogue)4Generate: an image (scene of the dialogue)

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

60

Page 61: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Experiment 1: Learning Linguistic MemoryExperiment 1: Learning Linguistic MemoryExperiment 1: Learning Linguistic MemoryExperiment 1: Learning Linguistic Memory

D i f dDataset: scripts from dramas4Friends4HouseHouse4244Grey Anatomy 44Gilmore Girls 4Sex and the City

Training data: 289 468 sentencesTraining data: 289,468 sentences Test data: 700 sentences with blanksVocabulary size: 34 219 wordsVocabulary size: 34,219 words

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

61

Page 62: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Sentence Completion ResultsSentence Completion ResultsSentence Completion ResultsSentence Completion Results

? gonna ? upstairs ? ? a shower I'm gonna go upstairs and take a shower

We ? ? a lot ? giftsWe don't have a lot of gifts

? have ? visit the ? roomI have to visit the ladies' room

? ? don't need your ?if I don't need your help

? still ? believe ? did thisI still can't believe you did this

? ? a dream about ? In ?I had a dream about you in Copenhagen

? i t it if ? ll h b ? ?

? ? ? decisionto make a decision

I still can't believe you did this

What ? ? ? hereWhat are you doing here

? ? fi ? f di l h l

I had a dream about you in Copenhagen

? appreciate it if ? call her by ? ? I appreciate it if you call her by the way

I'm standing ? the ? ? ? cafeteria I' t di i th f th f t i

Would you ? to meet ? ? Tuesday ? W ld i t t i T d d

? you ? first ? of medical schoolAre you go first day of medical school

Why ? you ? come ? down ? Why are you go come on down here

? think ? I ? met ? somewhere beforeI think but I am met him somewhere before

I'm standing in the one of the cafeteriaWould you nice to meet you in Tuesday and

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

62

Page 63: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Experiments 2 & 3: Crossmodal Experiments 2 & 3: Crossmodal ppTranslationTranslation The order (k) of hyperedge

♦ Text: Order 2~4Dataset: scenes and corresponding scripts from two dramas4 Friends

♦ Image: Order 10~340The method of creating hyperedges from training data

4 Prison Break

Training data: 2,808 scenes and scriptsScene (image) size: 80 x 60 = 4800

yp g g♦ Text: Sequential sampling from a

randomly selected position♦ Image: Random sampling in 4,800 Scene (image) size: 80 x 60 = 4800

binary pixelsVocabulary size: 2,579 words

g p gpixel positions

Number of samples from an image-text pair

Where am I giving birth

g p♦ From 150 to 300

Where am I giving birth

I know it's been really hard for you

So when you guys get in there

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

63

So when you guys get in there

Page 64: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

ImageImage--toto--Text Translation ResultsText Translation Results

Matching &

ImageImage toto Text Translation ResultsText Translation Results

AnswerQuery

I don't know

gCompletion

I don't know what happeneddon't know whatknow what happened

There's a kitty in my guitar case

There's aa kitty in

case…in my guitar case

Maybe there's something I can do to make sure I get pregnant

Maybe there's somethingthere's something I

… pregnantI get pregnant

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 65: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

TextText--toto--Image Translation ResultsImage Translation Results

Matching &

TextText toto Image Translation ResultsImage Translation Results

Query Matching &Completion Answer

I don't know what happened

Take a look at this

There's a kitty in my guitar case

Maybe there's something I can d t k I t tdo to make sure I get pregnant

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 66: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Toward HumanToward Human--Level IntelligenceLevel Intelligence

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 67: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

From Mind to Molecules and BackFrom Mind to Molecules and BackFrom Mind to Molecules and BackFrom Mind to Molecules and BackMind

BrainBrain

Cell

Molecule∞ memory

Molecule1011 cells

>103 molecules

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

67(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 68: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

P di f C t ti l I t lliP di f C t ti l I t lliParadigms for Computational IntelligenceParadigms for Computational Intelligence

Symbolism Connectionism Dynamicism Hyperinter-actionism

Metaphor symbolt

neuralt dynamical system biomolecular

tp system system y y systemMechanism logical electrical mechanical chemical

Description syntactic functional behavioral relational

Representation localist distributed continuous collective

Organization structural connectionist differential combinatorial

Adaptation substitution tuning rate change self-assembly

Processing sequential parallel dynamical massively parallel

Structure procedure network equation hypergraphStructure procedure network equation hypergraph

Mathematics logic, formallanguage

linear algebra,statistics geometry, calculus graph theory,

probabilistic logicS /ti f l ti l t l ti t l

© 2008, SNU Biointelligence Lab, http://bi.snu.ac.kr/

68

Space/time formal spatial temporal spatiotemporal

[Zhang, IEEE Comp. Intel. Mag., August 2008](c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 69: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Da Vinci’s Dream of Flying MachinesDa Vinci’s Dream of Flying MachinesDa Vinci s Dream of Flying MachinesDa Vinci s Dream of Flying Machines

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 70: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Engines of FlightEngines of FlightEngines of FlightEngines of Flight

R k E i(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Piston Engine Jet Engine Rocket Engine

Page 71: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

T i ’ D f I t lli t M hiT i ’ D f I t lli t M hiTuring’s Dream of Intelligent MachinesTuring’s Dream of Intelligent Machines

Alan Turing(1912-1954)

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Computing Machinery and Intelligence (1950)

Page 72: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

C t d I t lliC t d I t lliComputers and IntelligenceComputers and Intelligence

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Page 73: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Future Technology EnablersFuture Technology EnablersFuture Technology EnablersFuture Technology Enablers

Bio-electric computers

True neural computing

Quantum computer, molecular electronics

computers1e6-1e7 x lower power for lifetime batteries

Full motion

Smart lab-on-chip, plastic/printed ICs, self-assembly

mobile video/office

Metal gates Pervasive voice

Vertical/3D CMOS, Micro-wireless nets, Integrated optics

yWearable communications, wireless remote medicine, ‘hardware over internet’ !

Metal gates, Hi-k/metal oxides, Lo-k with Cu, SOI

recognition, “smart” transportation

Integrated optics

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/Source: Motorola, Inc, 2000

Now +2 +4 +6 +8 +10 +12

Page 74: A tifi i l I t lli A I t d tiArtificial Intelligence ... - SNUA tifi i l I t lli A I t d tiArtificial Intelligence: An Introduction Revised September 2008 Byoung-Tak Zhang School of

Artificial Intelligence (AI)Artificial Intelligence (AI)g ( )g ( )

S b li AISymbolic AI Rule-Based Systems

Connectionist AI Neural Networks

Evolutionary AI Genetic Algorithms

Molecular AI:

(c) 2000-2009 SNU CSE Biointelligence Lab, http://bi.snu.ac.kr/

Molecular AI: DNA Computing


Recommended