Presenter Tian Huang u6343091anueduau
Supervisor Dr Henry Gardner
COMP4560 Advanced Computing Project
August 19 2019
Augmented Reality and Mobile Phones
Explore the potentials of AR technology in a museum tour guide
application
Overview
bull Related Fields Human-Centred Computing
Software Engineering
bull Functions of the Application1 Museum Navigation using AR technology
2 Collection Identifying based on target recognition
3 Knowledge Conveying by AR interactions
2
Overview
bull What is Augmented RealityAugmented reality (AR) is an interactive experience
of a real-world environment where the objects that
reside in the real-world are enhanced by computer-
generated perceptual information sometimes across
multiple sensory modalities
(Adapted from httpsenwikipediaorgwikiAugmented_reality)
3
Museum Navigation
bull Help visitors to find out what collections
are nearby and show the way to
collections they are looking for
bull What is required1 Collections and their positions in the museum
(information stored in the database)
2 Information reflecting the real-time surroundings
(video feed from cameras)
3 Orientation visitors are facing (gyroscope)
4 Visitorsrsquo location in the museum (various method
one is to use Bluetooth beacons)4
Museum Navigation
5
(Small images are adapted from httpcollectionsearchnmagovau)
Collection Identifying
bull Tell the visitors what collection they are
looking at so that can provide related
information and interaction
bull What is required1 A pattern which generates features that can be
recognized by the smart phone to represent
collections
2 A method to interpret these features to differentiate
collections
6
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Overview
bull Related Fields Human-Centred Computing
Software Engineering
bull Functions of the Application1 Museum Navigation using AR technology
2 Collection Identifying based on target recognition
3 Knowledge Conveying by AR interactions
2
Overview
bull What is Augmented RealityAugmented reality (AR) is an interactive experience
of a real-world environment where the objects that
reside in the real-world are enhanced by computer-
generated perceptual information sometimes across
multiple sensory modalities
(Adapted from httpsenwikipediaorgwikiAugmented_reality)
3
Museum Navigation
bull Help visitors to find out what collections
are nearby and show the way to
collections they are looking for
bull What is required1 Collections and their positions in the museum
(information stored in the database)
2 Information reflecting the real-time surroundings
(video feed from cameras)
3 Orientation visitors are facing (gyroscope)
4 Visitorsrsquo location in the museum (various method
one is to use Bluetooth beacons)4
Museum Navigation
5
(Small images are adapted from httpcollectionsearchnmagovau)
Collection Identifying
bull Tell the visitors what collection they are
looking at so that can provide related
information and interaction
bull What is required1 A pattern which generates features that can be
recognized by the smart phone to represent
collections
2 A method to interpret these features to differentiate
collections
6
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Overview
bull What is Augmented RealityAugmented reality (AR) is an interactive experience
of a real-world environment where the objects that
reside in the real-world are enhanced by computer-
generated perceptual information sometimes across
multiple sensory modalities
(Adapted from httpsenwikipediaorgwikiAugmented_reality)
3
Museum Navigation
bull Help visitors to find out what collections
are nearby and show the way to
collections they are looking for
bull What is required1 Collections and their positions in the museum
(information stored in the database)
2 Information reflecting the real-time surroundings
(video feed from cameras)
3 Orientation visitors are facing (gyroscope)
4 Visitorsrsquo location in the museum (various method
one is to use Bluetooth beacons)4
Museum Navigation
5
(Small images are adapted from httpcollectionsearchnmagovau)
Collection Identifying
bull Tell the visitors what collection they are
looking at so that can provide related
information and interaction
bull What is required1 A pattern which generates features that can be
recognized by the smart phone to represent
collections
2 A method to interpret these features to differentiate
collections
6
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Museum Navigation
bull Help visitors to find out what collections
are nearby and show the way to
collections they are looking for
bull What is required1 Collections and their positions in the museum
(information stored in the database)
2 Information reflecting the real-time surroundings
(video feed from cameras)
3 Orientation visitors are facing (gyroscope)
4 Visitorsrsquo location in the museum (various method
one is to use Bluetooth beacons)4
Museum Navigation
5
(Small images are adapted from httpcollectionsearchnmagovau)
Collection Identifying
bull Tell the visitors what collection they are
looking at so that can provide related
information and interaction
bull What is required1 A pattern which generates features that can be
recognized by the smart phone to represent
collections
2 A method to interpret these features to differentiate
collections
6
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Museum Navigation
5
(Small images are adapted from httpcollectionsearchnmagovau)
Collection Identifying
bull Tell the visitors what collection they are
looking at so that can provide related
information and interaction
bull What is required1 A pattern which generates features that can be
recognized by the smart phone to represent
collections
2 A method to interpret these features to differentiate
collections
6
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Collection Identifying
bull Tell the visitors what collection they are
looking at so that can provide related
information and interaction
bull What is required1 A pattern which generates features that can be
recognized by the smart phone to represent
collections
2 A method to interpret these features to differentiate
collections
6
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Collection Identifying
bull Solution using Image Targets (supported
by Vuforia)
(Original image is adapted from httpsenwikipediaorgwikiJames_Cook)
(Vuforia logo is adapted from httpsdevelopervuforiacom)7
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Collection Identifying
bull Problemn records in the database
Match every records one by one time complexity O(n)
bull ImprovementBuilding up indexes like a balanced tree time
complexity O(log n)
8
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Collection Identifying
9Wraps and images within the wrap are adapted from Wikipedia
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Knowledge Conveying
bull Based on the result of collection identifying
various of AR interactions will be provided
to the visitors to stimulate their interests in
collections and convey relevant knowledge
to them
bull Find out several potential patterns
10
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Knowledge Conveying
bull The interaction between multiple
collections (show the relation between two
collections)
11
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Knowledge Conveying
12
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Knowledge Conveying
bull Use phone camera to capture user
modified texture to render the target object
(collections with specific shape or texture)
13
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Knowledge Conveying
14
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Conclusion
bull How AR technology can potentially be
applied in Android phone applications for
museum tour guide
1 Indoor Navigation
2 Target Identifying
3 Provide Experience Improving Interactions
15
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
QampA
bull Please ask me if you have any questions
16
Thank you for your attention
17
Thank you for your attention
17
![State of Augmented Reality, Virtual Reality and Mixed Reality · State of Augmented Reality, Virtual Reality and Mixed Reality [Microsoft Hololen] [Ready Player One] Augmented Reality](https://static.documents.pub/doc/80x56/5f82ab6da2d89130b90d78c7/state-of-augmented-reality-virtual-reality-and-mixed-reality-state-of-augmented.jpg)
