October 1999COMRIS Soft Poster Presentation1 COMRIS -- Cohabited Mixed- Reality Information Space An...

October 1999 COMRIS Soft Poster Presentation 1

COMRIS -- Cohabited Mixed-Reality Information Space

An ‘en route’ snapshot

The COMRIS Consortium


A one-liner – or two

COMRIS develops wearable technology to focus the attention of participants in large scale events.

COMRIS is about understanding and enabling the social engine of

complex societies.


The COMRIS Vision

Co-Habited Mixed Reality The social engine and scaling From parrot to component-wear Context sensitive text and speech Self-Evaluation of a wearable assistant CAVE interaction COMRIS and social science


The Conference Center


Welcome to RAVE 2000


RAVE 2000: a test bed

RAVE 2000 is an artificially designed conference

RAVE 2000 creates situations in which scenes of various encounters can be played by agents competing for attention

RAVE 2000 is the test bed for our ideas and for the technology


COMRIS Scenarios

Attend to more interests

See the interesting things

Meet the right people

Get more done

Grab a taxi in time

Share dinner with an interesting person


The COMRIS Vision



Scalability - Conceptual

Large groupsof individuals

Appearance basedexploration

Selective presentationsof role and skills

Community of Agentsthat know each other and

who share an interest

Competingfor attention Attention Attention

important message fromthe winner

Evaluating thecompetitors

Competence

Relevance


COMRIS Agent Model

Agent

Competence

Relevance

Appearance

Presentation

Contextinterest


You have an Idea and want to promote it

——o——

You must find and talk to the right person

——o——

An idea can be discussed in a group

——o——

Sometimes it is best to just shout


The COMRIS Vision



COMRIS Parrot Design




Parrot Usability Studies

User Control: do users want to be in control of message delivery or do they want automatic delivery?

The parrot has five buttons but the user needs several functions to interact with it. What is the preferred design?

And now with the real thing!


The COMRIS Vision



Parrot speaking...

“A presentation on numerical learning methods, a topic you are definitely interested in, is starting in 5 minutes in room B. You may want to catch the speaker afterwards since he is a reviewer for your I3 project. Maybe you want to say hi to your friend Sandy who is near you. Don’t forget to mention the present that she gave to you last time you met”


interestbased

navigation

competitionfor

attention

information push

virtual space physical space

PRA

PA

The parrot is a wearable

device providing

assistance to the user

in an information rich

environment. Its software

counterpart, the PA

(Personal Assistant)

realizes the loose coupling

between the virtual world

inhabited by a community of

software agents (PRA Personal

Representative Agent) and the physical world,

inhabited by human agents -

users.

Parrot Talk Requires Multiple Context Dimensions

co-habited mixed reality


EXTRA-LINGUISTIC CONTEXTtime 0: today+1: tomorrow+.10: in 10 minutesspace:close-by, at the other side of the building, on the same floor

social implicature:user is

1: standing, wandering around3: moving towards a goal

5: talking to someone

e.g.-pract:-date (:-day 31:-month 1:-d_elcv 0) :-timing (:-hour 10 :-minute 0) :-place (:-l_name “the coffee room” :-l_ID 9910 :- l_elcv “around the corner”)

Joe Scott proposes to meet you today at 10 o’clock in the coffee room around the corner

PROFILE CONTEXT user’s interest in: topic/ person: 1: might be interested in/might want to meet

3: are interested in/want to meet

5: your favourite topic/absolutely wanted to meete.g. -person..-p_pv:-pnumval 5 :-pqval “for socializing”

Joe Scott, whom you absolutely wanted to meet for socializing, will be giving a talk.

When generating natural language,especially for output on a wearable device, more than one dimension of context needs to be taken into account. Our context model allows for annotating the propositional contents of a message with different types of context information in a uniform way.

Context Model

Numeric focus on concept/instance: occurred 5: in previous message3: 1 message ago1: 2 or more messages ago

e.g. look-up (P_ID 25, concept person, instance 26) => lcv(5,5)

John will give a presentation on ubiquitous computing. He is currently in your neighborhood.

LINGUISTIC CONTEXT


PRAs play a scene & compete for the attention of the user

<Akel_content><Activity>

<status idref=“status-confirmation”/><involves><Person id=“delegate-023”><Person></involves><attending><Appointment><keyword idref=“topic-acl”><keyword idref=“topic-ontologies”><takesplace idref=“loc-010”></Appointment></attending><starts>2000-12-28 10:00:00</starts>

</Activity></Akel_content>

propositionalcontent

profilecontext

the information layer

linguisticcontext

discourse module

(defparameter *mprop1* "[(COOP meeting-proposal) (PERSON [ (FIRSTNAME \"Bob F.\") (LASTNAME \"FERNANDEZ GOMEZ\") (SEX m) (ID \"delegate-023\") ]) (EVENT [ (EVTYPE \"appointment\") (KEYWORD_LIST [(FIRST [(T_NAME \"ACL\") (T_ID \"topic-acl\")]) (REST [(FIRST [(T_NAME \"ontologies\") (T_ID \"topic-ontologies\")]) (REST [])])]) ]) ]) (TAKESPLACE [(ID \"L10\") (NAME \"the coffee room\")]) (START [(DAY 28) (MONTH 12) (TIME [(HOUR 10) (MINUTE 00)])]) (CONTEXT [(PERSON_PV [(PNUMVAL 4) (P_QVAL \"for socializing\")]) (PERSON_LCV [(CONCEPT 3) (ENTITY 1)]) (TOPIC_PV [(FIRST 3) (REST [(FIRST 3) (REST [])])]) (TOPIC_LCV [(FIRST [(CONCEPT 5) (ENTITY 5)]) (REST [(FIRST [(CONCEPT 5) (ENTITY 5)]) (REST [])])]) (DATE_ELCV 1) (LOC_ELCV \"around the corner\")]) ]")

extra-linguisticcontext

Each component contributes to the NLG (natural language generation) process model: the PRA provides thepropositional content and some profile context, the PA provides the extra-linguistic context, the NLG wrapper provides the linguistic context information. The NLG module produces 2 annotated versions of the same base text, for speech output (on the parrot) and for screen based interaction, allowing the user to browse the information layer.

HTML annotated output

Speech annotated output

[#Bob F. #FERNANDEZ GOMEZ / ] , whom you [very much ] wanted to V-meet / , V-p roposes to V-meet you / to V-discuss about *[ACL / ] and *[ontologies // ] *[tomorrow / ] at [*10 o'clock / ] in *[the coffee room / ], [around the corner ] .///

<A HREF=\\\"http://kiew.cs.uni-dortmund.de:8888/?expr=@'delegate-023'\\\" target=\\\"main\\\">Bob F. FERNANDEZ GOMEZ</A>, whom you very much wanted to meet, proposes to meet you to discuss about <A HREF=\\\"http://kiew.cs.uni-dortmund.de:8888/?expr=@'topic-acl'\\\” target=\\\"main\\\">ACL</A> and <A HREF=\\\"http://kiew.cs.uni-dortmund.de:8888/?expr=@'topic-ontologies'\\\" target=\\\"main\\\">ontologies</A> tomorrow at 10 o'clock in <A HREF=\\\"http://kiew.cs.uni-dortmund.de:8888/?expr=@'L10'\\\" target=\\\"main\\\">the coffee room</A>, around the corner.

naturallanguagegeneration module

context sensitive NLG process model


The COMRIS Vision

Co-Habited Mixed Reality The social engine and scaling From parrot to component-wear Context awareness at large Self-Evaluation of a wearable assistant CAVE interaction COMRIS and social science


Parrot Self-Evaluation

The parrot's advice creates an expectation for

future behavior.

Expectation monitoring can be

a basis for self-evaluation.

When is a user ready to shift attention?



The COMRIS Vision



Immersive VirtualityStereo camera

Comris Cave

virtuallypresent

parrot

present


4) Select a face by pointing

5) Increase/decrease interest

1) Represent participants by stereo videos

2) Interest distances are converted in a virtual scenario

3) Enter the cave

A virtual meeting in the cave


The COMRIS Vision



Can COMRIS provide insights for social science?

COMRIS has a strong hypothesis about what makes a complex society function.

COMRIS introduces technology as ‘grease’ in crucial aspects of that functioning

What can be legitimatly concluded from such an experiment


COMRIS Society Model

Competence

Relevance

Appearance

Presentation

Context

Res

ourc

es

Env

iron

men

t

interest

AgentCommunity

Society


COMRIS: to come

Toward the COMRIS co-habited mixed reality demonstration

Usability testing Parrot component design goes on

Dissemination Exploitation

Date post:	16-Jan-2016
Category:	Documents
Upload:	logan-benson
View:	214 times
Download:	0 times

October 1999COMRIS Soft Poster Presentation1 COMRIS -- Cohabited Mixed- Reality Information Space An...

Documents