Sound versus Graphics

Sound versus Graphics

Sound vs GraphicsSound vs Graphics

1) Sound is active, graphics are passive

Respect to the behavior of the user interacting with media

• Sound – active, User – passive ex) alarms, fire warnings, telephones, lift, reator meltdowns

• Graphics – passive, User –active

- The user must actively look around the visual space, seeing and recognizing the information presented as graphics.

Sound vs GraphicsSound vs Graphics

• Less true :when dealing with new media - The fact that the visual field is narrowed to just the screen

does tend to give new media graphics more of a directed, active nature

- Similar in some ways to television

The dynamic nature and the orchestration of the programs on it makes it more of an active medium with passive users

Sound vs GraphicsSound vs Graphics

2) Sound is non-localized, graphics are localized

• Graphics – context specific

- be highly localized

• Sound - difficult to localize

ex) classic three-phone problem

• See combinations of the two media, each one fulfilling the role

– Sound with coupled with a flashing light

– Banks of elevators

Sound vs GraphicsSound vs Graphics

3) Sound is transient, graphics are permanent

• Sound - transient (plays once and then is gone)

• Repetitions and constant background sound :To give sound more of a permanent character

• Graphics - permanent

Sound vs GraphicsSound vs Graphics

4) Sound is dynamic, graphics are static

• Sound – dynamic• Different ways of approaching this relationship with

time - be used to transmit information or atmosphere with

little or no relation to the actual time- have the other extreme

• Graphics - static

Sound vs GraphicsSound vs Graphics

5) Notation

• Sound – difficult and complex to notate

• Graphics - do not need a notation

Sound in the real-worldSound in the real-world- 뉴 미디어에 대한 사운드 디자인을 생각하기 전에 앞서 ,

실제 생활 속에서의 다양한 소리들에 대해 둘러본다 .

Babies and sound

시각적인 것에 대부분 의존하는 어른들과는 달리 ,

아이들에게는 보는 것과 듣는 것이 동등한 중요성을 가진다 .

어른 : 아 , 고양이다 .

아이 : ( 야옹 야옹 ) 아 , 고양이다 .

Silence

고요함은 소리의 공백을 나타낸다 .

뉴 미디어 사운드 분야에서 중요한 부분을 차지 .

Noise

별다른 정보를 포함하고 있지는 않다 .

특정한 상황이 아니라면 , 여러 소리들 가운데 묻혀버리는 하찮은 요소 .

-> Noise

Pleasant sounds

듣기에 좋은 소리 .

별다른 의미를 포함하고 있지 않아도 , 듣는 사람의 기분에 큰 영향을 끼친다 .

Physical effects

어떤 소리들은 의미에 관계 없이 물질적인 영향을 끼친다 .

이러한 소리들은 듣는 사람들에게 정신적 , 육체적 악영향을 끼칠 수 있다 .

예 ) 칠판으로 손톱 긁는 소리 . 나이프로 접시 긁기 .

Emotive sound

소리에 의한 감정 표현은 의사소통에 있어서 중요한 부분을 차지한다 .

예 ) 아이의 울음소리 , 화가 나서 고함을 지르는 소리 등 .

소음이 아니라도 , 이러한 소리들은 때때로 하고자 하는 일을 방해할 때가 있다 .

예 ) 음악을 들으며 공부를 하다가 음악에 심취해서 공부를 못했다 .

영화를 보는데 뒷자리 커플의 애정행각 소리 때문에 집중하지 못했다 .

Sound with meaning

명백한 의미를 가진 소리는 사람들에게 더욱 큰 영향을 미친다 .

예 ) 차의 경적소리 , 전화벨 소리

또한 전화기에서 울리는 벨 소리와 소방서에서 울리는 벨 소리가 다른 것처럼

소리에 담긴 의미에 따라 같은 소리라도 중요성이 달라진다 .

Speech

말은 더욱 더 명확하고 뚜렷한 의미를 가진 소리 .

때때로 말은 글보다 더 많은 정보를 포함한다 .

나 지금 떨고 있니 ?

말의 억양 , 호흡 , 표정 , 발음 등을 통해

말하는 사람의 상태를 예측할 수 있다 .

Sound TechnologySound TechnologySound TechnologySound Technology

Technology for creating sound Technology for creating sound artificiallyartificiallyTechnology for creating sound Technology for creating sound artificiallyartificially

• Mechanical sounds• Electronic generation of sound• Combine the two threads of

electronic sounds and computer technology

• Possible to do a lot with sound on the computer

Mechanical soundsMechanical sounds

• ‘By accident’, either in nature or as an undesigned by product of everyday life

• Door bell, fire bell, clock bell, telephone bells…

=> The message being communicated is very basic ; Simple

Electronic generation of soundElectronic generation of sound

• The main focus of the electronic sound was in electronic music

• Theremin• Moog synthesizer

Combine the two threads of electronic sounds and computer technology

Combine the two threads of electronic sounds and computer technology

• The beep – the electronic variant of the eternal ‘Oi’

오류 윈도우시작 윈도우종료 새 메세지

Nowdays…Nowdays…

• Increased storage and processing power have meant that it is possible to do a lot with sound on the computer.

Sound designSound design

Sound is a rich mediumIn technological terms the designer now has access topowerful sound-oriented toolsThe audience has sufficiently advanced technology to make the inclusion of sound in new media

Sound with meaningSound with meaning

• Methods of sound production : mechanical -> digital(computer-based,more flexible)Meaning of sound :'Oi' -> new and complex meanings

Sound, graphics and animationSound, graphics and animation

• Two good sources of guidance in sound design1. sound (inspiration) 2. graphic design

Sound for changing statesSound for changing states

• appropriate : sound > graphicsex) tresh can

Sound for events Sound for events

• In the real world many actions and events are accompaniedby a soundAnimation : Sound is a very important role

Sound for navigationSound for navigation

• Sound can assist with navigationCreating virtual, 3D environments with stereo-sound

Metaphorical soundsMetaphorical sounds

• When incorporating sounds into a new media system it issometimes a good idea to adopt metaphorical sounds

Sound for realism Sound for realism

• Sound plays a part in trying to recreate real-world aspects of something within a new media systemSound adds a lot to the atmosphere within a computer game

Physical aspects of sound designPhysical aspects of sound design

• As well as the higher-level points above, there are a few points to bear in mind on the lower levels of sound design

Volume Volume

• Visual feedback is always confined to the screen and assuch is local to the new media systemSound is not so easily localized and loud sounds can easily shock or confuse the user

Lead-in Lead-in

• Shock factor of a sound1, The volume has been dealt with above2, The nature of the sound (dog : sneeze < angry )3, lead-in

Length Length

Graphics -> spatial dimensionSound -> temporal dimension

Designing sound setsDesigning sound sets

Important : coherent , consistent , Important : coherent , consistent , similarity similarity

Physical attributes Physical attributes

• Irrespective of what the sounds are similarity : volume , pitch , lengthImportant : consistency, balance

Associative attributes Associative attributes

• Approach is the theme of sound production1. Similar physical waysex) water - dripping, splashing, running..2. Collect sounds that are related nature of sound, contextex) factory environment - hooters, machine noises, switches...

How they combine How they combine

• 1. Design for a suite of sounds consideration2. Any sounds discernible from background sounds3. Visual equivalent of saying, cursor shape different fromthe background pattern

Using speech in new mediaUsing speech in new media

IntroductionIntroduction

• Easy store - why?

Parallel channelsParallel channels

• Ex) Training systems- visual channel- second channel

Assumed intelligenceAssumed intelligence

• Drawback

• Ex1) 프로그래머와 교사간의 오해- Class

Ex2) 지식인과 비지식인간의 오해

- 한자 성어 or 영어

Ex1) 프로그래머와 교사간의 오해Ex1) 프로그래머와 교사간의 오해

• 서로 다른 것을 생각함

Ex2) 지식인과 비지식인간의 오해Ex2) 지식인과 비지식인간의 오해

• 말해도 못 알아 들음

User embarrassmentUser embarrassment

• Job-seeker’s web site

Slower interactionSlower interaction

• 해결방안- Skip

InterferenceInterference

• 1. External sound- Animation

• 2. Internal sound- Picture interference

ContextContext

• Context = Hint• Test

- Encounter - Not independently

Sound and Speech as Primary InteractionSound and Speech as Primary Interaction

We can thinkWe can thinkWe can thinkWe can think

- Environments, visually impaired user

- shifting the focus from visual to sound

- telephone-based, interactive systems

Text rules applyText rules apply Text rules applyText rules apply

Speech ≒ text word

chapter covering text for new media (chapter 3)

Text rules applyText rules applyText rules applyText rules apply

short and terminology that is being used

열려라 참깨 마이크로소프트 윈도우 XP 를 지원하는 컴퓨터 전원 켜기

Fewer choicesFewer choices Fewer choicesFewer choices

- For short-term memory of users

- minimum and limited

- quickly listed for the user

Voice fragments Voice fragments

'patched together‘Ex) 028 3642

Voice fragmentsVoice fragments

- Making the building blocks bigger takes away some of these effects but it then means you need a bigger pool of building blocks.

Time problems Time problems

Since all the interactions and choices have to be vocalized, there is a tendency for interactions to take a long time.

Time problemsTime problems

해결방법to explicitly offer the user the choice of interaction styles

to allow the user to pre-emptany choices that are being offered so instead of waiting for the system to complete its side of the interaction they can interaction they can immediately interrupt with their response.