Sound, Space, and Structure
Designing a System for Sound Spatialization
Song Yang
University of Toronto
April 5th, 2013
outline
what is sound spatialization?
what are some existing sound spatialization systems?
why is my system meaningful?
how does my system achieve spatialization?
introduction
sound spatialization : the simulation of point
sound sources and their movements
possible applications :
gaming (immersive RPGs)
film & home theatre
many more...
analog sound spatialization (pre-1980s)
R. Maconie, Tuning In: A Film About Karlheinz Stockhausen,
[Video recording]. London, United Kingdom:
British Broadcasting Corporation, 1981.
digital sound spatialization (1980s present)
Institute of Sonology
digital sound spatialization (1980s present)
CIRMMT @ McGill
gap objectives
design a household sound
spatialization system...
I. intuitive
II. flexible
III. simulates distance
IV. simulates direction (in 3-D)
V. minimal hardware requirements
modern sound spatialization
systems...
+ flexible
+ simulates distance
+ simulates direction (in 3-D)
- computationally expensive
- requires specialized equipment
system overview
simulation of
directionality
simulation of
distance
path definition
trajectory
generation
input
output
module I : trajectory generation
A.R. Forrest, Interactive Interpolation and
Approximation by Bzier Polynomials, The
Computer Journal, vol. 15, no. 1, pp. 71-79.
how to communicate spatial
trajectories to the computer?
cartesian/polar coordinates?
I. intuitive
II. flexible
III. simulates distance
IV. simulates direction
V. minimal hardware
bzier curves!
y(x) = x3 +3x2 2x + 5
module II : simulation of distance
M. Schroeder and B. Logan, Colorless Artificial
Reverberation, Journal of the Audio Engineering
Society, vol. 9, pp. 192-197.
I. intuitive
II. flexible
III. simulates distance
IV. simulates direction
V. minimal hardware distance of illusory sound source:
direct signal vs. reverb (echo) signal
model concert hall reverb using:
increasing signal density
decreasing signal amplitude
module III : simulation of directionality
V. Pulkki, Virtual Sound Source Positioning Using
Vector Base Amplitude Panning, Journal of the Audio
Engineering Society, vol. 45, no. 6, pp. 456-466.
active arc
vector base amplitude panning
I. intuitive
II. flexible
III. simulates distance
IV. simulates direction
V. minimal hardware
direction of illusory sound source:
volumeSpeakerLeft vs. volumeSpeakerRight
V. Pulkki, Virtual Sound Source Positioning Using
Vector Base Amplitude Panning, Journal of the Audio
Engineering Society, vol. 45, no. 6, pp. 456-466.
active
triangle
module III : simulation of directionality
I. intuitive
II. flexible
III. simulates distance
IV. simulates direction
V. minimal hardware
summary
an intuitive, flexible sound spatialization system with low
computational/hardware requirements, while maintaining
functionality of complex systems
Thanks!
Questions?