next up previous
Next: Portable Content: Authoring For Up: SOUND SPATIALIZATION DEVELOPMENT ENVIRONMENT Previous: SOUND SPATIALIZATION DEVELOPMENT ENVIRONMENT

Soundscape Control

During the design of a helical keyboard [Herder-Cohen96], we became aware that global control of the mapping between visual space and acoustical space could improve the intended experience. A major part in the design was the soundscape. All keys had to be differentiable by location, especially direction. If the listener is placed in the center, then keys playing in the far upper part or lower part could not be well differentiated by azimuth, and also the volume for them was too low. As a solution to these problems we developed the soundscape deformer, a 3d widget that controls the scene space tex2html_wrap_inline522 soundscape mappinggif. The scene space can be shifted around, which induces a translation of the soundscape. In that regard the soundscape deformer can be seen as a generalization of stereo panning for 3D (e.g., balance potentiometer of an amplifier, also known as a pan [for panoramic] pot).

   figure59
Figure 1: Soundscape deformer

The soundscape deformer, shown in Figure 1, provides a visual representation of a linear mapping. A sphere in the center represents the case in which the scene space is directly mapped to the soundscape. The soundscape is fully interactively manipulatable via handles (the small boxes on the outside), bounding box, and orientation axes through a pointing device. Figure 2 shows the soundscape reduced in height, flattening the spatial audio position of all sound objects to a plane. Another example, shown in Figure 3, reduces the horizontal dimension, compressing the left tex2html_wrap_inline524 right attribute. As an extreme example, shown in Figure 4, the sphere can be reduced to a point, giving a diotic soundscape, in which all objects seem to be at one place inside the user's head.

   figure73
Figure 2: Soundscape deformer: flattening

   figure83
Figure 3: Soundscape deformer: narrowing

   figure93
Figure 4: Soundscape deformer: extreme diotic case


next up previous
Next: Portable Content: Authoring For Up: SOUND SPATIALIZATION DEVELOPMENT ENVIRONMENT Previous: SOUND SPATIALIZATION DEVELOPMENT ENVIRONMENT

Jens Herder
Thu Nov 27 20:28:38 JST 1997