The course aims at providing students with knowledge regarding principles and technologies for the design, the synthesis, and the rendering of sound in interactive contexts. The main application domains include multimodal virtual and augmented realities, sonic interaction design, assistive interfaces, digital musical instruments.
Expected learning outcomes
At the end of the course, the student shall be able to design models for the synthesis and rendering of sound, and to implement them on real-time plaftorms. Additionally, the student shall be able to effectively communicate the learning outcomes, using the modalities of scientific writing.
Lesson period: First semester
(In case of multiple editions, please check the period, as it may vary)
The program is focused on the following topics 1) Procedural models for sound synthesis - Signal-based synthesis - Source-based synthesis and physical modeling - Latency, perceptual and computational aspects 2) 3D sound rendering - Spatial sound perception - Reverberation and virtual acoustics - Binaural rendering The main employed software tool is Pure-Data - Introduction to the pure-data environment - Dataflow and control - Managing real-time audio - Video processing
Prerequisites for admission
There are no specific prerequisites other than those required to enroll into the master degree.
For the part on procedural models for sound synthesis: - Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering: - Bosun Xie, "Head-related transfer function and virtual auditory display", 2nd edition, J. Ross Publishing (2013) - Frank Zotter and Matthias Frank, "Ambisonics" Springer Open (2019) https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers. Additional complementary material prepared by the instructor is made available through the web site of the course.
Assessment methods and Criteria
The exam consists of the development of a project, which has to be documented through a written essay in the form of a scientific paper, and has to be critically discussed in an oral test. The project can be developed individually or in a group of two students. The evaluation is given in 30ths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.