Procedural and Spatial Sound
A.Y. 2025/2026
Learning objectives
The course aims at providing students with knowledge regarding principles and technologies for the design, the synthesis, and the rendering of sound in interactive contexts, with a focus on procedural approaches for synthesis and on sound spatialization techniques. The main application domains include immersive virtual and augmented realities, audio for videogames, interactive sonification, multimodal 3D user interfaces.
Expected learning outcomes
At the end of the course, the student shall know the main concepts related to procedural approaches to sound synthesis and techniques for sound spatialization based on multichannel and binaural approaches. Additionally, the student shall be able to design models for the synthesis and rendering of sound, and to implement them on real-time plaftorms.
Lesson period: First four month period
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course can be attended as a single course.
Course syllabus and organization
Single session
Responsible
Lesson period
First four month period
Course syllabus
The program is focused on the following topics
1) Introduction to audio for virtual reality
- Rendering pipeline
- Approaches to audio synthesis and rendering
- Immersion and presence
2) Procedural models for sound synthesis
- Signal-based synthesis
- Source-based synthesis and physical modeling
- Latency, perceptual and computational aspects
3) 3D sound rendering
- Spatial sound perception
- Reverberation and virtual acoustics
- Binaural rendering
4) Software tools for audio in VR
- Basics of real-time audio processing
- Introduction to the Pure-Data environment
- Introduction to "audio middleware" software (FMOD)
1) Introduction to audio for virtual reality
- Rendering pipeline
- Approaches to audio synthesis and rendering
- Immersion and presence
2) Procedural models for sound synthesis
- Signal-based synthesis
- Source-based synthesis and physical modeling
- Latency, perceptual and computational aspects
3) 3D sound rendering
- Spatial sound perception
- Reverberation and virtual acoustics
- Binaural rendering
4) Software tools for audio in VR
- Basics of real-time audio processing
- Introduction to the Pure-Data environment
- Introduction to "audio middleware" software (FMOD)
Prerequisites for admission
There are no specific prerequisites other than those required to enroll into the master degree.
Teaching methods
The entire course is taught by lectures.
Teaching Resources
Web site:
https://myariel.unimi.it/course/view.php?id=7243
For the part on procedural models for sound synthesis:
- Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering:
- Bosun Xie, "Head-related transfer function and virtual auditory display",
2nd edition, J. Ross Publishing (2013)
- Frank Zotter and Matthias Frank, "Ambisonics"
Springer Open (2019)
https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers.
Additional complementary material prepared by the instructor is made available through the web site of the course.
https://myariel.unimi.it/course/view.php?id=7243
For the part on procedural models for sound synthesis:
- Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering:
- Bosun Xie, "Head-related transfer function and virtual auditory display",
2nd edition, J. Ross Publishing (2013)
- Frank Zotter and Matthias Frank, "Ambisonics"
Springer Open (2019)
https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers.
Additional complementary material prepared by the instructor is made available through the web site of the course.
Assessment methods and Criteria
The exam consists of a written test (multiple choice/open questions) and the development of a project, which has to be critically discussed in an oral test. The project can be developed individually or in a group of two students.
The evaluation is given in thirtieths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.
The evaluation is given in thirtieths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.
Professor(s)