Sound in Interaction
A.Y. 2024/2025
Learning objectives
The course aims at providing students with knowledge regarding principles and technologies for the design, the synthesis, and the rendering of sound in interactive contexts. The main application domains include multimodal virtual and augmented realities, sonic interaction design, assistive interfaces, digital musical instruments.
Expected learning outcomes
At the end of the course, the student shall be able to design models for the synthesis and rendering of sound, and to implement them on real-time plaftorms. Additionally, the student shall be able to effectively communicate the learning outcomes, using the modalities of scientific writing.
Lesson period: First semester
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.
Course syllabus and organization
Single session
Responsible
Lesson period
First semester
Course syllabus
1) Introduction to audio for virtual reality
- Rendering pipeline
- Approaches to audio synthesis and rendering
- Immersion and presence
2) Procedural models for sound synthesis
- Signal-based synthesis
- Source-based synthesis and physical modeling
- Latency, perceptual and computational aspects
3) 3D sound rendering
- Spatial sound perception
- Reverberation and virtual acoustics
- Binaural rendering
4) Software tools for audio in VR
- Basics of real-time audio processing
- Introduction to the Pure-Data environment
- Introduction to "audio middleware" software (FMOD)
- Rendering pipeline
- Approaches to audio synthesis and rendering
- Immersion and presence
2) Procedural models for sound synthesis
- Signal-based synthesis
- Source-based synthesis and physical modeling
- Latency, perceptual and computational aspects
3) 3D sound rendering
- Spatial sound perception
- Reverberation and virtual acoustics
- Binaural rendering
4) Software tools for audio in VR
- Basics of real-time audio processing
- Introduction to the Pure-Data environment
- Introduction to "audio middleware" software (FMOD)
Prerequisites for admission
There are no specific prerequisites other than those required to enroll into the master degree.
Teaching methods
The entire course is taught by lectures.
Teaching Resources
Web site:
http://favanzinisi.ariel.ctu.unimi.it
For the part on procedural models for sound synthesis:
- Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering:
- Bosun Xie, "Head-related transfer function and virtual auditory display",
2nd edition, J. Ross Publishing (2013)
- Frank Zotter and Matthias Frank, "Ambisonics"
Springer Open (2019)
https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers.
Additional complementary material prepared by the instructor is made available through the web site of the course.
http://favanzinisi.ariel.ctu.unimi.it
For the part on procedural models for sound synthesis:
- Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering:
- Bosun Xie, "Head-related transfer function and virtual auditory display",
2nd edition, J. Ross Publishing (2013)
- Frank Zotter and Matthias Frank, "Ambisonics"
Springer Open (2019)
https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers.
Additional complementary material prepared by the instructor is made available through the web site of the course.
Assessment methods and Criteria
The exam consists of a written test (multiple choice/open questions) and the development of a project, which has to be documented through a written essay in the form of a scientific paper, and has to be critically discussed in an oral test. The project can be developed individually or in a group of two students.
The evaluation is given in thirtieths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.
The evaluation is given in thirtieths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.
INF/01 - INFORMATICS - University credits: 6
Lessons: 48 hours
Professor:
Avanzini Federico
Shifts:
Turno
Professor:
Avanzini FedericoProfessor(s)