Multimedia Systems and Interaction Design
A.Y. 2025/2026
Learning objectives
The course aims to provide an in-depth understanding of the principles and technologies underlying multimedia systems, with a specific focus on Interaction Design and methodologies for designing effective user experiences. Students will acquire theoretical knowledge and practical skills related to multimedia architectures, interaction models, and usability criteria, with particular attention to optimizing the user experience in complex digital environments.
Expected learning outcomes
By the end of the course, students will be able to:
- Analyze and understand the architectures and interaction models of multimedia systems.
- Apply Interaction Design principles to the design of interfaces and interactive systems.
. Evaluate the usability and accessibility of multimedia solutions through empirical and analytical methods.
- Develop and implement strategies to enhance the user experience in complex digital contexts.
- Utilize advanced tools and technologies for the design and development of innovative multimedia systems.
The teaching approach integrates theory and practice, combining lectures, case study analysis, project-based activities, and laboratory sessions to ensure a solid and applicable learning experience in both academic and professional contexts.
- Analyze and understand the architectures and interaction models of multimedia systems.
- Apply Interaction Design principles to the design of interfaces and interactive systems.
. Evaluate the usability and accessibility of multimedia solutions through empirical and analytical methods.
- Develop and implement strategies to enhance the user experience in complex digital contexts.
- Utilize advanced tools and technologies for the design and development of innovative multimedia systems.
The teaching approach integrates theory and practice, combining lectures, case study analysis, project-based activities, and laboratory sessions to ensure a solid and applicable learning experience in both academic and professional contexts.
Lesson period: Second four month period
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.
Course syllabus and organization
Single session
Responsible
Lesson period
Second four month period
Course syllabus
General Introduction
- Multimedia and digital communication: definitions, application domains, trends
- Recap of Interaction Design fundamentals: principles, processes, mental models, affordance, and mapping
Design of Interactive Systems for Multimedia Content
- Multimedia data modeling
- Object-Relational Database Management Systems (ORDBMS)
- Multimedia extensions in Oracle (e.g., Oracle Multimedia)
Management of Digital Texts
- Information Retrieval models: boolean, vector space, probabilistic
- Text IR vs relational databases
- Oracle Text and IR systems such as Solr
Management of Digital Images
- Visual perception and color models (RGB, CMYK, HSV)
- Formats and standards for digital images: GIF, PNG, TIFF, JPEG
- Image retrieval: from low-level content to semantic representations
- Image IR techniques: Query by Sample Example (QBSE), MediaPipe Image Embedders, OpenAI CLIP
Management of Audio Content
- Sampling, quantization, signal-to-noise ratio
- Standards and compression: WAV, AIFF, MP3, AAC
- Psychoacoustics: critical bands, spatial and temporal masking
Management of Video Content
- Color models for video, compression techniques (predictive coding, motion vectors)
- Video standards: MPEG, H.264
- Integrated audio-video management and IR with Oracle Multimedia
Multimedia Information Systems and Metadata
- Standards for content description: MPEG-7
- Metadata languages, ontologies, and semantic enrichment
Interactive Systems and Generative AI
- Design of Question Answering systems
- Designing with Generative AI
- Retrieval-Augmented Generation (RAG): architecture and applications
- Prompt engineering for optimizing generative experiences
Conversational Experience Design
- Conversation models and design of dialog flows
- Building conversational agents with DialogFlow and LLM-based chatbots
- Criteria for coherence, context-awareness, personalization, and engagement
Architectures and Interaction in Real-Time Environments
- Operating systems and challenges for real-time interactive media
- Synchronization and temporal management of multimedia data
- Quality of Service: technical parameters and perceived quality
- Scheduling and network protocols for real-time multimedia (e.g., RTP, RTCP)
User Experience Evaluation Methods
- Usability, accessibility, and UX in multimedia systems
- Empirical and analytical evaluation techniques: Quantitative measures: SUS (System Usability Scale), UTAUT, CTS, NASA-TLX and Qualitative feedback
- Evaluation of generative AI integration in multimedia projects
Analysis of Technology Adoption and Acceptance Potential
- Project-based and lab activities
- Hands-on sessions with advanced tools and technologies (e.g., Oracle Text, DialogFlow, MediaPipe, LLM-based tools)
- Case study analysis of real-world applications
- Multimedia and digital communication: definitions, application domains, trends
- Recap of Interaction Design fundamentals: principles, processes, mental models, affordance, and mapping
Design of Interactive Systems for Multimedia Content
- Multimedia data modeling
- Object-Relational Database Management Systems (ORDBMS)
- Multimedia extensions in Oracle (e.g., Oracle Multimedia)
Management of Digital Texts
- Information Retrieval models: boolean, vector space, probabilistic
- Text IR vs relational databases
- Oracle Text and IR systems such as Solr
Management of Digital Images
- Visual perception and color models (RGB, CMYK, HSV)
- Formats and standards for digital images: GIF, PNG, TIFF, JPEG
- Image retrieval: from low-level content to semantic representations
- Image IR techniques: Query by Sample Example (QBSE), MediaPipe Image Embedders, OpenAI CLIP
Management of Audio Content
- Sampling, quantization, signal-to-noise ratio
- Standards and compression: WAV, AIFF, MP3, AAC
- Psychoacoustics: critical bands, spatial and temporal masking
Management of Video Content
- Color models for video, compression techniques (predictive coding, motion vectors)
- Video standards: MPEG, H.264
- Integrated audio-video management and IR with Oracle Multimedia
Multimedia Information Systems and Metadata
- Standards for content description: MPEG-7
- Metadata languages, ontologies, and semantic enrichment
Interactive Systems and Generative AI
- Design of Question Answering systems
- Designing with Generative AI
- Retrieval-Augmented Generation (RAG): architecture and applications
- Prompt engineering for optimizing generative experiences
Conversational Experience Design
- Conversation models and design of dialog flows
- Building conversational agents with DialogFlow and LLM-based chatbots
- Criteria for coherence, context-awareness, personalization, and engagement
Architectures and Interaction in Real-Time Environments
- Operating systems and challenges for real-time interactive media
- Synchronization and temporal management of multimedia data
- Quality of Service: technical parameters and perceived quality
- Scheduling and network protocols for real-time multimedia (e.g., RTP, RTCP)
User Experience Evaluation Methods
- Usability, accessibility, and UX in multimedia systems
- Empirical and analytical evaluation techniques: Quantitative measures: SUS (System Usability Scale), UTAUT, CTS, NASA-TLX and Qualitative feedback
- Evaluation of generative AI integration in multimedia projects
Analysis of Technology Adoption and Acceptance Potential
- Project-based and lab activities
- Hands-on sessions with advanced tools and technologies (e.g., Oracle Text, DialogFlow, MediaPipe, LLM-based tools)
- Case study analysis of real-world applications
Prerequisites for admission
Database and Human-Computer Interaction
Teaching methods
Lectures with discussions and presentations of case studies
Teaching Resources
Slides of the lectures in MyARIEL
In the slides are reported books, articles websites useful both for studying and insight.
Basic Readings:
- Z. Li, M. Drew. Fundamentals of Multimedia, Pearson Educational, 2004
- Multimedia Applications. In B. Fuhrt (ed), Handbook of Internet Computing, CRC Press, 2000
In the slides are reported books, articles websites useful both for studying and insight.
Basic Readings:
- Z. Li, M. Drew. Fundamentals of Multimedia, Pearson Educational, 2004
- Multimedia Applications. In B. Fuhrt (ed), Handbook of Internet Computing, CRC Press, 2000
Assessment methods and Criteria
Methods of verification are:
1. Written test (max grade 30/30)
2. Oral test, Thematic Deepening, Project (optional) that will result in an increase or decrease in the grade of the written test by + or - 3 points
The evaluation criteria of the written test concern:
- Knowledge of the content
- Adherence of the response to the track
- Ability to make connections
- The relevance of the contents in relation to the question
The evaluation criteria of the oral test/thematic deepening/project concern:
- the focus of the issue
- logical rigour and use of technical language
- fairness and clarity of exposure
- The critical awareness, personal interpretation skills, richness and relevance of the oral presentation
1. Written test (max grade 30/30)
2. Oral test, Thematic Deepening, Project (optional) that will result in an increase or decrease in the grade of the written test by + or - 3 points
The evaluation criteria of the written test concern:
- Knowledge of the content
- Adherence of the response to the track
- Ability to make connections
- The relevance of the contents in relation to the question
The evaluation criteria of the oral test/thematic deepening/project concern:
- the focus of the issue
- logical rigour and use of technical language
- fairness and clarity of exposure
- The critical awareness, personal interpretation skills, richness and relevance of the oral presentation
Professor(s)