Multimedia Systems and Interaction Design

A.Y. 2026/2027
6
Max ECTS
48
Overall hours
SSD
INFO-01/A
Language
Italian
Learning objectives
The course aims to provide students with advanced knowledge of
interactive multimedia systems, with a focus on modeling, management,
search, and use of multimedia content in complex and data-driven contexts.
Upon completion of the course, students will be able to:
- understand and design interactive multimedia systems based on advanced
data models;
- apply Information Retrieval and Multimedia Retrieval techniques,
including vector representations and semantic embeddings;
- integrate generative Artificial Intelligence technologies (Large
Language Models, Retrieval-Augmented Generation, conversational agents)
in a controlled and reliable manner;
- evaluate the user experience (UX) and technological acceptance of
multimedia and AI-driven systems;
- analyze the architectural and real-time constraints (QoS and QoE) that
influence the quality of interaction.
The course provides adequate theoretical and methodological preparation
for access to advanced research and industrial development contexts in
multimedia systems and interactive AI.
Expected learning outcomes
Knowledge and Understanding.
The student will acquire in-depth knowledge of:
- data models for multimedia content;
- multimedia retrieval and multimodal retrieval architectures;
- text, image, audio, and video retrieval techniques;
- generative AI systems applied to interaction;
- user experience evaluation methodologies.

Ability to apply knowledge and understanding.
The student will be able to:
- design systems for searching and accessing multimedia content;
- use semantic representations and embeddings for retrieval;
- develop RAG pipelines and AI-based conversational systems;
- critically evaluate alternative technological solutions.

Making independent judgments.
The student will develop the following skills:
- critically analyze multimedia and AI-driven architectures;
- evaluate the trade-offs between technical quality and perceived quality;
- Evaluate the reliability, usability, and acceptability of designed
systems.

Communication skills.
The student will be able to:
- clearly and rigorously describe architectures and design solutions;
- discuss technological choices using appropriate technical language;
- present design and experimental results.

Learning skills.
The student will acquire the conceptual tools to:
- independently update themselves on emerging technologies in the field;
- deepen research topics in multimedia, IR, and interactive AI.
Single course

This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.

Course syllabus and organization

Single session

Responsible
Lesson period
Second four month period
Course syllabus
- Multimedia systems and digital communication
- Designing interactive experiences and user experience for intelligent systems
- Managing images, audio, video, and AI-generated content in modern databases
- Search engines and Information Retrieval: how systems "understand" and retrieve information
- Full-text search, ranking, and real-world search engines with Oracle Text and Apache Solr
- Large Language Models, ChatGPT, Transformers, and embeddings
- Vector databases and Retrieval-Augmented Generation (RAG) for advanced AI systems
- Conversational AI and intelligent chatbot design
- Image Retrieval using visual similarity and embeddings
- Audio and Video Retrieval, segmentation, and multimodal retrieval
- CLIP, multimodal AI, and cross-modal text-image-audio-video retrieval
- MPEG-7 and semantic multimedia description
- Distributed systems, streaming, Quality of Service (QoS), and Quality of Experience (QoE)
- Evaluation of intelligent systems based on Generative AI and multimedia retrieval
Prerequisites for admission
It is advisable but not mandatory to have basic knowledge of subjects such as databases and Human-Computer Interaction.
Teaching methods
Lectures with discussions and presentations of case studies
Teaching Resources
Slides of the lectures in MyARIEL

In the slides are reported books, articles websites useful both for studying and insight.
Basic Readings:
- Z. Li, M. Drew. Fundamentals of Multimedia, Pearson Educational, 2004
- Multimedia Applications. In B. Fuhrt (ed), Handbook of Internet Computing, CRC Press, 2000
- Moore, R. J., & Arar, R. (2019). Conversational UX design: A practitioner's guide to the natural conversation framework. Morgan & Claypool.
- Moore, R. J., An, S., & Ren, G. J. (2023). The IBM natural conversation framework: a new paradigm for conversational UX design. Human-Computer Interaction, 38(3-4), 168-193.
Assessment methods and Criteria
Methods of verification are:
1. Written test (max grade 30/30)
2. Oral test, Thematic Deepening, Project (optional) that will result in an increase or decrease in the grade of the written test by + or - 3 points

The evaluation criteria of the written test concern:
- Knowledge of the content
- Adherence of the response to the track
- Ability to make connections
- The relevance of the contents in relation to the question

The evaluation criteria of the oral test/thematic deepening/project concern:
- the focus of the issue
- logical rigour and use of technical language
- fairness and clarity of exposure
- The critical awareness, personal interpretation skills, richness and relevance of the oral presentation
INFO-01/A - Informatics - University credits: 6
Lessons: 48 hours
Professor: Valtolina Stefano
Shifts:
Turno
Professor: Valtolina Stefano
Professor(s)
Reception:
On appointment
via Celoria 18, Third floor, Room 3006