Advanced Mathematical Statistics
A.Y. 2026/2027
Learning objectives
This course provides a rigorous introduction to Gaussian Processes (GPs) and their role in nonparametric statistics, machine learning, and probabilistic artificial intelligence. Students will develop a solid mathematical understanding of Gaussian processes, covariance functions, and kernel methods, together with practical skills for implementing and applying GP-based models.
Expected learning outcomes
Upon completion of the course, students will have acquired a solid theoretical understanding of Gaussian processes and the main mathematical and statistical tools associated with them, including positive definite kernels, Bayesian inference, and nonparametric modeling. They will be able to develop and analyze Gaussian process models and apply them to regression, classification, spatio-temporal data analysis, and probabilistic machine learning problems. Students will also gain practical experience in implementing such models using Python and PyTorch, developing critical skills in uncertainty quantification, covariance function design, and the application of advanced probabilistic methodologies to modern artificial intelligence.
Lesson period: First semester
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.
Course syllabus and organization
Single session
Responsible
Lesson period
First semester
Course syllabus
Introduction to Gaussian processes and their probabilistic foundations. Finite-dimensional distributions, mean and covariance functions, Gaussian processes, and fundamental existence results. Positive definite kernels, Mercer and Bochner theorems, spectral representations, and an introduction to reproducing kernel Hilbert spaces. Bayesian inference with Gaussian processes: Gaussian conditioning, regression, posterior and predictive distributions, marginal likelihood, and hyperparameter estimation. Models for multidimensional and spatio-temporal data. Applications to machine learning, including kernel methods, Gaussian process classification, Bayesian optimization, and approximation techniques. Introduction to Deep Gaussian Processes, connections with neural networks, and probabilistic approaches to artificial intelligence. Computational laboratories in Python and PyTorch focused on the implementation and analysis of Gaussian process models.
Prerequisites for admission
Students are expected to have a solid background in probability theory, mathematical statistics, real analysis, linear algebra, and matrix computations. Basic familiarity with scientific programming in Python is recommended.
Teaching methods
The course consists of 42 hours of lectures and 36 hours of computational laboratory activities. Lectures focus on mathematical theory, proofs, and statistical modeling, while laboratory sessions provide hands-on experience with Python and PyTorch implementations. Collaborative activities are integrated into laboratory sessions to promote discussion and problem-solving. The course is organized over approximately 7 hours per week, including up to 4 hours of laboratory work.
Teaching Resources
Rasmussen, C. E., Williams, C. K. I., Gaussian Processes for Machine Learning, MIT Press.
Murphy, K. P., Probabilistic Machine Learning: Advanced Topics, MIT Press.
Stein, M. L., Interpolation of Spatial Data: Some Theory for Kriging, Springer.
Genton, M. G. (Ed.), Covariance Functions and Their Applications.
Neal, R. M., Bayesian Learning for Neural Networks.
Murphy, K. P., Probabilistic Machine Learning: Advanced Topics, MIT Press.
Stein, M. L., Interpolation of Spatial Data: Some Theory for Kriging, Springer.
Genton, M. G. (Ed.), Covariance Functions and Their Applications.
Neal, R. M., Bayesian Learning for Neural Networks.
Assessment methods and Criteria
Assessment is based on five intermediate evaluations combining theoretical and computational components.
MATH-03/B - Probability and Mathematical Statistics - University credits: 9
Laboratories: 36 hours
Lessons: 42 hours
Lessons: 42 hours
Professors:
Aletti Giacomo, Micheletti Alessandra
Professor(s)
Reception:
on appointment
office 2099