Master's degree in Computer Science and Engineering

Master's degree in Computer Science and Engineering

Image Processing II (2020/2021)

Course code
4S003737
Credits
6
Coordinator
Gloria Menegaz
Other available courses
Academic sector
INF/01 - INFORMATICS
Language of instruction
Italian

Links



Teaching is organised as follows:
Activity Credits Period Academic staff
Teoria 5 I semestre Gloria Menegaz
Laboratorio 1 I semestre Gloria Menegaz

Go to lesson schedule

Learning outcomes

The course aims at providing competence about analysis, modeling and interpretation of multidimensional signals and images with focus on artificial vision and machine learning aspects, targeting applications in the field of multimedia and interpretable machine learning. At the end of the course the students will be able to autonomously solve typical problems requiring multidimensional signal modeling, feature extraction, analysis and interpretation of the outcomes of machine learning algorithms in the field of multimedia and artificial vision.

Syllabus

The course aims at providing competence about analysis, modeling and interpretation of multidimensional signals and images with focus on artificial vision and machine learning aspects, targeting applications in the field of multimedia and interpretable machine learning. At the end of the course the students will be able to autonomously solve typical problems requiring multidimensional signal modeling, feature extraction, analysis and interpretation of the outcomes of machine learning algorithms in the field of multimedia and artificial vision with particular focus on convolutional neural networks.

Syllabus
The course consists of three blocks: modeling of the Human Visual System (HVS), multiresolution signal representation and analysis of deep learning algorithms with focus Convolutional Neural Networks (CNNs).

Part 1: Human Visual System (HVS) – 10 hours
Introduction to Visual Intelligence
Foudations of vision, stimulus encoding, representation and interpretation
HVS modeling: multiscale processing of the visual stimuli, Contrast Sensitivity Function (CSF), color vision and perception, Color Matching Functions (CMFs)
High-level modeling of the HVS: structural and functional connectivity and graph-based modeling

Part 2: Multiresolution analysis – 20 hours
Background
Mathematical tools
Fourier transform in 1D and 2D
Windowed Fourier Transform
Wavelets and multiresolution representations
Wavelets Bases
Families of Wavelet Transforms (WT) and their properties
Fast Discrete Wavelet Tranforms (DWT)
WT in two dimensions
Scattering transform

Part 3: Application to the analysis and interpretation of deep convolutional neural networks (CNNs)– 10 hours
Overview on CNNs
The issue of interpretability, main approaches
CNN, HVS and multiresolution: getting to a unified view
CNN interpretation based on multiresolution theory and HVS models
Examples of interpretable DL

LABORATORY
Laboratory sessions will consist in Matlab and Python exercises on the topics covered in the theory lessons.

Assessment methods and criteria

The exam will consist of a project and a colloquium on the topics of the course.

Reference books
Activity Author Title Publisher Year ISBN Note
Teoria Stephane Mallat A Wavelet Tour of Signal Processing (Edizione 2) Academic Press 1999 9780124666061
Teoria Brian A. Wandell Foundations of Vision Sinauer Associates Inc 1995 0878938532




© 2002 - 2021  Verona University
Via dell'Artigliere 8, 37129 Verona  |  P. I.V.A. 01541040232  |  C. FISCALE 93009870234