Multimedia Systems

(1) Create a login on the LML Course Manager: and then
(2) Register for Course: Multimedia Systems

Period: Fridays, 7 Sept - 30 Nov 2012
Time: 13:45-15:30
Place: rm. 403


Dr Michael Lew, (Lecturer) email: (Email to make an appointment)

Dr Erwin M. Bakker, (Lecturer) email:

Tom Groentjes, (Teaching Assistant) email:


At the end of the Multimedia Systems course, the student should be able to

- understand how scientific researchers view multimedia systems
- have insight into the state-of-the-art in the prominent areas of scientific multimedia research including social computing, advanced Internet technologies, speech recognition, robotics, computer vision, video tracking, and biometrics
- have insight into building a multimedia system from diverse core technologies.
- have insight into the challenges and limitations of current multimedia systems
- scientifically evaluate a multimedia system
- build a prototype multimedia system


Multimedia systems is a wide and diverse area. In this course we focus on the scientific view of multimedia systems as presented in major conferences and journals. The intention is to focus on current research trends such as social computing, speech recognition, robotics, and computer vision and gain insight into what is novel from a modern scientific perspective. From a practical standpoint, the technologies may be areas where the student will do further research, take in-depth courses in the specific area (i.e. Speech Understanding) or be used as components for future multimedia systems.

This is a masters level course, where instead of having only lectures and an exam, we have a combination of lectures and student presentations and novel programming projects. Two projects which emphasize the students vision on future multimedia technologies are mandatory: (1) In the future vision video project, the student is expected to show their own vision on how multimedia technology will effect society in the future. (2) In the final project, the students create a working prototype of a novel multimedia system based on thier own vision and interests. In summary, we show you the diverse landscape of multimedia technology as a broad foundation, and based on that foundation you develop your own interests and vision. This year, we will discuss the following topics in multimedia systems: speech recognition, social computing, robotics, vision & machine learning, video understanding & retrieval, and biometrics & face recognition.

There are workshops and project discussions during the semester, which are meant to provide reinforcement, practical experience, feedback and advice for each studentís application. Therefore, class discussion is important and is included as part of the grade.

Prerequisites: The student should be fluent in C/C++ programming (Equivalent of 6 months programming experience in C or C++)

Examination (6 EC):
- Multimedia Project: Design & Programming & Documentation for your multimedia system (60% of grade).
- Future Vision Project (10% of grade): Create a short video of the future.
- Class discussions, attendance (you should be at every class), homework, and problem sets (30% of grade).

Table of contents/Topics

- Introduction to multimedia systems
- Important areas of scientific multimedia research
- Challenges in scientific multimedia research
- Social computing
- Collaborative filtering
- Advanced internet technologies
- Speech recognition and audio analysis
- Robotics
- Planning
- Computer vision
- Video analysis and tracking
- Biometrics

Schedule (tentative): (Look on the forum for class notes)

Each lecture is meant to be a blend of past, present, and future trends

1. 07-09-2012: Social Computing I (Michael)
2. 14-09-2012: Future Vision Examples, Multimedia Project Discussions and Demos (Michael)
3. 21-09-2012: Social Computing II (Michael)
4. 28-09-2012: Project Discussions (Michael, Erwin)
5. 05-10-2012: Future Vision Projects Expo & Android Workshop (Michael, Erwin)
6. 12-10-2012: Speech Recognition (Erwin)
7. 19-10-2012: Speech Recognition Workshop (Erwin)
8. 26-10-2012: Robotics (Erwin)
9. 02-11-2012: Simulation Workshop (Erwin)
10. 09-11-2012: Computer Vision and Machine Learning I (Michael)
11. 16-11-2012: Vision and Machine Learning Workshop (Michael)
12. 23-11-2012: Computer Vision and Machine Learning II (Michael)
13. 30-11-2012: Multimedia Expo: Project Demos (the class)