Seminar Audio Processing and Indexing

(Will be updated. Last updated: 30-5 2022
ML Workshop added
and new deadlines as discussed during class
.)

Contents

 

 



Period: Spring February 8th - May 23rd 2022

Time:   Tuesday 11.15 - 13.00

Place:  Room 312 (Snellius)

 

Organizers:

 

Lecturer:

Dr Erwin M. Bakker ( erwin@liacs.nl )

Room 126a and LIACS Media Lab (LML)

 

Teaching assistant:

to be announced

 

NB Register on BrightSpace.

 

Abstract:

During this seminar the fundamentals of audio processing and indexing will be studied. Applications in the area of speech recognition, audio synthesis and content based audio retrieval will be discussed. State of the art work on content based audio retrieval will be studied and presented by the participants.

The seminar starts with several lectures and accompanying assignments in the form of workshops; followed by a literature selection, study, and presentations by all the students; the seminar ends with final project demos / presentations.

Requirements: C, C++

Grading (6 ECTS): Presentations and Project (60% of grade). Class discussions, attendance, and workshops (40% of grade). It is necessary to be at every class and to complete every workshop. If you can not be there, you must contact Dr. E.M. Bakker before class!

Materials:

 

Lecture slides and further materials will be made available on this site.

 

List of recommended books:

 

Discrete-Time Speech Signal Processing, Principles and Practice by T.F. Quatieri, Prentice Hall PTR; ISBN 013242942, 2002.

 

Fundamentals of Speech Recognition by Lawrence Rabiner, and Biing-Hwang Juang (Hardcover, 507 pages; Publisher: Pearson Education POD; ISBN: 0130151572; 1st edition, April 12, 1993)

 

Spoken Language Processing: A Guide to Theory, Algorithm and System Development by Xuedong Huang , Alex Acero , Hsiao-Wuen Hon , Raj Reddy (Hardcover, 980 pages; Publisher: Prentice Hall PTR; ISBN: 0130226165; 1st edition, April 25, 2001) 

 

Speech Recognition: Theory and C++ Implementation by Claudio Bechetti and Lucio Prina Ricotti (Hardcover, 407 pages; Publisher: John Wiley & Sons; ISBN: 0471977306; 1st edition April, 1999)

Links

 

 

Schedule (tentative, visit regularly):
8-2
 Organization and Introduction
15-2  Audio Production and Processing
22-2
 ADC and an Algebraic Introduction to FT
1-3  No Class (See Brightspace)
4-3
 Question hour: Project Proposals
( See Brightspace: 13.00 Kaltura )
8-3  Project Proposals (presentations by students)
15-3
 FFT & FFT Workshop
22-3  Audio Features & workshop and data
29-3
 No Class
5-4
 Machine Learning
12-4  Student Paper Presentations I
19-4  Student Paper Presentations II
26-4  Student Paper Presentations III
3-5  Student Paper Presentations IV
10-5
 No Class
 Online Final Project Progress Meetings
 (Schedule will be available on Brightspace)
17-5
 No Class
24-5  Final Project Presentations Demo's
3-6
 Project Deliverables: Final Technical Project Paper (4-8 pages), code, and  Web Site (or github)
Due: 20-6 2022 (as discussed during class)

Assignments (workshops):

  1. Vocal Tract Workshop. Due: 22-2 2022.
  2. FFT Workshop and audio_data. Due 22-3 2022 before 23.59.
  3. Audio Features Workshop. Due 20-6 2022
  4. Machine Learning Workshop. Due 20-6 2022
Project Links

Student Paper-Presentations Session I-III

Previous Project Titles and Pages

2021
2020 -
  • Second Voice Generation
  • Robustness of Musical Genre Identification
  • Improved Mobile Song Recognition
  • An iOS App using Bliss for Improved Communication through Text-To-Speech
  • ScoreAid
  • Emotion Recognition
  • Instrument Detection
  • Musical Instrument Recognizer ( Annotation  )
  • Audio Feature Extraction with Deep Belief Networks
  • Audio Morphing
  • Audio Indexing the 1.000.000 song data set
  • Chord Recognition
  • Audio Phantom Materialization
  • Harmonic Model Based Audio Transformations
  • Content-Based Music Similarity, Visualization and Automatic Play-List Generation.
  • Indexing and Predicting Bands from Unknown Songs
  • Interpolation between Different Instruments
  • Modular Synthesizer
  • Hit Predictor
  • Pitch Perfector
  • Inter-Voice Morphing

Presentations

During the seminar we will study state-of-the-art audio indexing methods and techniques using recent scientific publications from international journals, workshops, and conferences on content based audio retrieval.

Each student will present a recent technical paper:

  • Each student will have to select 1 very recent scientific publications on audio processing and/or indexing.

  • Each student will study the selected paper into great detail, and present it during a 12 minutes talk followed by 3 minutes of questions for a critical audience.

  • In order to ensure a critical audience, every student in class is expected to have read at least the title, abstract and conclusions of the papers to be presented. Also every student is expected to have prepared at least one question per paper.

Projects

During the seminar each student has to do a project related to audio processing/synthesis/indexing.

The agenda for the projects is as follows:

  1. Project proposal presentation using the website for the project. It has to address:

    • Title of the proposal.

    • Reference(s) of the paper(s).

    • A short description of the problem(s) to be solved.

    • The state of the art with respect to these problems.

    • A (realistic) goal of the proposed project.

  2. Project status reports.

  3. Final project presentation / demo.

  4. Final technical project paper.

Project Web Pages

Every student has to maintain a project web page on which progress, documents, code, links, etc. related to the project are maintained. Here you can find an example project page. Feel free to design your own project web page though. Do not forget to mail me the link to your project page.

Note: Using your university account you can put your web-page under a directory \home\public_html.

Journals

You have access to all of the listed journals by using your ULCN-
account (for further details see http://www.bibliotheek.leidenuniv.nl/ ):