Seminar Speech Recognition 2005

(Last updated: 10 - 3 2005)

Contents

 

 

Previous Seminars

 

Period: February 3rd - April 28th

Time:   Thursday 13.45 – 15.30

Place:  LIACS, Room 313

            (10-3, 17-3: Room 413)

 

Organizers:

Dr Erwin M. Bakker

Room 147 and LIACS Media Lab (LML), Email: erwin@liacs.nl

 

Drs Joost Broekens (Teaching Assistant)

Room 120, Tel: 071 527 5779, Email: broekens@liacs.nl

 

NB E-mail your name, phone, and college card number to erwin@liacs.nl

 

Abstract:

In this seminar all aspects of a state of the art speech recognition systems will be studied. The participation and contributions of the students is of great importance. There will be several programming assignments, reports, and presentations by the students.

Requirements: C, C++

Grading (7 ECTS): Design, Programming and Documentation for your speech recognition project plus further presentations (70% of grade). Class discussions, attendance, and problem sets (30% of grade). It is necessary to be at every class. If you can not be there, you must contact Dr. E.M. Bakker before class!

List of recommended books:

 

 

Spoken Language Processing: A Guide to Theory, Algorithm and System Development by Xuedong Huang , Alex Acero , Hsiao-Wuen Hon , Raj Reddy (Hardcover, 980 pages; Publisher: Prentice Hall PTR; ISBN: 0130226165; 1st edition, April 25, 2001) 

 

 

Speech Recognition: Theory and C++ Implementation by Claudio Bechetti and Lucio Prina Ricotti (Hardcover, 407 pages; Publisher: John Wiley & Sons; ISBN: 0471977306; 1st edition April, 1999)

 

 

Fundamentals of Speech Recognition by Lawrence Rabiner, and Biing-Hwang Juang (Hardcover, 507 pages; Publisher: Pearson Education POD; ISBN: 0130151572; 1st edition, April 12, 1993)

Links

VoiceXML

 

 

 

Tentative Schedule:

  1. 3 - 2: Introduction Speech Recognition

  2. 10 - 2: Continuous Speech Recognition (A technical overview); Projects: Teams

  3. 17 - 2: FFT, DFT, Short Time FFT

  4. 24 - 2: Project Proposals

  5. 3 - 3: Mel-Spectrum Computation, Mel-Spectrum to Mel-Cepstrum; Cepstral to Feature Stream. Projects: Proposals and Selection

  6. 10 - 3: Speech Recognition Workshop: Assignments; Code and Data; VoiceBox (Room 413)

  7. 17 - 3: Projects Progress Meeting (Room 413)

  8. 24 - 3:  Acoustic Modeling & Robustness, HMM model (Theory), HMM (Applications and Examples)

  9. 31 - 3 Phonemes, Triphones, Language Model

  10. 7 - 4: N-gram models, LM training, Search Algorithms

  11. 14 - 4: Preliminary Project Presentations and Discussions

  12. 21 - 4: To be announced.

  13. 28 - 4: Final Project Demos.

Presentations

Every student has to present 1 - 2 subjects in 20 minute lectures. The students have to rehearse their lecture beforehand with the organizers. In general, this will be scheduled on Tuesday afternoon, 2 days before the actual class.

Projects

During the seminar students have to do a project related to speech recognition. The project has to be based on problems identified in recent speech recognition research. The research publications can be found in the following journals:

  • Journal 1

  • Journal 2

 The agenda for the projects is as follows:

  1. Teams of 2 -3 students has to be formed.

  2. Proposals: Each member of the team has to propose a different subject based on a recent research publication. The (short) presentation of the proposal has to address:

    • Title of the proposal

    • Reference of the article

    • A short description of the problem(s) to be solved.

    • The state of the art with respect to these problems.

    • A (realistic) goal of the proposed project.

  3. Proposal selection by the organizers.

  4. Progress meeting.

  5. Preliminary project presentations.

  6. Final project demos.

 Teams of 2 - 3 students have to propose a project

Project Web Pages

Every team has to maintain a project web page on which the progress, documents, code, links, etc. related to the project are maintained. Here you can find the example project page. Do not forget to mail me the link to your project page.

Project Literature

A couple of journals that can be used to find a suitable problem for the speech recognition projects. We have electronic access to all of these (to access these journals use (1) your U-LIP account or (2) any computer within the university as these electronic sites use IP access checking). If you have problems accessing one of these journals, please contact Joost Broekens.

To efficiently search articles on a certain topic go to:
http://www.sciencedirect.com, click "Search", and type for example: Speech recognition (in first field) and review (second field) Or go to: www.ieee.org or www.acm.org and search for "speech recognition" or "speech synthesis". Many useful links can be found here.

Some review articles about problems or overviews of specific programs related to SR and technologies that can be found in the list of journals above when searching for "speech recognition" and "review":

  • Speech recognition by machines and humans

  • Speech recognition in adverse environments

  • Speech recognition algorithms for voice control interface.

  • Use of Speech Recognition Software: A Vocal Endurance Test for the New Millennium

  • Statistical language model adaptation: review and perspectives

  • Recent advances in the multi-stream HMM/ANN hybrid approach to noise

  • robust ASR

  • Speech recognition with unknown partial feature corruption – a review of the union model

  • A survey of hybrid ANN/HMM models for automatic speech recognition

  • The SPHINX-II speech recognition system: an overview

  • Speech recognition evaluation: a review of the U.S. CSR and LVCSR programmes

Some cool but more specific ones:

  • Robust speech recognition based on adaptive classification and decision strategies

  • Towards situated speech understanding: visual context priming of language models