Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition
Pourquoi ce travail est-il dans la base ?
Une base qui oublie comment elle a trouvé un travail ne peut pas être vérifiée. Voici les voies qui ont admis celui-ci.
Résumé
We propose a novel context-dependent (CD) model for large-vocabulary speech recognition (LVSR) that leverages recent advances in using deep belief networks for phone recognition. We describe a pre-trained deep neural network hidden Markov model (DNN-HMM) hybrid architecture that trains the DNN to produce a distribution over senones (tied triphone states) as its output. The deep belief network pre-training algorithm is a robust and often helpful way to initialize deep neural networks generatively that can aid in optimization and reduce generalization error. We illustrate the key components of our model, describe the procedure for applying CD-DNN-HMMs to LVSR, and analyze the effects of various modeling choices on performance. Experiments on a challenging business search dataset demonstrate that CD-DNN-HMMs can significantly outperform the conventional context-dependent Gaussian mixture model (GMM)-HMMs, with an absolute sentence accuracy improvement of 5.8% and 9.2% (or relative error reduction of 16.0% and 23.2%) over the CD-GMM-HMMs trained using the minimum phone error rate (MPE) and maximum-likelihood (ML) criteria, respectively.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
La notice
- Revue
- IEEE Transactions on Audio Speech and Language Processing
- Thématique
- Speech Recognition and Synthesis
- Domaine
- Computer Science
- Établissements canadiens
- University of Toronto
- Organismes subventionnaires
- Microsoft ResearchUniversity of TorontoMicrosoft
- Mots-clés
- Hidden Markov modelComputer scienceSpeech recognitionWord error rateArtificial intelligenceArtificial neural networkContext (archaeology)Mixture modelDeep neural networksSentenceGeneralizationPhoneDeep learningPattern recognition (psychology)VocabularyMathematics
- Résumé présent dans OpenAlex
- oui