Supervised Sequence Labelling with Recurrent Neural Networks

Graves, Alex

ISBN 10: 3642432182 / ISBN 13: 9783642432187

Verlag: Springer-Verlag Berlin and Heidelberg GmbH & Co. KG, 2014

This book offers a complete framework for classifying and transcribing sequential data with recurrent neural networks. It uses state-of-the-art results in speech and handwriting recognition to show the framework in action. Series: Studies in Computational Intelligence. Num Pages: 146 pages, biography. BIC Classification: UYQN. Category: (P) Professional & Vocational. Dimension: 235 x 155 x 10. Weight in Grams: 254. . 2014. Paperback. . . . . Books ship from the US and Ireland. Bestandsnummer des Verkäufers V9783642432187

Inhaltsangabe:

Supervised sequence labelling is a vital area of machine learning, encompassing tasks such as speech, handwriting and gesture recognition, protein secondary structure prediction and part-of-speech tagging. Recurrent neural networks are powerful sequence learning tools—robust to input noise and distortion, able to exploit long-range contextual information—that would seem ideally suited to such problems. However their role in large-scale sequence labelling systems has so far been auxiliary.

The goal of this book is a complete framework for classifying and transcribing sequential data with recurrent neural networks only. Three main innovations are introduced in order to realise this goal. Firstly, the connectionist temporal classification output layer allows the framework to be trained with unsegmented target sequences, such as phoneme-level speech transcriptions; this is in contrast to previous connectionist approaches, which were dependent on error-prone prior segmentation. Secondly, multidimensional recurrent neural networks extend the framework in a natural way to data with more than one spatio-temporal dimension, such as images and videos. Thirdly, the use of hierarchical subsampling makes it feasible to apply the framework to very large or high resolution sequences, such as raw audio or video.

Experimental validation is provided by state-of-the-art results in speech and handwriting recognition.

Von der hinteren Coverseite:

Supervised sequence labelling is a vital area of machine learning, encompassing tasks such as speech, handwriting and gesture recognition, protein secondary structure prediction and part-of-speech tagging. Recurrent neural networks are powerful sequence learning tools--robust to input noise and distortion, able to exploit long-range contextual information--that would seem ideally suited to such problems. However their role in large-scale sequence labelling systems has so far been auxiliary.

The goal of this book is a complete framework for classifying and transcribing sequential data with recurrent neural networks only. Three main innovations are introduced in order to realise this goal. Firstly, the connectionist temporal classification output layer allows the framework to be trained with unsegmented target sequences, such as phoneme-level speech transcriptions; this is in contrast to previous connectionist approaches, which were dependent on error-prone prior segmentation. Secondly, multidimensional recurrent neural networks extend the framework in a natural way to data with more than one spatio-temporal dimension, such as images and videos. Thirdly, the use of hierarchical subsampling makes it feasible to apply the framework to very large or high resolution sequences, such as raw audio or video.

Experimental validation is provided by state-of-the-art results in speech and handwriting recognition.

Bibliografische Details

Titel: Supervised Sequence Labelling with Recurrent...
Verlag: Springer-Verlag Berlin and Heidelberg GmbH & Co. KG
Erscheinungsdatum: 2014
Einband: Softcover
Zustand: New