Time-Delay Neural Networks for Speech Recognition, neural network lecture notes
Time-delay neural networks (TDNNs) acquire temporal speech information. Time-delay input frames allow the weights in the initial layers to account for time variations in speech. Like the MLP, they are feed forward networks. Figure shows a basic TDNN scheme for the phoneme category task. TDNNs are good at recognition of sub word units from continuous speech.