This work applies one of the recent visualization techniques used in computer vision domain ‘layer-wise relevance propagation’ algorithm for kernels and deep neural networks in automatic speech recognition task. It attempts to make the hidden layers in deep learning systems more interpretable by adding another visualization tool.