This study aims to decode the hemodynamic responses evoked by multiple sound-categories using functional near-infrared spectroscopy. The six different sounds were given as stimuli. The oxy-hemoglobin concentration changes are measured in both hemispheres of the auditory cortex while 18 healthy subjects listen to 10-s blocks of six sound-categories. Long short-term memory networks were used as a classifier. The classification accuracy was 20.38 ± 4.63% with six class classification. Though LSTM networks’ performance was a little higher than chance levels, it is (...) noteworthy that we could classify the data subject-wise without feature selections. (shrink)