Does someone’s ability to hear a speech signal give us all the information we need?
Communication entails more than exchanging words. Voices carry vital information about their internal states as well, such as emotion. Listen to the samples below from the Toronto Emotional Speech Test (TESS) – they have the same words but clearly convey different emotions.
We can all agree that knowing a talker’s emotional state is important information for a listener. Unfortunately, when it comes to hearing aid benefits, little is known about how hearing aids affect users’ perception of emotion in speech.
I was recently an investigator in a study that looked at how hearing aid use affected the perception of emotion in speech and the recognition of speech spoken with emotion. Interestingly, we found that the use of hearing aids improved listeners’ word recognition performance from 43% correct (unaided) to 68% correct (aided), but that hearing aids did not improve listeners’ ability to identify emotions (38% unaided, compared to 40% aided). In short, hearing aids improved the recognition of what was spoken but hearing aids did not improve the listeners’ ability to identify the emotion being conveyed.
Since this study, I joined several colleagues from Ryerson University and Phonak AG to develop a questionnaire that would allow us to measure hearing handicap related to affective (emotion) speech. The questionnaire we developed, called the Emotional Communication in Hearing Questionnaire (EMO-CHeQ), includes 17 items such as, “I find it difficult to identify the emotions of people speaking on television”.
When we assessed the questionnaire, we found that, on average, adults with hearing impairment experience handicap when listening to emotion in speech and current generation hearing aids do not appear to address this performance deficit. Even more remarkable was that when we looked at people who are very satisfied with their hearing aids, there wasn’t less auditory emotion hearing handicap for this group.
To some extent, this is not too surprising because the focus of hearing instrument research, to date, has more focused on optimizing speech intelligibility and sound quality rather than emotion identification. Importantly, this new research presents us with an important new outcome measure to assess improvements with emotion identification.
If you would like to learn more about our study looking at perception of emotional speech by listeners with hearing aids, read a recently published article in Canadian Acoustics.