On Practical Aspects of Multi-condition Training Based on Augmentation for Reverberation-/Noise-Robust Speech Recognition

dc.contributor.authorMálek, Jiří
dc.contributor.authorŽdánský, Jindřich
dc.date.accessioned2019-10-15T06:31:47Z
dc.date.available2019-10-15T06:31:47Z
dc.date.issued2019-01-01
dc.description.abstractMulti-condition training achieved through data augmentation belongs to the most successful techniques for noise/reverberation-robust automatic speech recognition (ASR). Its basic principle, i.e., generation of artificially distorted speech signals, is well documented in the literature. However, the specific choice of hyper-parameters for the generation process and its influence on the results of the subsequent ASR is usually not discussed in detail. Often, it is simply assumed that the augmentation should include as many acoustic conditions as possible. When designed in this broad manner, the computational/storage demands of the augmentation process grow rapidly. In this paper, we rather aim for careful selection of a limited number of acoustic conditions that are highly relevant with respect to the target environment. In this manner, we keep the computational requirements feasible, while retaining the improved accuracy of the augmented models. We experimentally analyze two augmentation scenarios and draw conclusions regarding suitable setup choices. The first case concerns augmentation for reverberation-robust ASR. We propose to exploit Clarity C50 as a feature for selection of Room Impulse Responses (RIRs) crucial for the augmentation. We show that mismatches in other RIR-related parameters, such as Reverberation Time T60 or the room dimension, have small influence on ASR accuracy, as long as the training-test conditions are matched from the C50 perspective. Subsequently, we investigate the augmentation for noise-reverberation-robust ASR. We discuss selection of Signal-to-Noise Ratio (SNR), the type of noise and reverberation level of speech. We observe the influence of mismatches in these parameters on the ASR accuracy. © 2019, Springer Nature Switzerland AG.cs
dc.identifier.doi10.1007/978-3-030-27947-9_21
dc.identifier.urihttps://dspace.tul.cz/handle/15240/154026
dc.identifier.urihttps://link.springer.com/chapter/10.1007/978-3-030-27947-9_21
dc.language.isocscs
dc.publisherSpringer Verlag
dc.relation.ispartofLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
dc.subjectData augmentationcs
dc.subjectFar speech recognitioncs
dc.subjectMulti-condition trainingcs
dc.subjectNoisy speech recognitioncs
dc.titleOn Practical Aspects of Multi-condition Training Based on Augmentation for Reverberation-/Noise-Robust Speech Recognitioncs
dc.typeConference Paper
local.citation.epage263
local.citation.spage251
local.event.edate2019-09-13
local.event.locationLjubljana; Slovenia
local.event.sdate2019-09-11
local.event.title22nd International Conference on Text, Speech, and Dialogue, TSD 2019
local.identifier.publikace7162
local.relation.volume11697
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
2019_Book_TextSpeechAndDialogue.pdf
Size:
26.14 MB
Format:
Adobe Portable Document Format
Description:
článek
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Collections