Comparative Analysis of Voice Conversion in German

AuthorSchäfer, Karla; Choi, Jeong-Eun; Steinebach, Martin
Date2024
TypeConference Proceedings
AbstractVoice Conversion (VC) has gained attention due to its rapid development and increased accessibility. However, this also brings a potential threat for misuses. Consequently, it is crucial to thoroughly assess the performance of VC models. Current research, however, predominantly focuses on the evaluation of VC models on English, neglecting other languages during evaluation and focusing on one conversion scenario. To address this research gap, this paper aims to evaluate four VC models, namely kNN-VC, FreeVC, QuickVC, and RVC, on German speakers across three different conversion settings: any-to-any conversion (i.e., without fine-tuning), VC with speaker fine-tuning, and VC with language (German) fine-tuning. Additionally, we examined the influence of target speaker audio length using data ranging from 10 to 2400 seconds for generation.
Conference27th International Conference on Pattern Recognition (ICPR 2024)
Isbn978-3-031-78312-8
ISSN0302-9743
SerieLecture Notes in Computer Science
InPattern Recognition, p.387-402
PublisherSpringer
Urlhttps://tubiblio.ulb.tu-darmstadt.de/id/eprint/162115