A Study of Bilinear Models in Voice Conversion

• 作者: Jani Nurminen Moncef Gabbouj Victor Popa
• 来源期刊: 信号与信息处理(英文)
• 学科: 数学
• 关键词: Line Spectral Frequencies (LSF) GAUSSIAN Mixture Model (GMM) BILINEAR Models (BL) SINGULAR Value DECOMPOSITION (SVD) TEMPORAL DECOMPOSITION (TD) Factor Analysis
• 年，卷（期）: 2011,（2）
• 页码范围: 125-139
• 页数: 15页
• 分类号: O1

摘要

This paper presents a voice conversion technique based on bilinear models and introduces the concept of contextual modeling. The bilinear approach reformulates the spectral envelope representation from line spectral frequencies feature to a two-factor parameterization corresponding to speaker identity and phonetic information, the so-called style and content factors. This decomposition offers a flexible representation suitable for voice conversion and facilitates the use of efficient training algorithms based on singular value decomposition. In a contextual approach (bilinear) models are trained on subsets of the training data selected on the fly at conversion time depending on the characteristics of the feature vector to be converted. The performance of bilinear models and context modeling is evaluated in objective and perceptual tests by comparison with the popular GMM-based voice conversion method for several sizes and different types of training data.