Publication

Singing voice resynthesis using vocal sound libraries

View document

Bibliographic Details
Summary:Although resynthesis may seem a simple analysis/synthesis process, it is a quite complex task, even more when it comes to recreating a singing voice. This paper presents a system whose goal is to start with an original audio stream of someone singing and recreate the same performance (melody, phonetics, dynam-ics) using an internal vocal sound library (choir or solo voice). By extracting dynamics and pitch information, and looking for phonetic similarities between the original audio frames and the frames of the sound library, a completely new audio stream is created. The obtained audio results, although not perfect (mainly due to the existence of audio artifacts), show that this technologi-cal approach may become an extremely powerful audio tool.
Main Authors:Fonseca, Nuno
Other Authors:Ferreira, Aníbal
Subject:Audio acoustics Linguistics Analysis/synthesis Audio frames Audio tools Complex task Performance Resynthesis Simple analysis Singing voices Synthesis process
Year:2010
Country:Portugal
Document type:conference paper
Access type:open access
Associated institution:Universidade de Leiria e Oeste
Language:English
Origin:IC-online
Description
Summary:Although resynthesis may seem a simple analysis/synthesis process, it is a quite complex task, even more when it comes to recreating a singing voice. This paper presents a system whose goal is to start with an original audio stream of someone singing and recreate the same performance (melody, phonetics, dynam-ics) using an internal vocal sound library (choir or solo voice). By extracting dynamics and pitch information, and looking for phonetic similarities between the original audio frames and the frames of the sound library, a completely new audio stream is created. The obtained audio results, although not perfect (mainly due to the existence of audio artifacts), show that this technologi-cal approach may become an extremely powerful audio tool.

Funded activities

No funded projects found.